Merge branch 'master' of github.com:CommunityDataScienceCollective/COVID-19_Digital_O...

diff --git a/README.md b/README.md
index 10a868b0fa42cab7cb602444e793af7e28253e84..3848b4f2a6f0466230135469faa9388c63b8946a 100644 (file)
--- a/README.md
+++ b/README.md
@@ -1,8 +1,7 @@
 # COVID-19 Digital Observatory
-The COVID-19 Digital Observatory collects, aggregates, and distributes data from social media, search engine results, and Wikipedia to support immediate public health response and social and data science research related to the pandemic.
+The [COVID-19 Digital Observatory](https://covid19.communitydata.science "Covid-19 Digital Observatory homepage") collects, aggregates, and distributes data from social media, search engine results, and Wikipedia to support immediate public health response and social and data science research related to the pandemic.
 
-The [community data science collective](https://wiki.communitydata.science/Main_Page "The community data science collective wiki") is the early stages of building this project. We expect to make rapid progess and to begin releasing code and data soon.
+The [community data science collective](https://wiki.communitydata.science/Main_Page "The community data science collective wiki") is working with [Pushshift](https://pushshift.io) and others to build this project. We expect to make rapid progess and to release additional code and data soon.
 
-We eagerly welcome contributors! Please get in touch. 
-Contributors are held to the [code of conduct](code_of_conduct.md "link to code of conduct.md").
+We eagerly welcome contributors! Please get in touch, submit pull requests, and visit the [project homepage](https://covid19.communitydata.science "Covid-19 Digital Observatory homepage") for more info. Also, please note that contributors are held to the [code of conduct](code_of_conduct.md "link to code of conduct.md").
 

diff --git a/wikipedia_views/scripts/fetch_daily_views.py b/wikipedia_views/scripts/fetch_daily_views.py
index 4f496fee7351963bc3d1ba5caad45da9de670c17..e3a2ff406d113754e9cd2e5d3401bb7917700c03 100755 (executable)
--- a/wikipedia_views/scripts/fetch_daily_views.py
+++ b/wikipedia_views/scripts/fetch_daily_views.py
@@ -79,7 +79,6 @@ def main():
     t_Out = f"{outputPath}dailyviews{queryDate}.tsv"
 
     with open(articleFile, 'r') as infile:
-        next(infile) #skip header
         articleList = list(infile)
 
     j = []

diff --git a/wikipedia_views/scripts/wikiproject_scraper.py b/wikipedia_views/scripts/wikiproject_scraper.py
index 2ee37428c0487a10a6f9417a6d1aefa5ab671314..9d209a98b5912e6a075ca643d514b7a7aaae3609 100755 (executable)
--- a/wikipedia_views/scripts/wikiproject_scraper.py
+++ b/wikipedia_views/scripts/wikiproject_scraper.py
@@ -109,7 +109,6 @@ def main():
     #3 Saves the list to a file
 
     with open(outputFile, 'w') as f:
-        f.write("Article\n")
         f.write('\n'.join(articleNames)+'\n')
     logging.debug(f"Finished scrape and made a new article file at {datetime.datetime.now()}")