From: Nathan TeBlunthuis Date: Tue, 31 Mar 2020 23:01:43 +0000 (-0700) Subject: Merge branch 'master' of github.com:CommunityDataScienceCollective/COVID-19_Digital_O... X-Git-Url: https://code.communitydata.science/covid19.git/commitdiff_plain/687da1284f0ccc527046f31b93a5a3ca306a946d?hp=603a7b6ec36d8ca03f90a3bcf1c3fcddedf2837b Merge branch 'master' of github.com:CommunityDataScienceCollective/COVID-19_Digital_Observatory --- diff --git a/README.md b/README.md index 10a868b..3848b4f 100644 --- a/README.md +++ b/README.md @@ -1,8 +1,7 @@ # COVID-19 Digital Observatory -The COVID-19 Digital Observatory collects, aggregates, and distributes data from social media, search engine results, and Wikipedia to support immediate public health response and social and data science research related to the pandemic. +The [COVID-19 Digital Observatory](https://covid19.communitydata.science "Covid-19 Digital Observatory homepage") collects, aggregates, and distributes data from social media, search engine results, and Wikipedia to support immediate public health response and social and data science research related to the pandemic. -The [community data science collective](https://wiki.communitydata.science/Main_Page "The community data science collective wiki") is the early stages of building this project. We expect to make rapid progess and to begin releasing code and data soon. +The [community data science collective](https://wiki.communitydata.science/Main_Page "The community data science collective wiki") is working with [Pushshift](https://pushshift.io) and others to build this project. We expect to make rapid progess and to release additional code and data soon. -We eagerly welcome contributors! Please get in touch. -Contributors are held to the [code of conduct](code_of_conduct.md "link to code of conduct.md"). +We eagerly welcome contributors! Please get in touch, submit pull requests, and visit the [project homepage](https://covid19.communitydata.science "Covid-19 Digital Observatory homepage") for more info. Also, please note that contributors are held to the [code of conduct](code_of_conduct.md "link to code of conduct.md"). diff --git a/wikipedia_views/scripts/fetch_daily_views.py b/wikipedia_views/scripts/fetch_daily_views.py index 4f496fe..e3a2ff4 100755 --- a/wikipedia_views/scripts/fetch_daily_views.py +++ b/wikipedia_views/scripts/fetch_daily_views.py @@ -79,7 +79,6 @@ def main(): t_Out = f"{outputPath}dailyviews{queryDate}.tsv" with open(articleFile, 'r') as infile: - next(infile) #skip header articleList = list(infile) j = [] diff --git a/wikipedia_views/scripts/wikiproject_scraper.py b/wikipedia_views/scripts/wikiproject_scraper.py index 2ee3742..9d209a9 100755 --- a/wikipedia_views/scripts/wikiproject_scraper.py +++ b/wikipedia_views/scripts/wikiproject_scraper.py @@ -109,7 +109,6 @@ def main(): #3 Saves the list to a file with open(outputFile, 'w') as f: - f.write("Article\n") f.write('\n'.join(articleNames)+'\n') logging.debug(f"Finished scrape and made a new article file at {datetime.datetime.now()}")