covid19.git
20 months agoregenerated following update to R src that creates this file
aaronshaw [Sat, 28 Mar 2020 22:31:36 +0000 (17:31 -0500)]
regenerated following update to R src that creates this file

20 months agoLoading data directly from github URL. Commenting out commands that assume cloned...
aaronshaw [Sat, 28 Mar 2020 22:30:37 +0000 (17:30 -0500)]
Loading data directly from github URL. Commenting out commands that assume cloned repository.

20 months agoMerge pull request #5 from kayleachampion/master
Kaylea Champion [Sat, 28 Mar 2020 21:17:21 +0000 (14:17 -0700)]
Merge pull request #5 from kayleachampion/master

view data

20 months agoMerge pull request #1 from CommunityDataScienceCollective/kaylea/master
Kaylea Champion [Sat, 28 Mar 2020 21:15:53 +0000 (14:15 -0700)]
Merge pull request #1 from CommunityDataScienceCollective/kaylea/master

Some suggested changes.

20 months agoMerge branch 'kaylea/master' of github.com:CommunityDataScienceCollective/COVID-19_Di... kaylea/master
Nathan TeBlunthuis [Sat, 28 Mar 2020 21:13:46 +0000 (14:13 -0700)]
Merge branch 'kaylea/master' of github.com:CommunityDataScienceCollective/COVID-19_Digital_Observatory into kaylea/master

20 months agoMerge branch 'kaylea/master' of github.com:CommunityDataScienceCollective/COVID-19_Di...
Nathan TeBlunthuis [Sat, 28 Mar 2020 21:12:36 +0000 (14:12 -0700)]
Merge branch 'kaylea/master' of github.com:CommunityDataScienceCollective/COVID-19_Digital_Observatory into kaylea/master

20 months agoMerge branch 'kaylea/master' of github.com:CommunityDataScienceCollective/COVID-19_Di...
Nathan TeBlunthuis [Sat, 28 Mar 2020 21:12:36 +0000 (14:12 -0700)]
Merge branch 'kaylea/master' of github.com:CommunityDataScienceCollective/COVID-19_Digital_Observatory into kaylea/master

20 months agoRead the whole input file before making api calls
Nathan TeBlunthuis [Sat, 28 Mar 2020 21:09:28 +0000 (14:09 -0700)]
Read the whole input file before making api calls

20 months agoRead the whole input file before making api calls
Nathan TeBlunthuis [Sat, 28 Mar 2020 21:09:28 +0000 (14:09 -0700)]
Read the whole input file before making api calls

20 months agoMerge pull request #4 from CommunityDataScienceCollective/translations
groceryheist [Sat, 28 Mar 2020 21:07:04 +0000 (14:07 -0700)]
Merge pull request #4 from CommunityDataScienceCollective/translations

Transliterations: Use data from google trends and wikidata to find transliterations.

20 months agoUpdate transliteration results for 2020-03-28 translations
Nathan TeBlunthuis [Sat, 28 Mar 2020 21:03:16 +0000 (14:03 -0700)]
Update transliteration results for 2020-03-28

- renamed results from yesterday into time stamped file

20 months agoRead entire input files before making api calls.
Nathan TeBlunthuis [Sat, 28 Mar 2020 20:55:52 +0000 (13:55 -0700)]
Read entire input files before making api calls.

This is nicer style to not hold onto resources for as long.
It will use a bit more memory.

20 months agoKeep better track of time.
Nathan TeBlunthuis [Sat, 28 Mar 2020 20:49:19 +0000 (13:49 -0700)]
Keep better track of time.

- Add timestamp ot transliterations output file.
- Append wikidata search terms instead of overwriting

20 months agotypo fix
Nathan TeBlunthuis [Sat, 28 Mar 2020 17:01:43 +0000 (10:01 -0700)]
typo fix

20 months agoMerge branch 'translations' of github.com:CommunityDataScienceCollective/COVID-19_Dig...
Nathan TeBlunthuis [Sat, 28 Mar 2020 16:58:43 +0000 (09:58 -0700)]
Merge branch 'translations' of github.com:CommunityDataScienceCollective/COVID-19_Digital_Observatory into translations

20 months agoMerge pull request #6 from aaronshaw/translations
Aaron Shaw [Sat, 28 Mar 2020 15:28:41 +0000 (10:28 -0500)]
Merge pull request #6 from aaronshaw/translations

minimal example in R

20 months agoa minimal example in R that outputs a table of top 5 related search terms per day...
aaronshaw [Sat, 28 Mar 2020 15:18:33 +0000 (10:18 -0500)]
a minimal example in R that outputs a table of top 5 related search terms per day per query

20 months agoA few suggestions for the python script:
Nathan TeBlunthuis [Sat, 28 Mar 2020 03:27:02 +0000 (20:27 -0700)]
A few suggestions for the python script:

- using format strings (f-strings) is a nice way in python to build
strings using variables.
- you can read and process a file in one pass if you iterate over the
open file itself instead of reading it into a variable and then
looping
- i had to change your strip code when i stopped using csv reader
- my python linter and auto-formater hate non-indendent comments
- i added a few lines to print cases where we don't get Ok responses.

20 months agoReorganize wikipedia views subproject into subpackage.
Nathan TeBlunthuis [Sat, 28 Mar 2020 03:13:11 +0000 (20:13 -0700)]
Reorganize wikipedia views subproject into subpackage.

20 months agoadd mwapi to requirements
Nathan TeBlunthuis [Sat, 28 Mar 2020 03:05:07 +0000 (20:05 -0700)]
add mwapi to requirements

20 months agoall data
Kaylea Champion [Sat, 28 Mar 2020 01:24:19 +0000 (18:24 -0700)]
all data

20 months agocleaning out commented code
Kaylea Champion [Sat, 28 Mar 2020 01:19:22 +0000 (18:19 -0700)]
cleaning out commented code

20 months agoreorganizes comments
Kaylea Champion [Sat, 28 Mar 2020 01:17:39 +0000 (18:17 -0700)]
reorganizes comments

20 months agoinitial files
Kaylea Champion [Sat, 28 Mar 2020 01:10:13 +0000 (18:10 -0700)]
initial files

20 months agomakes TSV
Kaylea Champion [Sat, 28 Mar 2020 01:08:43 +0000 (18:08 -0700)]
makes TSV
makes JSON

20 months agomany bug fixes
Kaylea Champion [Sat, 28 Mar 2020 00:24:18 +0000 (17:24 -0700)]
many bug fixes

20 months agoadd output files from tranliteration search using google trends
Nathan TeBlunthuis [Fri, 27 Mar 2020 23:53:03 +0000 (16:53 -0700)]
add output files from tranliteration search using google trends

20 months agoexpand wikidata search to get keywords from google trends
Nathan TeBlunthuis [Fri, 27 Mar 2020 23:52:19 +0000 (16:52 -0700)]
expand wikidata search to get keywords from google trends

20 months agofor testing
Kaylea Champion [Fri, 27 Mar 2020 23:00:36 +0000 (16:00 -0700)]
for testing

20 months agoMerge pull request #3 from kayleachampion/master
Benjamin Mako Hill [Fri, 27 Mar 2020 21:47:15 +0000 (14:47 -0700)]
Merge pull request #3 from kayleachampion/master

adding in an article list

20 months agonew file -- list of article names
Kaylea Champion [Fri, 27 Mar 2020 21:41:38 +0000 (14:41 -0700)]
new file -- list of article names

20 months agostart keeping track of installation requirements
Nathan TeBlunthuis [Fri, 27 Mar 2020 17:55:24 +0000 (10:55 -0700)]
start keeping track of installation requirements

20 months agoupdate output using limited base terms list
Nathan TeBlunthuis [Thu, 26 Mar 2020 18:14:55 +0000 (11:14 -0700)]
update output using limited base terms list

20 months agoshell script to run the whoe process
Nathan TeBlunthuis [Thu, 26 Mar 2020 18:13:23 +0000 (11:13 -0700)]
shell script to run the whoe process

20 months agonarrow base terms
Nathan TeBlunthuis [Thu, 26 Mar 2020 17:24:31 +0000 (10:24 -0700)]
narrow base terms

20 months agoMerge pull request #2 from aaronshaw/patch-1
groceryheist [Thu, 26 Mar 2020 17:23:27 +0000 (10:23 -0700)]
Merge pull request #2 from aaronshaw/patch-1

Update base_terms.txt

20 months agoUpdate base_terms.txt
Aaron Shaw [Thu, 26 Mar 2020 01:28:20 +0000 (20:28 -0500)]
Update base_terms.txt

typo fix

20 months agoFinish MVP for transliterations
Nathan TeBlunthuis [Wed, 25 Mar 2020 05:06:08 +0000 (22:06 -0700)]
Finish MVP for transliterations

code is reasonably well-written
checked that we get seemingly good data back
adding README
adding data

20 months agoUntested code to get labels from wikidata in all languages.
Nathan TeBlunthuis [Wed, 25 Mar 2020 01:04:22 +0000 (18:04 -0700)]
Untested code to get labels from wikidata in all languages.

20 months agoPython code to find wikidata entities to translate. Here we search the api for entit...
Nathan TeBlunthuis [Tue, 24 Mar 2020 22:03:47 +0000 (15:03 -0700)]
Python code to find wikidata entities to translate.  Here we search the api for entities that have covid keywords.

Building system for finding translations from Wikidata.

20 months agoMerge pull request #1 from kayleachampion/patch-1
groceryheist [Tue, 24 Mar 2020 21:31:36 +0000 (14:31 -0700)]
Merge pull request #1 from kayleachampion/patch-1

Update README.md

20 months agoUpdate README.md
Kaylea Champion [Tue, 24 Mar 2020 21:28:17 +0000 (14:28 -0700)]
Update README.md

some language nicing and adding in immediacy goal

20 months agoUpdate README.md
Kaylea Champion [Tue, 24 Mar 2020 21:25:43 +0000 (14:25 -0700)]
Update README.md

language nicing

20 months agoadd code of conduct and elaborate description
Nathan TeBlunthuis [Tue, 24 Mar 2020 19:12:57 +0000 (12:12 -0700)]
add code of conduct and elaborate description

20 months agoInitial commit
groceryheist [Tue, 24 Mar 2020 18:10:29 +0000 (11:10 -0700)]
Initial commit

Community Data Science Collective || Want to submit a patch?