]> code.communitydata.science - cdsc_reddit.git/shortlog
projects / cdsc_reddit.git / shortlog
? search:
summary | shortlog | log | commit | commitdiff | tree
first ⋅ prev ⋅ next
cdsc_reddit.git
2020-08-09 Nate E TeBlunthuisUse groupby - joins instead of windows commit | commitdiff | tree | snapshot
2020-08-04 Nate E TeBlunthuisrenamte tf_comments part 2. commit | commitdiff | tree | snapshot
2020-08-04 Nate E TeBlunthuisrename tf_reddit_comments.py step1. commit | commitdiff | tree | snapshot
2020-08-04 Nate E TeBlunthuisImprove tokenization following data. Generate author... commit | commitdiff | tree | snapshot
2020-08-04 Nate E TeBlunthuisimprove tokenizer. commit | commitdiff | tree | snapshot
2020-08-04 Nate E TeBlunthuisTF reddit comments. commit | commitdiff | tree | snapshot
2020-08-04 Nate E TeBlunthuiscode to sort tf commit | commitdiff | tree | snapshot
2020-07-10 Nate E TeBlunthuisremove is_submitter field from submissions which doesn... commit | commitdiff | tree | snapshot
2020-07-08 Nate E TeBlunthuisBugfixes in scripts. commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisclean up comments in streaming example. commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisupdate .gitignore commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisupdate examples with working streaming commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisBuild comments dataset similarly to submissions and... commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisupdate .gitignore commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisScript for example of streaming pyarrow. commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisScript to demonstrate reading parquet. commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisCheck the shas when we download dumps commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisScript to run both parts of submissions_2_parquet.sh commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisCache before sorting so we don't extract twice. commit | commitdiff | tree | snapshot
2020-07-07 Nate E TeBlunthuisMove the spark part of submissions_2_parquet to a separ... commit | commitdiff | tree | snapshot
2020-07-06 Nate E TeBlunthuisFix whitespace at top of file. commit | commitdiff | tree | snapshot
2020-07-06 Nate E TeBlunthuisSecondary sort for the by_author dataset should be... commit | commitdiff | tree | snapshot
2020-07-06 Nate E TeBlunthuisCreate a second dataset sorted by author. commit | commitdiff | tree | snapshot
2020-07-06 Nate E TeBlunthuisCreate parquet datasets of reddit submissions from... commit | commitdiff | tree | snapshot
2020-07-03 Nate E TeBlunthuisRename spark script to reflect that it is for comments. commit | commitdiff | tree | snapshot
2020-07-03 Nate E TeBlunthuisupdate .gitignore commit | commitdiff | tree | snapshot
2020-07-03 Nate E TeBlunthuisbugfix in retrieving old data and rename file. commit | commitdiff | tree | snapshot
2020-07-03 Nate E TeBlunthuisScript for checking shas for submissions. commit | commitdiff | tree | snapshot
2020-07-03 Nate E TeBlunthuisBugfix: use timestamp types commit | commitdiff | tree | snapshot
2020-07-03 Nate E TeBlunthuisupdate the reddit comment dumps commit | commitdiff | tree | snapshot
2020-07-03 Nate E TeBlunthuisDon't clobber old dumps so that we can just download... commit | commitdiff | tree | snapshot
2020-07-03 Nate E TeBlunthuisscript for getting submissions dumps from pushshift. commit | commitdiff | tree | snapshot
2020-07-02 Nate E TeBlunthuisExtract variables from pushshift comment to parquet commit | commitdiff | tree | snapshot
Building parquet tables from pushshift reddit dumps.

Community Data Science Collective || Want to submit a patch?