]> code.communitydata.science - cdsc_reddit.git/commit
projects / cdsc_reddit.git / commit
? search:
summary | shortlog | log | commit | commitdiff | tree
(parent: fc6575a) | patch
Build comments dataset similarly to submissions and improve partitioning scheme
authorNate E TeBlunthuis <nathante@mox2.hyak.local>
Tue, 7 Jul 2020 18:45:43 +0000 (11:45 -0700)
committerNate E TeBlunthuis <nathante@mox2.hyak.local>
Tue, 7 Jul 2020 18:45:43 +0000 (11:45 -0700)
commit40d45637702fb51feb9f99ff7f6d71787af765ed
tree571c545a7092a45db24f7d250f08d5c06a7dd132tree | snapshot
parentfc6575a28716f6d1611f988c48d15e64a22687accommit | diff
Build comments dataset similarly to submissions and improve partitioning scheme
comments_2_parquet.py [deleted file] blob | history
comments_2_parquet.sh [new file with mode: 0755] blob
comments_2_parquet_part1.py [new file with mode: 0755] blob
comments_2_parquet_part2.py [new file with mode: 0755] blob
helper.py [new file with mode: 0644] blob
submissions_2_parquet.sh diff | blob | history
submissions_2_parquet_part1.py diff | blob | history
submissions_2_parquet_part2.py diff | blob | history
Building parquet tables from pushshift reddit dumps.

Community Data Science Collective || Want to submit a patch?