]> code.communitydata.science - cdsc_reddit.git/tree
Build comments dataset similarly to submissions and improve partitioning scheme
-rw-r--r-- 61 .gitignore
-rw-r--r-- 921 check_comments_shas.py
-rwxr-xr-x 1052 check_submission_shas.py
-rwxr-xr-x 321 comments_2_parquet.sh
-rwxr-xr-x 3349 comments_2_parquet_part1.py
-rwxr-xr-x 1390 comments_2_parquet_part2.py
drwxr-xr-x - examples
-rw-r--r-- 1711 helper.py
-rwxr-xr-x 459 pull_pushshift_comments.sh
-rwxr-xr-x 759 pull_pushshift_submissions.sh
-rw-r--r-- 329 submissions_2_parquet.sh
-rwxr-xr-x 4077 submissions_2_parquet_part1.py
-rw-r--r-- 1789 submissions_2_parquet_part2.py

Community Data Science Collective || Want to submit a patch?