]> code.communitydata.science - cdsc_reddit.git/tree
Update submissions to parse using the backfill queue.
-rw-r--r-- 75 .gitignore
-rw-r--r-- 921 check_comments_shas.py
-rwxr-xr-x 1052 check_submission_shas.py
-rw-r--r-- 689 checkpoint_parallelsql.sbatch
-rwxr-xr-x 433 comments_2_parquet.sh
-rwxr-xr-x 3349 comments_2_parquet_part1.py
-rwxr-xr-x 1390 comments_2_parquet_part2.py
drwxr-xr-x - examples
-rw-r--r-- 1508 helper.py
-rwxr-xr-x 459 pull_pushshift_comments.sh
-rwxr-xr-x 758 pull_pushshift_submissions.sh
-rwxr-xr-x 221 run_tf_jobs.sh
-rw-r--r-- 503 sort_tf_comments.py
-rw-r--r-- 202 submissions_2_parquet.sh
-rwxr-xr-x 4762 submissions_2_parquet_part1.py
-rw-r--r-- 1746 submissions_2_parquet_part2.py
-rwxr-xr-x 7726 tf_comments.py
-rw-r--r-- 2550 top_comment_phrases.py

Community Data Science Collective || Want to submit a patch?