code.communitydata.science - cdsc

]> code.communitydata.science - cdsc_reddit.git/commit

author	Nate E TeBlunthuis <nathante@mox2.hyak.local>
	Wed, 9 Dec 2020 01:32:20 +0000 (17:32 -0800)
committer	Nate E TeBlunthuis <nathante@mox2.hyak.local>
	Wed, 9 Dec 2020 01:32:20 +0000 (17:32 -0800)
commit	e6294b5b90135a5163441c8dc62252dd6a188412
tree	805114af6f0249357623fbc1416a1a71ad7d4332	tree \| snapshot
parent	a60747292e91a47d122158659182f82bfd2e922a	commit \| diff

Refactor and reorganze.

47 files changed:

author_cosine_similarity.py	[deleted file]	blob \| history
clustering/clustering.py	[moved from clustering.py with 98% similarity]	diff \| blob \| history
clustering/fit_tsne.py	[moved from fit_tsne.py with 100% similarity]	blob \| history
datasets/checkpoint_parallelsql.sbatch	[moved from checkpoint_parallelsql.sbatch with 100% similarity]	blob \| history
datasets/comments_2_parquet.sh	[moved from comments_2_parquet.sh with 100% similarity]	blob \| history
datasets/comments_2_parquet_part1.py	[moved from comments_2_parquet_part1.py with 100% similarity]	blob \| history
datasets/comments_2_parquet_part2.py	[moved from comments_2_parquet_part2.py with 100% similarity]	blob \| history
datasets/helper.py	[moved from helper.py with 100% similarity]	blob \| history
datasets/job_script.sh	[new file with mode: 0755]	blob
datasets/submissions_2_parquet.sh	[moved from submissions_2_parquet.sh with 100% similarity]	blob \| history
datasets/submissions_2_parquet_part1.py	[moved from submissions_2_parquet_part1.py with 100% similarity]	blob \| history
datasets/submissions_2_parquet_part2.py	[moved from submissions_2_parquet_part2.py with 100% similarity]	blob \| history
dumps/check_comments_shas.py	[moved from check_comments_shas.py with 100% similarity]	blob \| history
dumps/check_submission_shas.py	[moved from check_submission_shas.py with 100% similarity]	blob \| history
dumps/pull_pushshift_comments.sh	[moved from pull_pushshift_comments.sh with 100% similarity]	blob \| history
dumps/pull_pushshift_submissions.sh	[moved from pull_pushshift_submissions.sh with 100% similarity]	blob \| history
ngrams/#ngrams_helper.py#	[new file with mode: 0644]	blob
ngrams/checkpoint_parallelsql.sbatch	[new file with mode: 0644]	blob
ngrams/run_tf_jobs.sh	[moved from run_tf_jobs.sh with 100% similarity]	blob \| history
ngrams/sort_tf_comments.py	[moved from sort_tf_comments.py with 100% similarity]	blob \| history
ngrams/tf_comments.py	[moved from tf_comments.py with 89% similarity]	diff \| blob \| history
ngrams/top_comment_phrases.py	[moved from top_comment_phrases.py with 100% similarity]	blob \| history
old/#tfidf_authors.py#	[new file with mode: 0644]	blob
old/#tfidf_comments_weekly.py#	[new file with mode: 0644]	blob
old/.#tfidf_authors.py	[new symlink]	blob
old/.#tfidf_comments_weekly.py	[new symlink]	blob
old/author_cosine_similarity.py	[new file with mode: 0644]	blob
old/term_cosine_similarity.py	[new file with mode: 0644]	blob
old/tfidf_authors.py	[new file with mode: 0644]	blob
old/tfidf_authors_weekly.py	[new file with mode: 0644]	blob
old/tfidf_comments.py	[new file with mode: 0644]	blob
old/tfidf_comments_weekly.py	[new file with mode: 0644]	blob
similarities/#cosine_similarities.py#	[new file with mode: 0644]	blob
similarities/#tfidf_weekly.py#	[new file with mode: 0644]	blob
similarities/.#cosine_similarities.py	[new symlink]	blob
similarities/.#tfidf_weekly.py	[new symlink]	blob
similarities/Makefile	[new file with mode: 0644]	blob
similarities/__pycache__/similarities_helper.cpython-37.pyc	[new file with mode: 0644]	blob
similarities/cosine_similarities.py	[new file with mode: 0644]	blob
similarities/job_script.sh	[new file with mode: 0755]	blob
similarities/similarities_helper.py	[moved from similarities_helper.py with 74% similarity]	diff \| blob \| history
similarities/tfidf.py	[new file with mode: 0644]	blob
similarities/top_subreddits_by_comments.py	[moved from top_subreddits_by_comments.py with 56% similarity]	diff \| blob \| history
similarities/weekly_cosine_similarities.py	[new file with mode: 0644]	blob
term_cosine_similarity.py	[deleted file]	blob \| history
tfidf_authors.py	[deleted file]	blob \| history
tfidf_comments.py	[deleted file]	blob \| history

Building parquet tables from pushshift reddit dumps.

RSS Atom

Community Data Science Collective || Want to submit a patch?