code.communitydata.science - cdsc

]> code.communitydata.science - cdsc_reddit.git/commit

author	Nathan TeBlunthuis <nathante@uw.edu>
	Wed, 24 May 2023 00:18:19 +0000 (17:18 -0700)
committer	Nathan TeBlunthuis <nathante@uw.edu>
	Wed, 24 May 2023 00:18:19 +0000 (17:18 -0700)
commit	07b0dff9bc0dae2ab6f7fb7334007a5269a512ad
tree	9a55776cf6fabb2fb6ec24ba40d9fe1a3d0deec2	tree \| snapshot
parent	811a0d87c4d394c2c7849a613f6aec2d81e49138	commit \| diff

changes for archiving.

47 files changed:

bots/good_bad_bot.py	[deleted file]	blob \| history
clustering/Makefile		diff \| blob \| history
clustering/affinity/subreddit_comment_authors_10000_a.feather	[deleted file]	blob \| history
clustering/fit_tsne.py	[deleted file]	blob \| history
clustering/umap_hdbscan_clustering.py	[deleted file]	blob \| history
clustering/umap_hdbscan_clustering_lsi.py	[deleted file]	blob \| history
clustering/validation.py	[new file with mode: 0644]	blob
datasets/Makefile	[new file with mode: 0644]	blob
datasets/comments_2_parquet_part1.py		diff \| blob \| history
datasets/job_script.sh	[deleted file]	blob \| history
datasets/run_comments_jobs.sbatch	[new file with mode: 0644]	blob
datasets/run_submissions_jobs.sbatch	[new file with mode: 0644]	blob
density/Makefile		diff \| blob \| history
density/job_script.sh		diff \| blob \| history
dumps/remove_duplicate_comments.py	[new file with mode: 0644]	blob
dumps/remove_duplicate_submissions.py	[new file with mode: 0644]	blob
examples/pyarrow_reading.py	[deleted file]	blob \| history
examples/pyarrow_streaming.py	[deleted file]	blob \| history
ngrams/#ngrams_helper.py#	[deleted file]	blob \| history
ngrams/Makefile	[new file with mode: 0644]	blob
ngrams/run_array.sbatch	[new file with mode: 0755]	blob
ngrams/run_job.sbatch	[new file with mode: 0644]	blob
ngrams/tf_comments.py		diff \| blob \| history
ngrams/top_comment_phrases.py	[deleted file]	blob \| history
run_array.sbatch	[new file with mode: 0644]	blob
similarities/Makefile		diff \| blob \| history
similarities/__pycache__/similarities_helper.cpython-37.pyc	[deleted file]	blob \| history
similarities/job_script.sh		diff \| blob \| history
similarities/similarities_helper.py		diff \| blob \| history
similarities/top_subreddits_by_comments.py		diff \| blob \| history
similarities/wang_similarity.py	[deleted file]	blob \| history
similarities/weekly_cosine_similarities.py	[deleted file]	blob \| history
start_spark_and_run.sh	[new file with mode: 0755]	blob
start_spark_cluster.sh	[new file with mode: 0755]	blob
start_spark_worker.sh	[new file with mode: 0755]	blob
timeseries/__init__.py	[deleted file]	blob \| history
timeseries/choose_clusters.py	[deleted file]	blob \| history
timeseries/cluster_timeseries.py	[deleted file]	blob \| history
tsne_subreddit_fit.feather	[deleted file]	blob \| history
visualization/Makefile	[deleted file]	blob \| history
visualization/data/term_affinityprop_10000.feather	[deleted symlink]	blob \| history
visualization/data/term_affinityprop_3000.feather	[deleted symlink]	blob \| history
visualization/data/term_tsne_10000.feather	[deleted symlink]	blob \| history
visualization/data/term_tsne_3000.feather	[deleted symlink]	blob \| history
visualization/subreddit_author_tf_similarities_10000.html	[deleted file]	blob \| history
visualization/subreddit_author_tf_similarities_10000_viewport.html	[deleted file]	blob \| history
visualization/tsne_vis.py	[deleted file]	blob \| history

Building parquet tables from pushshift reddit dumps.

RSS Atom

Community Data Science Collective || Want to submit a patch?