]> code.communitydata.science - mediawiki_dump_tools.git/blob - wikiq_users/run_wikiq_users_standalone.sh
projects / mediawiki_dump_tools.git / blob
? search:
summary | shortlog | log | commit | commitdiff | tree
history | raw | HEAD
add spark program for running group by users
[mediawiki_dump_tools.git] / wikiq_users / run_wikiq_users_standalone.sh
1 #!/usr/bin/env bash
2 spark-submit benchmark_spark.py --output-format csv  -i "../mediawiki_dump_tools/tests/tsvs/*.tsv" -o  "./out.tsv" --num-partitions 2
Tool for parsing MediaWiki XML dumps built on Python MedaiWiki-Utilities

Community Data Science Collective || Want to submit a patch?