code.communitydata.science - mediawiki_dump

]> code.communitydata.science - mediawiki_dump_tools.git/shortlog

projects / mediawiki_dump_tools.git / shortlog

2021-10-18	Nathan TeBlunthuis	use dataclasses and pyarrow for types.	commit \| commitdiff \| tree \| snapshot
2021-10-17	Nathan TeBlunthuis	initial work on parquet support	commit \| commitdiff \| tree \| snapshot
2019-11-11	Nathan TeBlunthuis	remove commented code master	commit \| commitdiff \| tree \| snapshot
2019-11-09	Nathan TeBlunthuis	refactor regex matching in a tidier object oriented...	commit \| commitdiff \| tree \| snapshot
2019-11-09	Nathan TeBlunthuis	validate tests and add asserts and baselines for regex...	commit \| commitdiff \| tree \| snapshot
2019-11-07	sohyeonhwang	added regex scanner v2's dump unit test file regextest...	commit \| commitdiff \| tree \| snapshot
2019-11-07	sohyeonhwang	merging pull containing revert-radius with 2nd version...	commit \| commitdiff \| tree \| snapshot
2019-10-07	groceryheist	add unit tests for configuring revert_radius	commit \| commitdiff \| tree \| snapshot
2019-10-07	groceryheist	make revert radius configurable	commit \| commitdiff \| tree \| snapshot
2019-10-06	groceryheist	Merge branch 'master' into regex_scanner	commit \| commitdiff \| tree \| snapshot
2019-10-05	groceryheist	update baseline outputs	commit \| commitdiff \| tree \| snapshot
2019-10-05	groceryheist	bugfix, remove old legacy persistence flag	commit \| commitdiff \| tree \| snapshot
2019-10-05	sohyeonhwang	changes for regex scanner addition	commit \| commitdiff \| tree \| snapshot
2019-09-22	groceryheist	edont compute persistence by default	commit \| commitdiff \| tree \| snapshot
2019-09-22	groceryheist	elaborate docstring for persistence	commit \| commitdiff \| tree \| snapshot
2018-09-03	groceryheist	improve help for namespace-include	commit \| commitdiff \| tree \| snapshot
2018-09-03	groceryheist	sub assertEquals assertEqual advanced_persistence	commit \| commitdiff \| tree \| snapshot
2018-09-03	Nate E TeBlunthuis	add namespace filter parameter	commit \| commitdiff \| tree \| snapshot
2018-08-24	groceryheist	Merge branch 'advanced_persistence' of code.communityda...	commit \| commitdiff \| tree \| snapshot
2018-08-24	groceryheist	Add parameter for selecting specific namespaces.	commit \| commitdiff \| tree \| snapshot
2018-08-24	groceryheist	Merge branch 'advanced_persistence' of code.communityda...	commit \| commitdiff \| tree \| snapshot
2018-08-24	Nate E TeBlunthuis	Merge branch 'advanced_persistence' of code.communityda...	commit \| commitdiff \| tree \| snapshot
2018-08-24	Nate E TeBlunthuis	add namespace filter parameter	commit \| commitdiff \| tree \| snapshot
2018-08-24	Nate E TeBlunthuis	Merge branch 'advanced_persistence' of code.communityda...	commit \| commitdiff \| tree \| snapshot
2018-08-24	Nate E TeBlunthuis	add namespace filter parameter	commit \| commitdiff \| tree \| snapshot
2018-08-24	Nate E TeBlunthuis	add namespace filter parameter	commit \| commitdiff \| tree \| snapshot
2018-08-20	groceryheist	add support for persistence with segment matching	commit \| commitdiff \| tree \| snapshot
2018-07-10	groceryheist	Prefix page titles with namespace names. mediawiki-utils-migration	commit \| commitdiff \| tree \| snapshot
2018-07-05	groceryheist	migrate to mwxml. This completes the migration away...	commit \| commitdiff \| tree \| snapshot
2018-07-05	groceryheist	migrate to mwpersistence. this fixes many issues. We...	commit \| commitdiff \| tree \| snapshot
2018-07-04	groceryheist	migrate reverts to python-mwreverts	commit \| commitdiff \| tree \| snapshot
2018-07-04	groceryheist	add note to readme about dependency on compression...	commit \| commitdiff \| tree \| snapshot
2018-07-04	groceryheist	add tests for wikipedia, malformed xml, bzip2, correct...	commit \| commitdiff \| tree \| snapshot
2018-07-04	groceryheist	create baseline tests for xml dump processing	commit \| commitdiff \| tree \| snapshot
2018-05-17	Benjamin Mako...	a number of small updates and fixes	commit \| commitdiff \| tree \| snapshot
2017-12-07	groceryheist	support 7z archives with multiple files. add urlencode...	commit \| commitdiff \| tree \| snapshot
2017-02-07	Benjamin Mako...	fix code to work with bzip files	commit \| commitdiff \| tree \| snapshot
2015-07-23	Benjamin Mako...	added list of compressed dump files to .gitignore	commit \| commitdiff \| tree \| snapshot
2015-07-23	Benjamin Mako...	added support to parse namespaces from title	commit \| commitdiff \| tree \| snapshot
2015-07-23	Benjamin Mako...	added README file to document the submodule	commit \| commitdiff \| tree \| snapshot
2015-07-23	Benjamin Mako...	created new repository for wikiq with Mediawiki-Utiliti...	commit \| commitdiff \| tree \| snapshot

Tool for parsing MediaWiki XML dumps built on Python MedaiWiki-Utilities

RSS Atom

Community Data Science Collective || Want to submit a patch?