Active Tasks By Project

Project: Datasets-General-or-Unknown

Switch to All Tasks 5 Phabricator task(s).

Phabricator Link	Wiki Link	Status	Priority	Author	Assignee	Projects	Subtasks	Parent Tasks
T115223	T115223: Provide wikidata downloads as multiple files to make access more robust and efficient	open	Low (yellow)	NealMcB (Nealmcb)		Datasets-General-or-Unknown (Backlog) Wikidata (monitoring)		T88991: improve Wikidata dumps [tracking]
T151876	T151876: Consider using pigz (Zopfli) for Wikidata JSON dump	open	Needs Triage (violet)	hoo (Marius Hoch)		Datasets-General-or-Unknown (Backlog) Wikidata (incoming)		T88991: improve Wikidata dumps [tracking]
T211326	T211326: (Wikidata) Dump maintenance scripts should periodically reload DB configuration	open	Needs Triage (violet)	hoo (Marius Hoch)		Datasets-General-or-Unknown (Backlog) Wikidata (incoming)		T88991: improve Wikidata dumps [tracking]
T72246	T72246: provide incremental JSON dumps for Wikidata	open	Low (yellow)	Lydia_Pintscher (Lydia Pintscher)		Datasets-General-or-Unknown (Done) Wikidata (needs discussion or investigation) MediaWiki-extensions-WikibaseRepository (Backlog)		T88991: improve Wikidata dumps [tracking]
T88991	T88991: improve Wikidata dumps [tracking]	open	High (red)	Lydia_Pintscher (Lydia Pintscher)		Datasets-General-or-Unknown (Done) Wikidata (hold) Tracking-Neverending (Tag)	T211326: (Wikidata) Dump maintenance scripts should periodically reload DB configuration T195419: Wikidata JSON dumps should not include Lexemes T191639: Wikidata JSON dumps do not have the 'ns' (namespace) T182348: dcatap.rdf in dumps contains invalid data T177533: Consider sorting nt dumps and omit duplicate rows T155103: Create a truthy nt dump T151876: Consider using pigz (Zopfli) for Wikidata JSON dump T118379: bz2 dumps cannot be read with PHP T89273: Produce stub dumps for all wikis as soon as a new month starts, then generate all other dumps on second round-robin cycle T190513: Make sure Wikidata entity dump scripts run for only about 1-2hours T181385: Wikidata entity dumpers stuck with 100% CPU on snapshot1007 T177550: Allow dumping only entities in a certain page_id range in each maintenance script run (days: 1) T177486: &#91 Tracking&#93 Wikidata entity dumpers need to cope with the immense Wikidata growth recently T119613: consider a serialization that supports random access for the dump T93658: cron job to create RDF dumps T72385: Wikidata JSON dump: file directory location should follow standard patterns T94019: Generate RDF from JSON T162351: Create a "page prop" RDF dump for Wikidata entities ("pagePropertiesRdf") T98320: &#91 Task&#93 Create dump of entity redirects (JSON or n-triples) T87328: link to json dump documentation from dump site T85407: improve dump documentation T74348: Wikidata dumps contain old-style serialization. T73349: &#91 Bug&#93 Fix empty map serialization behaviour T73992: &#91 Story&#93 JSON should (optionally) contain full URIs for referenced external entities T187888: "Failed to dump Q12129 (Value must be at most 127 characters long.)" when dumping Wikidata as TTL T185589: Repeating blank node ids in Wikidata entity RDF dumps T178978: Include information about Wikidata dumps in Wikidata query service T176844: Look into truthy nt dump performance T144103: Create .nt (NTriples) dumps for wikidata data T91117: &#91 Bug&#93 Empty JSON maps are serialized as empty lists in XML dumps T87329: update and consolidate json dump documentation T87283: Wikidata dumps should have revision ID or other sequence mark T85970: Some Wikidata XML dumps are failing T85133: Introduce setting to allow import of entities from XML dumps. T72247: provide "latest" link for JSON dumps T70792: Wikidata JSON dump: filename prefix T70366: add script for stitching json dump shards T56085: &#91 Task&#93 EntityIdValues should be serialized as strings, not type/number structures. T46580: Script for creating RDF dumps of all entities T179681: Add HDT dump of Wikidata T115223: Provide wikidata downloads as multiple files to make access more robust and efficient T85101: create index for each dump T72246: provide incremental JSON dumps for Wikidata T46581: Partial dumps T119612: Consider a serialization that supports random access for storage in the DB for Wikidata	T88728: Improve Wikimedia dumping infrastructure