This site is no longer actively maintained. It exists for historical purposes as an example of Phabricator integration and Lua scripting.

Tasks By Project

From cpt

Project: Analytics

Switch to Active Tasks 284 Phabricator task(s).

Phabricator Link Wiki Link Status Priority Author Assignee Projects Subtasks Parent Tasks
T120242 T120242: Consistent MediaWiki state change events | MediaWiki events as source of truth open Medium (orange)
T126494 T126494: Send Mediawiki Kafka logs to Kafka jumbo cluster with TLS encryption declined Needs Triage (violet)
    T129889 T129889: Create mediawiki_ApiAction Kafka topic resolved Medium (orange)
      T134535 T134535: Create a class to make EventRelayer to send events to EventBus endpoint resolved Medium (orange)
        T140908 T140908: Move efSchemaValidate out of global scope resolved Medium (orange)
          T141524 T141524: eventbus should send statsd in batches declined Medium (orange)
            T142139 T142139: Top API user agents stats resolved Medium (orange)
              T153081 T153081: Pageviews Data : removes 1000 limit in the most viewed articles for a given project and timespan API open Low (yellow)
                T155478 T155478: Copy cached API requests from raw webrequests table to ApiAction open Low (yellow)
                T157091 T157091: Make EventBus service support wildcards in schema definitions resolved Needs Triage (violet)
                  T157092 T157092: Support per-topic configuration in EventBus service declined Medium (orange)
                    T159264 T159264: Prototype counting of requests with real time (streaming data) declined Medium (orange)
                    T162365 T162365: ExternalLinksChange Logging instrumentation is completely broken invalid Low (yellow)
                      T166249 T166249: Bulk/Batch event endpoint duplicate Medium (orange)
                        T167180 T167180: Emit revision-score event to EventBus and expose in EventStreams resolved Medium (orange)
                        T171884 T171884: Convert Extension:Dashiki to use extension registration invalid Needs Triage (violet)
                          T175281 T175281: Separate off ChangePropagation for JobQueue as a new deployment resolved High (red)
                            T175316 T175316: Very large jobs posted by Wikidata resolved High (red)
                              T175958 T175958: Add unit tests to EventBus extension resolved Medium (orange)
                                T178881 T178881: Set up ChangeProp for JobQueue in beta resolved High (red)
                                T187102 T187102: Vagrant's /var/log/daemon.log filling up with kafka errors resolved Medium (orange)
                                  T187225 T187225: Set up a Cloud VPS Kafka Cluster with replicated eventbus production data declined Needs Triage (violet)
                                  T187418 T187418: Enable multiple topics in EventStreams URL resolved Low (yellow)
                                    T189303 T189303: Support claimTTL and rootClaimTTL in change-prop resolved Medium (orange)
                                      T190196 T190196: Create <dc>.change-prop.partitioned.mediawiki.job.refreshLinks topic resolved High (red)
                                        T192005 T192005: Disable MirrorMaker for job queue events resolved Medium (orange)
                                          T192198 T192198: Wikidata doesn't update recentchanges resolved Unbreak Now! (pink)
                                            T195500 T195500: Global mass message delivered on meta but not on other wikis? resolved High (red)
                                              T198256 T198256: RFC: Modern Event Platform - Choose Schema Tech resolved Medium (orange)
                                                T199432 T199432: Consider disabling automatic topic creation in main-kafka declined Medium (orange)
                                                  T201063 T201063: Modern Event Platform: Schema Repostories resolved Medium (orange)
                                                  T201068 T201068: Modern Event Platform: Stream Intake Service resolved Medium (orange)
                                                  T201643 T201643: RFC: Modern Event Platform: Schema Registry resolved Medium (orange)
                                                    T201963 T201963: RFC: Modern Event Platform: Stream Intake Service resolved Medium (orange)
                                                      T204183 T204183: EventBus error "Unable to deliver all events: (curl error: 28) Timeout was reached" invalid High (red)
                                                        T204952 T204952: Migrate mediawiki current usage of monolog to log to EventBus to use the new scalable event intake service duplicate Medium (orange)
                                                          T205319 T205319: Modern Event Platform: Stream Configuration resolved Medium (orange)
                                                          T206269 T206269: Consider converting AQS to TypeScript declined Low (yellow)
                                                            T206785 T206785: Modern Event Platform: Stream Intake Service (EventGate): Implementation resolved High (red)
                                                            T206789 T206789: Modern Event Platform: Schema Registry: Implementation resolved Medium (orange)
                                                            T206812 T206812: Git Commit hook that adds a whole new file when a new version of schema is committed resolved Medium (orange)
                                                              T206814 T206814: CI Support for Schema Registry resolved Medium (orange)
                                                              T206815 T206815: Prototype in node intake service resolved Medium (orange)
                                                                T206824 T206824: Make it possible to use $ref in JSONSchemas resolved Medium (orange)
                                                                  T206889 T206889: Develop a library for JSON schema backwards incompatibility detection resolved Medium (orange)
                                                                    T208251 T208251: Modern Event Platform: Stream Intake Service: EventGate security review resolved High (red)
                                                                      T208361 T208361: Make schemas use required $schema property with absolute path (not absolute URL) to the schema duplicate High (red)
                                                                        T209031 T209031: Not able to scoop comment table in labs for mediawiki reconstruction process [EPIC} resolved High (red)
                                                                        T210012 T210012: Define how we vet code & data for ongoing, automated ingestion in Druid declined Needs Triage (violet)
                                                                          T210013 T210013: EventBus extension started emitting rev_count as a string resolved Needs Triage (violet)
                                                                            T210451 T210451: Kafka eqiad.mediawiki.page-delete topic is empty resolved High (red)
                                                                              T210608 T210608: EventBus::createEvent Call to a member function format() on a non-object (boolean) resolved Unbreak Now! (pink)
                                                                                T210693 T210693: Create materialized views on Wiki Replica hosts for better query performance resolved High (red)
                                                                                  T210705 T210705: Move turnilo to nodejs 10 resolved High (red)
                                                                                    T210706 T210706: Move AQS to nodejs 10 resolved High (red)
                                                                                      T210741 T210741: EventStreams process occasionally OOMs declined Low (yellow)
                                                                                        T211247 T211247: Modern Event Platform: Stream Intake Service: Implementation: Deployment Pipeline resolved High (red)
                                                                                        T212529 T212529: Standardize datetimes/timestamps in the Data Lake resolved Medium (orange)
                                                                                        T212853 T212853: Throttling /request dispatcher that fronts eventlogging /MEP endpoint open High (red)
                                                                                          T213561 T213561: Discovery for Kafka cluster brokers declined Medium (orange)
                                                                                            T213564 T213564: Datacenter aware configs for EventGate topic prefixes resolved Medium (orange)
                                                                                              T213566 T213566: Transferring data from Hadoop to production MySQL database resolved Medium (orange)
                                                                                              T213963 T213963: Include git in our alpine docker image on docker-registry.wikimedia.org declined Medium (orange)
                                                                                                T213976 T213976: Workflow to be able to move data files computed in jobs from analytics cluster to production resolved Medium (orange)
                                                                                                T214080 T214080: Rewrite Avro schemas (ApiAction, CirrusSearchRequestSet) as JSONSchema and produce to EventGate resolved High (red)
                                                                                                T214093 T214093: Modern Event Platform: Schema Guidelines and Conventions resolved Medium (orange)
                                                                                                T214430 T214430: Modern Event Platform: Stream Connectors declined Medium (orange)
                                                                                                T214446 T214446: EventBus mediawiki extension should support multiple 'event service' endpoints resolved High (red)
                                                                                                T215001 T215001: Revisions missing from mediawiki_revision_create resolved High (red)
                                                                                                T215442 T215442: Make Refine use JSONSchemas of event data to support Map types and proper types for integers vs decimals resolved High (red)
                                                                                                T216163 T216163: Add monolog adapters for Eventbus resolved High (red)
                                                                                                  T216492 T216492: Page-links-change stream doesn't capture duplicated links open Medium (orange)
                                                                                                    T216504 T216504: page-links-change stream is assigning template propagation events to the wrong edits open Medium (orange)
                                                                                                      T216567 T216567: mediawiki/recentchange event should not use fields with polymorphic types declined Medium (orange)
                                                                                                        T217040 T217040: Add UTC 'Z' suffix to webrequest `dt` field. resolved Medium (orange)
                                                                                                          T217041 T217041: Use Z UTC suffix in EventBus emitted events rather than +00:00 resolved High (red)
                                                                                                            T217059 T217059: Spike [2019-2020 work] Oozie Replacement. Airflow Study / Argo Study resolved Medium (orange)
                                                                                                              T217661 T217661: EventGate (in k8s) takes a long time to load new schemas resolved High (red)
                                                                                                                T218238 T218238: Vagrant initial provision fails on NodeJS version mismatch resolved High (red)
                                                                                                                  T218254 T218254: EventBus extension should never log unserialized events resolved High (red)
                                                                                                                    T218255 T218255: Enabling api-request eventgate to group1 caused minor service disruptions resolved High (red)
                                                                                                                    T218260 T218260: Decrease timeout for EventBus extension for analytics events resolved High (red)
                                                                                                                      T218268 T218268: eventgate-analytics k8s pods occasionally can't produce to kafka resolved High (red)
                                                                                                                        T218305 T218305: EventGate wikimedia implementation should emit rdkafka stats resolved High (red)
                                                                                                                          T218346 T218346: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main resolved High (red)
                                                                                                                          T218347 T218347: Ingest cirrussearchrequest data into druid declined Medium (orange)
                                                                                                                            T218348 T218348: Ingest api data (for posts) into druid open Medium (orange)
                                                                                                                              T218617 T218617: Fix EventLogging schemas that use array for items type resolved Medium (orange)
                                                                                                                                T218680 T218680: EventGate Helm chart should POST test event for readinessProbe resolved High (red)
                                                                                                                                  T219032 T219032: EventGate should be able to configure hasty and guaranteed kafka producers individually resolved High (red)
                                                                                                                                    T219332 T219332: Modern Event Platform: Stream Intake Service: Documentation resolved High (red)
                                                                                                                                      T219374 T219374: Prepare and check storage layer for hi.wikisource resolved Medium (orange)
                                                                                                                                        T219513 T219513: EventGate should extract event time from events and produce to kafka with timestamp resolved High (red)
                                                                                                                                          T219544 T219544: Make hadoop cluster able to push to swift resolved High (red)
                                                                                                                                          T219552 T219552: Schema Registry HTTP Service resolved High (red)
                                                                                                                                          T219556 T219556: Create schema[12]00[12] (schema.svc.{eqiad,codfw}.wmnet) resolved High (red)
                                                                                                                                            T219737 T219737: Ability to create blocks broken resolved Unbreak Now! (pink)
                                                                                                                                              T219842 T219842: [Post-mortem] Kafka Jumbo cluster cannot accept connections resolved Medium (orange)
                                                                                                                                              T219922 T219922: Move eventstreams logging to new logging pipeline declined Medium (orange)
                                                                                                                                                T219928 T219928: Move AQS logging to new logging pipeline resolved Medium (orange)

                                                                                                                                                  ... further results