T123954
|
T123954: Investigate proper set up for using Kafka MirrorMaker with new main Kafka clusters.
|
resolved
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T124077
|
T124077: Update MirrorMaker in Kafka .deb and puppet module [13 pts]
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T124469
|
T124469: 4 more Kafka brokers, 2 in eqiad and 2 codfw
|
declined
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T129889
|
T129889: Create mediawiki_ApiAction Kafka topic
|
resolved
|
Medium (orange)
|
bd808 (Bryan Davis)
|
Ottomata (Andrew Otto)
|
|
|
|
T141524
|
T141524: eventbus should send statsd in batches
|
declined
|
Medium (orange)
|
fgiunchedi (Filippo Giunchedi)
|
Ottomata (Andrew Otto)
|
|
|
|
T157091
|
T157091: Make EventBus service support wildcards in schema definitions
|
resolved
|
Needs Triage (violet)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T157092
|
T157092: Support per-topic configuration in EventBus service
|
declined
|
Medium (orange)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T157822
|
T157822: Support multiple partitions per topic in EventBus
|
declined
|
Medium (orange)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T166341
|
T166341: SSDs for main Kafka clusters
|
declined
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T167180
|
T167180: Emit revision-score event to EventBus and expose in EventStreams
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T187102
|
T187102: Vagrant's /var/log/daemon.log filling up with kafka errors
|
resolved
|
Medium (orange)
|
DLynch (David Lynch)
|
Ottomata (Andrew Otto)
|
|
|
|
T187418
|
T187418: Enable multiple topics in EventStreams URL
|
resolved
|
Low (yellow)
|
Smalyshev (Stas Malyshev)
|
Ottomata (Andrew Otto)
|
|
|
|
T188136
|
T188136: Modern Event Platform: Stream Intake Service: Migrate Mediawiki monolog Kafka uses to eventgate-analytics
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T190196
|
T190196: Create <dc>.change-prop.partitioned.mediawiki.job.refreshLinks topic
|
resolved
|
High (red)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T192005
|
T192005: Disable MirrorMaker for job queue events
|
resolved
|
Medium (orange)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T201063
|
T201063: Modern Event Platform: Schema Repostories
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T201068
|
T201068: Modern Event Platform: Stream Intake Service
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T201643
|
T201643: RFC: Modern Event Platform: Schema Registry
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T201963
|
T201963: RFC: Modern Event Platform: Stream Intake Service
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T204952
|
T204952: Migrate mediawiki current usage of monolog to log to EventBus to use the new scalable event intake service
|
duplicate
|
Medium (orange)
|
Nuria (Nuria)
|
Ottomata (Andrew Otto)
|
|
|
|
T205319
|
T205319: Modern Event Platform: Stream Configuration
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T206785
|
T206785: Modern Event Platform: Stream Intake Service (EventGate): Implementation
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T206789
|
T206789: Modern Event Platform: Schema Registry: Implementation
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T206812
|
T206812: Git Commit hook that adds a whole new file when a new version of schema is committed
|
resolved
|
Medium (orange)
|
Nuria (Nuria)
|
Ottomata (Andrew Otto)
|
|
|
|
T206815
|
T206815: Prototype in node intake service
|
resolved
|
Medium (orange)
|
Nuria (Nuria)
|
Ottomata (Andrew Otto)
|
|
|
|
T206824
|
T206824: Make it possible to use $ref in JSONSchemas
|
resolved
|
Medium (orange)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T207869
|
T207869: Modern Event Platform: Schema Registry Implementation
|
duplicate
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T208361
|
T208361: Make schemas use required $schema property with absolute path (not absolute URL) to the schema
|
duplicate
|
High (red)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T210741
|
T210741: EventStreams process occasionally OOMs
|
declined
|
Low (yellow)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T211247
|
T211247: Modern Event Platform: Stream Intake Service: Implementation: Deployment Pipeline
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T211248
|
T211248: Modern Event Platform: Stream Intake Service: Migrate eventlogging-service-eventbus events to eventgate-main
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T212529
|
T212529: Standardize datetimes/timestamps in the Data Lake
|
resolved
|
Medium (orange)
|
nettrom_WMF (Morten Warncke-Wang)
|
Ottomata (Andrew Otto)
|
|
|
|
T213561
|
T213561: Discovery for Kafka cluster brokers
|
declined
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T213564
|
T213564: Datacenter aware configs for EventGate topic prefixes
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T213566
|
T213566: Transferring data from Hadoop to production MySQL database
|
resolved
|
Medium (orange)
|
bmansurov (b)
|
Ottomata (Andrew Otto)
|
|
|
|
T213976
|
T213976: Workflow to be able to move data files computed in jobs from analytics cluster to production
|
resolved
|
Medium (orange)
|
Nuria (Nuria)
|
Ottomata (Andrew Otto)
|
|
|
|
T214080
|
T214080: Rewrite Avro schemas (ApiAction, CirrusSearchRequestSet) as JSONSchema and produce to EventGate
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T214093
|
T214093: Modern Event Platform: Schema Guidelines and Conventions
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T214446
|
T214446: EventBus mediawiki extension should support multiple 'event service' endpoints
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T215442
|
T215442: Make Refine use JSONSchemas of event data to support Map types and proper types for integers vs decimals
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T215834
|
T215834: EventBusRCFeedEngine should use FormattedRCFeed instead of RCFeedEngine to use updated configuration
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T216504
|
T216504: page-links-change stream is assigning template propagation events to the wrong edits
|
open
|
Medium (orange)
|
Samwalton9 (Sam Walton)
|
Ottomata (Andrew Otto)
|
|
|
|
T217040
|
T217040: Add UTC 'Z' suffix to webrequest `dt` field.
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T217041
|
T217041: Use Z UTC suffix in EventBus emitted events rather than +00:00
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T217661
|
T217661: EventGate (in k8s) takes a long time to load new schemas
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T218238
|
T218238: Vagrant initial provision fails on NodeJS version mismatch
|
resolved
|
High (red)
|
DLynch (David Lynch)
|
Ottomata (Andrew Otto)
|
|
|
|
T218255
|
T218255: Enabling api-request eventgate to group1 caused minor service disruptions
|
resolved
|
High (red)
|
jijiki (effie mouzeli)
|
Ottomata (Andrew Otto)
|
|
|
|
T218268
|
T218268: eventgate-analytics k8s pods occasionally can't produce to kafka
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T218305
|
T218305: EventGate wikimedia implementation should emit rdkafka stats
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T218346
|
T218346: Modern Event Platform: Deploy instance of EventGate service that produces events to kafka main
|
resolved
|
High (red)
|
Nuria (Nuria)
|
Ottomata (Andrew Otto)
|
|
|
|
T218617
|
T218617: Fix EventLogging schemas that use array for items type
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T218680
|
T218680: EventGate Helm chart should POST test event for readinessProbe
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T219032
|
T219032: EventGate should be able to configure hasty and guaranteed kafka producers individually
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T219332
|
T219332: Modern Event Platform: Stream Intake Service: Documentation
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T219513
|
T219513: EventGate should extract event time from events and produce to kafka with timestamp
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T219544
|
T219544: Make hadoop cluster able to push to swift
|
resolved
|
High (red)
|
Nuria (Nuria)
|
Ottomata (Andrew Otto)
|
|
|
|
T219552
|
T219552: Schema Registry HTTP Service
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T219556
|
T219556: Create schema[12]00[12] (schema.svc.{eqiad,codfw}.wmnet)
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T219922
|
T219922: Move eventstreams logging to new logging pipeline
|
declined
|
Medium (orange)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T219936
|
T219936: Investigate if kafka can decline requests to consume from consumers that support an older protocol
|
resolved
|
Medium (orange)
|
Nuria (Nuria)
|
Ottomata (Andrew Otto)
|
|
|
|
T220661
|
T220661: EventGate service runner worker occasionally killed, usually during higher load
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T221390
|
T221390: Make sure any monolog + eventbus fields with binary data are base64 encoded
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T222962
|
T222962: Use new eventgate chart release analytics for eventgate-analytics service.
|
resolved
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T223626
|
T223626: Kafka Connect development work
|
duplicate
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T223628
|
T223628: Replace Camus with Kafka Connect for event data imports
|
duplicate
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T223690
|
T223690: Replace Cassandra-uuid with uuid
|
resolved
|
Medium (orange)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T225110
|
T225110: cirrussearch-request has some validation errors
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T225203
|
T225203: Icinga alert for EventGate validation errors
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T226051
|
T226051: Fix mediawiki_page_restrictions_change table after migration to eventgate-main and schema version 1.0.0
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T226436
|
T226436: Remove Avro + Kafka support in Mediawiki, Refinery and Puppet
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T226668
|
T226668: Factor out eventgate-wikimedia factory into its own gerrit repo and use it for deployment pipeline
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T227958
|
T227958: stream.wikimedia.org/?doc returns an error page
|
resolved
|
High (red)
|
stjn
|
Ottomata (Andrew Otto)
|
|
|
|
T229051
|
T229051: Allow eventgate-analytics service to reach schema.svc.{eqiad,codfw}.wmnet:8190
|
resolved
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T229863
|
T229863: Refactor EventBus mediawiki configuration
|
resolved
|
Needs Triage (violet)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T232122
|
T232122: Decomission eventlogging-service-eventbus and clean up related configs and code
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T232144
|
T232144: Migrate all event-schemas schemas to current.yaml and materialize with jsonschema-tools and remove old schemas
|
resolved
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T233057
|
T233057: Clean up descriptions of fields in included common schemas in mediawiki/event-schemas repository
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T233329
|
T233329: Write and update Event Platform instrumentation documentation for Product teams
|
resolved
|
Medium (orange)
|
nshahquinn-wmf (Neil Shah-Quinn)
|
Ottomata (Andrew Otto)
|
|
|
|
T233432
|
T233432: Figure out how to $ref common schema across schema repositories
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T233629
|
T233629: Public EventGate instance and endpoint for analytics event intake: eventgate-analytics-external
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T233630
|
T233630: Public schema.wikimedia.org endpoint for schema.svc
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T233634
|
T233634: Modern Event Platform: Stream Configuration: Implementation
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T236386
|
T236386: Set up eventgate-logging-external in production
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T238230
|
T238230: Decommission EventLogging backend components by migrating to MEP
|
open
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T238657
|
T238657: eventgate-wikimedia should support using remote stream configuration
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T238837
|
T238837: Develop test environment solution for MEP analytics events
|
resolved
|
High (red)
|
jlinehan (Jason Linehan)
|
Ottomata (Andrew Otto)
|
|
|
|
T238937
|
T238937: Eliminate usage of mocha-eslint from eventstreams
|
resolved
|
Medium (orange)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T239135
|
T239135: Create partitioned CirrusSearchElasticaWrite topic
|
resolved
|
Needs Triage (violet)
|
Pchelolo
|
Ottomata (Andrew Otto)
|
|
|
|
T240355
|
T240355: Update MW Vagrant to work with EventLogging and EventGate changes
|
resolved
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T240477
|
T240477: eventgate-wikimedia should fill in defaults for some important fields
|
resolved
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T240985
|
T240985: Create and use new schema repositories
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T241073
|
T241073: Set up TLS for eventgate-main and eventgate-analytics
|
resolved
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T242122
|
T242122: Deploy EventStreamConfig extension
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T242224
|
T242224: Switch all eventgate clients to use new TLS port
|
resolved
|
Medium (orange)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T242363
|
T242363: Create common http subobject for re-use in event schemas
|
resolved
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T242454
|
T242454: Add examples to all event schemas
|
resolved
|
Needs Triage (violet)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T245859
|
T245859: jsonschema-tools should add a 'latest' symlink
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T246030
|
T246030: Enable client side error logging in prod for small wiki
|
resolved
|
High (red)
|
Nuria (Nuria)
|
Ottomata (Andrew Otto)
|
|
|
|
T249261
|
T249261: Vertical: Migrate SearchSatisfaction EventLogging event stream to Event Platform
|
resolved
|
High (red)
|
Ottomata (Andrew Otto)
|
Ottomata (Andrew Otto)
|
|
|
|
T250844
|
T250844: MEP: canary events so we know events are flowing through pipeline
|
duplicate
|
High (red)
|
Nuria (Nuria)
|
Ottomata (Andrew Otto)
|
|
|
|