Tasks By Project

Project: WMF-JobQueue

Switch to Active Tasks 74 Phabricator task(s).

Phabricator Link	Wiki Link	Status	Priority	Author	Assignee	Projects	Subtasks	Parent Tasks
T157088	T157088: [EPIC] Develop a JobQueue backend based on EventBus	resolved	Medium (orange)			User-mobrovac (Backlog) Epic Platform Team Workboards (Done with CPT) MediaWiki-Core-JobQueue WMF-JobQueue (Untriaged) Services (done) Event-Platform (Backlog) Analytics (Analytics-Radar) (Radar - Watching) ChangeProp (Backlog)	T171533: Document ChangeProp and EventBus monitoring T166341: SSDs for main Kafka clusters T163380: Support posting Jobs to EventBus simultaneously with normal job processing T163379: Create JobQueue implementation that posts to EventBus T157093: Support regexes in topic names in ChangeProp T157091: Make EventBus service support wildcards in schema definitions T157090: Generalise deduplication in ChangeProp T157089: Add storage to Change-Prop for deduplication T178881: Set up ChangeProp for JobQueue in beta T175281: Separate off ChangePropagation for JobQueue as a new deployment T198220: Stop and remove old job runners T190327: FY17/18 Q4 Program 8 Services Goal: Complete the JobQueue transition to EventBus T188947: Create an LVS endpoint for jobrunners on videoscalers T188667: Support dynamic rates for ChangeProp T183744: FY17/18 Q3 Program 8 Services Goal: Migrate two high-traffic jobs over to EventBus T183586: Separate ChangeProp and JobQueue Redis T182372: Make Kafka JobQueue use Special:RunSingleJob T175958: Add unit tests to EventBus extension T175957: Options for implementing JobQueue statistics methods T175780: Requests for new JobQueue monitoring capabilities T175727: Support topic arrays in ChangeProp config T175212: Services Q2 2017/18 goal: Migrate a subset of jobs to multi-DC enabled event processing infrastructure. T175146: &#91 RfC&#93 Move RunJobs.php to the mediawiki (core) repository T174600: Add the ability to sign and verify jobs T174599: Set up LVS and VirtualHost for RunSingleJob.php T172832: Investigate use-cases for delayed job executions T169937: Services Q1 2017/18 goal: Begin migrating job queue processing to multi-DC enabled eventbus infrastructure. T166342: New SCB nodes T157094: Create schema for Job event T157092: Support per-topic configuration in EventBus service T182274: Create custom per-job metric reporters capability T175800: Allow easy tuning of the jobqueue concurrency.
T172479	T172479: Collect error logs from jobchron/jobrunner services in Logstash	declined	Low (yellow)			observability (Inbox) Release-Engineering-Team (Watching / External) WMF-JobQueue (Legacy infra) Sustainability (Incident Followup) Performance-Team (Radar) (Watching) Core-Platform-Team-Old (Closed) SRE (Backlog)		T172480: Add a jobrunner server to the Scap canary pool
T172480	T172480: Add a jobrunner server to the Scap canary pool	open	Low (yellow)			Deployments (Scap) (Needs triage) WMF-JobQueue (EventBus infra) Release-Engineering-Team (Seen) Services (watching) Platform Team Legacy (Watching / External) Sustainability (Incident Followup)	T172479: Collect error logs from jobchron/jobrunner services in Logstash
T175146	T175146: [RfC] Move RunJobs.php to the mediawiki (core) repository	stalled	Medium (orange)			TechCom-RFC (TechCom-RFC-Closed) (Approved) MediaWiki-Configuration (Backlog) Platform Team Workboards (Initiatives) (Paused) WMF-JobQueue (EventBus infra) MediaWiki-Core-JobQueue Patch-For-Review	T244826: Create rest endpoint for executing jobs instead of /rpc/RunSingleJob T243096: Jobrunner monitoring still calles /rpc/runJobs.php T246371: Move job traffic from rpc/RunSingleJob to REST endpoint T246389: Enable MW REST API on job runners and video scalers (for the new rest.php job executor)	T157088: [EPIC] Develop a JobQueue backend based on EventBus
T192085	T192085: PHP Fatal in AffectedPagesFinder::getChangedAspects	resolved	High (red)			Patch-For-Review User-Ladsgroup (Incoming) MW-1.31-release-notes (WMF-deploy-2018-04-17 (1.31.0-wmf.30)) MediaWiki-extensions-WikibaseClient (Backlog) WMF-JobQueue (Untriaged) Wikidata-Ministry-Of-Magic (Done) Wikidata (incoming) Services (watching) MW-1.32-notes (WMF-deploy-2018-04-24 (1.32.0-wmf.1))		T190327: FY17/18 Q4 Program 8 Services Goal: Complete the JobQueue transition to EventBus
T198220	T198220: Stop and remove old job runners	resolved	Medium (orange)			User-jijiki (In Progress 🏋️♀️) Event-Platform (Backlog) SRE (Backlog) WMF-JobQueue (Legacy infra) Services (done) User-Joe (Blocking others) Analytics (Analytics-Radar) (Radar - Watching)		T157088: [EPIC] Develop a JobQueue backend based on EventBus
T199432	T199432: Consider disabling automatic topic creation in main-kafka	declined	Medium (orange)			Analytics (Kafka Work) WMF-JobQueue (EventBus infra) ChangeProp (Backlog) User-Elukey (Backlog) Platform Team Legacy (Designing) Event-Platform (Backlog) Services (designing)
T202107	T202107: Job queue should not overload the DB servers when there is replication lag	resolved	Medium (orange)			Platform Team Workboards (Done with CPT) WMF-JobQueue (EventBus infra) Sustainability (Tag) ChangeProp (Backlog) Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)) Services (done)
T204031	T204031: Deploy regular running of wikidata constraint checks using the job queue	resolved	Medium (orange)			Wikimedia-Site-requests (Backlog) WMF-JobQueue (Meta) Platform Team Legacy (Watching / External) wikidata-campsite-a-b-split (Team A owned & driven) Wikidata (in progress) Wikibase-Quality (Backlog) wdwb-tech (Active) Services (watching) Patch-For-Review User-Ladsgroup (Incoming) Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) (Test (Verification)) Wikibase-Quality-Constraints (incoming) User-Addshore (Watching 👀)	T204022: Add functionality to run QualityConstraint checks on an entity after every edit
T204183	T204183: EventBus error "Unable to deliver all events: (curl error: 28) Timeout was reached"	invalid	High (red)			Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)) Event-Platform (Backlog) WMF-JobQueue (EventBus infra) Wikimedia-production-error (Older) Analytics (Event Platform)
T206186	T206186: Create LimitedConcurrencyKafkaConsumer	open	Lowest (sky)			ChangeProp (Backlog) Platform Engineering (Icebox) WMF-JobQueue (Meta)
T207329	T207329: Clear watchlist on enwiki only removes 50 items at a time	resolved	Medium (orange)			Growth-Team (Blocked) Event-Platform (Backlog) MediaWiki-Watchlist (Backlog) MW-1.33-notes (1.33.0-wmf.1; 2018-10-23) WMF-JobQueue (EventBus infra) Analytics (Analytics-Radar) (Radar - Watching) Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)) Services (next)
T207809	T207809: PHP error "CdnPurgeJob never inserted."	resolved	Medium (orange)			MW-1.33-notes (1.33.0-wmf.2; 2018-10-30) Performance-Team (Doing (old)) Wikimedia-production-error (Resolved) MW-1.32-notes (Backlog) Platform Team Legacy (Watching / External) Services (watching) MediaWiki-Cache (HTTP Cache) WMF-JobQueue (Untriaged)
T208922	T208922: PHP Fatal Error: Class undefined: JobExecutor (jobrunners try to run labswiki jobs)	resolved	High (red)			WMF-JobQueue (EventBus infra) Services (done) Wikimedia-production-error (Untriaged) Platform Team Workboards (Done with CPT) Performance-Team (Radar) (Watching)
T210451	T210451: Kafka eqiad.mediawiki.page-delete topic is empty	resolved	High (red)			Services (done) Wikimedia-Incident (Active investigation) Wikidata-Query-Service (Incoming) Event-Platform (Backlog) SRE (Backlog) Wikidata (incoming) Analytics (Incoming) WMF-JobQueue (Untriaged) Platform Team Workboards (Done with CPT) MW-1.33-notes (1.33.0-wmf.4; 2018-11-13)
T210910	T210910: Jobs for otrs-wiki are slower than expected to process	invalid	Needs Triage (violet)			Platform Engineering (Triage Meeting Inbox) Platform Team Workboards (Done with CPT) WMF-JobQueue (EventBus infra)
T212335	T212335: EventBus or CirrusSearch: DomainException from line 353 of /srv/mediawiki/php-1.33.0-wmf.9/vendor/firebase/php-jwt/src/JWT.php: Unknown JSON error: 5	resolved	High (red)			Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)) MW-1.33-notes (1.33.0-wmf.19; 2019-02-26) Analytics (Analytics-Radar) (Radar - Watching) Wikimedia-production-error (Older) Event-Platform (Backlog) Services (doing) CirrusSearch (Uncategorised) Platform Team Workboards (Done with CPT) WMF-JobQueue (EventBus infra)
T213506	T213506: Grafana alerting broken after upgrade to 5.0.0	resolved	High (red)			observability (In progress) Patch-For-Review WMF-JobQueue (Untriaged) TCB-Team (now WMDE-TechWish) (Incoming) Platform Team Workboards (Done with CPT) Services (watching) SRE (Backlog)
T217683	T217683: Delete the mediawiki/services/cp-jobqueue repo	resolved	Needs Triage (violet)			WMF-JobQueue (Untriaged) Services (watching) User-greg (Backlog) Release-Engineering-Team (INBOX) Platform Team Legacy (Watching / External) ChangeProp (Backlog)
T218170	T218170: Finish removal of ukwikimedia wiki	resolved	Low (yellow)			Performance-Team (Inbox) WMF-JobQueue (Meta) Wikimedia-production-error (Sep2019/1.34.wmf.21+)
T218692	T218692: read only on mediawiki generates "LoadBalancer.php: Cannot access the database: Unknown error"	resolved	Medium (orange)			WMF-JobQueue (Core) Platform Team Legacy (Watching / External) Performance-Team (Backlog: Maintenance) Wikimedia-Rdbms (Rdbms library) DBA (Blocked external/Not db team) Sustainability (Incident Followup)
T218812	T218812: RFC: Provide the ability to have time-delayed or time-offset jobs in the job queue	open	Needs Triage (violet)			TechCom-RFC (P2: Resource) Analytics (Analytics-Radar) (Radar - Watching) Event-Platform (Radar) User-ArielGlenn (Short-term backlog) Platform Team Legacy (Watching / External) WMF-JobQueue (Untriaged) ChangeProp (Backlog) serviceops (serviceops-radar) (Watched) Community-Tech (Older: Tracking Work by Others)
T219159	T219159: Partition htmlCacheUpdate job topic	resolved	Needs Triage (violet)			Platform Team Workboards (Done with CPT) Event-Platform (Backlog) Services (done) WMF-JobQueue (Untriaged) Analytics (Analytics-Radar) (Radar - Watching)
T220127	T220127: Reuse JobExecutor within a JobRunner	declined	Medium (orange)			MediaWiki-Core-JobQueue MW-1.35-notes (1.35.0-wmf.19; 2020-02-11) Platform Team Workboards (Clinic Duty Team) (Doing(WIP:5)) WMF-JobQueue (EventBus infra)
T220399	T220399: Migrate cpjobqueue to kubernetes	resolved	Medium (orange)			WMF-JobQueue (EventBus infra) Release-Engineering-Team (Pipeline) SRE (Backlog) Epic ChangeProp (Backlog) Release-Engineering-Team-TODO (Next) Platform Team Initiatives (Containerise Services) serviceops (Incoming 🐫) Platform Team Workboards (Epics) (Epic Backlog) Patch-For-Review Release Pipeline (Backlog)	T244387: Change-Prop consumer group must respect service name T245803: Make changeprop chart depend on Kafka-dev for minikube	T198901: Migrate production services to kubernetes using the pipeline
T221224	T221224: showJobs.php maintenance script useless and misleading in production	open	Low (yellow)			Analytics (Radar) Developer Productivity MediaWiki-Core-JobQueue Platform Team Workboards (Clinic Duty Team) (Later) WMF-JobQueue (Meta) Event-Platform (Radar)
T221368	T221368: cdnPurge and other jobs fail completely to execute	resolved	Unbreak Now! (pink)			Wikimedia-production-error (Apr 2019 / 1.33.wmf.25+) MediaWiki-Core-JobQueue Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)) WMF-JobQueue (Untriaged) Platform Team Workboards (Done with CPT) MW-1.34-notes (1.34.0-wmf.3; 2019-04-30) Performance-Team (Inbox) Services (done)
T224425	T224425: MW Job consumers sometimes pause for several minutes	resolved	High (red)			Discovery-Search (Current work) (Blocked (from outside the team)) WMF-JobQueue (EventBus infra) Platform Team Workboards (Clinic Duty Team) (Blocked Externally) Platform Team Initiatives (Modern Event Platform (TEC2))
T225097	T225097: "JobExecutor not loaded" error for BounceHandlerJob on wikitech.wikimedia.org	open	Low (yellow)			Wikimedia-production-error (Older) MediaWiki-extensions-BounceHandler (Backlog) Cloud-Services (wikitech.wikimedia.org) (Snowflakes) Platform Engineering (Icebox) WMF-JobQueue (EventBus infra)
T226109	T226109: Write incident report for jobs not being executed on 1.34.0-wmf.10	resolved	Medium (orange)			Analytics (Analytics-Radar) (Radar - Watching) Platform Team Workboards (Clinic Duty Team) (Done) Event-Platform (Backlog) MassMessage (Backlog) WMF-JobQueue (Untriaged) SRE (Backlog)
T228525	T228525: If JobQueueEventBus fails to send a job exception is left uncaught	invalid	Needs Triage (violet)			Performance-Team (Inbox) WMF-JobQueue (Untriaged) Wikimedia-production-error (Jul2019/1.34.wmf.13+) Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1)) Platform Team Workboards (Clinic Duty Team) (Done)
T228911	T228911: DBTransactionError "transaction round 'LinksUpdate::doUpdate' still running" (via RunSingleJob.php)	declined	Medium (orange)			Platform Engineering (Icebox) Performance-Team (Radar) (Watching) MediaWiki-Page-derived-data Wikimedia-production-error (Jul2019/1.34.wmf.13+) MediaWiki-Core-JobQueue WMF-JobQueue (Core)
T230730	T230730: Better way to pause writes on elasticsearch	open	Medium (orange)			Platform Engineering (Icebox) Patch-For-Review ChangeProp (Backlog) Event-Platform (Radar) Analytics (Analytics-Radar) (Radar - Watching) WMF-JobQueue (Untriaged) Discovery-Search (elastic / cirrus)
T231194	T231194: Increase concurrency of the cirrusCheckerJob	resolved	Medium (orange)			Discovery-Search (Current work) (Waiting) Services (doing) Platform Team Workboards (Clinic Duty Team) (Done) WMF-JobQueue (Untriaged)
T232362	T232362: Massmessages not going through, log looks fine	resolved	Medium (orange)			WMF-JobQueue (EventBus infra) Platform Team Workboards (Clinic Duty Team) (Done) SRE (Backlog) MassMessage (Backlog)	T232392: EventBus extension must not send batches that are too large
T232379	T232379: MassMessage problems - multiple deliveries and missing deliveries	resolved	Low (yellow)			MassMessage (Backlog) MW-1.34-notes (1.34.0-wmf.23; 2019-09-17) Platform Team Workboards (Clinic Duty Team) (Done) WMF-JobQueue (Untriaged)
T232392	T232392: EventBus extension must not send batches that are too large	resolved	High (red)			MW-1.36-notes (1.36.0-wmf.4; 2020-08-11) good first task (Backlog) Platform Team Workboards (Clinic Duty Team) (Done) WMF-JobQueue (EventBus infra) Event-Platform (Radar) Analytics (Event Platform) Platform Team Initiatives (Modern Event Platform (TEC2))		T232362: Massmessages not going through, log looks fine
T233584	T233584: Re-adjust cirrusSearchLinksUpdate vs cirrusSearchLinksUpdatePrioritized concurrency	resolved	High (red)			Services (done) WMF-JobQueue (Untriaged) Platform Team Workboards (Clinic Duty Team) (Done) Discovery-Search (Current work) (Waiting)
T234226	T234226: MassMessage not delivering messages	resolved	High (red)			MassMessage (Backlog) Patch-For-Review Platform Team Workboards (Clinic Duty Team) (Inbox) WMF-JobQueue (Untriaged)
T235358	T235358: Could not enqueue jobs: "Unable to deliver all events: 500: Internal Server Error"	duplicate	High (red)			Wikimedia-production-error (Oct2019/1.35.wmf.1+) Platform Engineering (Future Initiatives/Small Projects) WMF-JobQueue (EventBus infra)
T238296	T238296: job queue insert rate metrics gone from Grafana	resolved	Needs Triage (violet)			Platform Team Workboards (Clinic Duty Team) (Inbox) observability (Radar) serviceops (Incoming 🐫) WMF-JobQueue (Untriaged) MediaWiki-Core-JobQueue
T239394	T239394: Can't rename the translatable page mw:Global_templates/Draft_spec	resolved	Medium (orange)			Platform Team Workboards (Clinic Duty Team) (Inbox) WMF-JobQueue (Untriaged) MediaWiki-extensions-Translate (Backlog) User-DannyS712 (Otherwise closed)
T240518	T240518: Some jobs are not being processed / are processed slowly	resolved	Medium (orange)			Platform Team Workboards (Clinic Duty Team) (Doing(WIP:5)) Structured-Data-Backlog (Triage) MW-1.35-notes (1.35.0-wmf.10; 2019-12-10) Product-Infrastructure-Team-Backlog (Tracking) SDC-Statements (Machine-vision-depicts) (Backlog) MachineVision (Tracking) WMF-JobQueue (Untriaged) SRE (Backlog) Sustainability (Incident Followup)	T240733: TypeError from line 92 of /srv/mediawiki/php-1.35.0-wmf.10/extensions/MachineVision/src/Client/GoogleCloudVisionClient.php: Argument 2 passed to MediaWiki\Extension\MachineVision\Client\GoogleCloudVisionClient::fetchAnnotations() must be an instance of LocalFile, boolean given
T241448	T241448: Job queue broken on Beta Cluster	resolved	Unbreak Now! (pink)			WMF-JobQueue (Untriaged) ChangeProp (Backlog) Platform Engineering (Inbox) Beta-Cluster-Infrastructure (To Triage)
T241905	T241905: Investigate JobQueue outage from 2020-01-04 22:00 UTC	declined	Medium (orange)			SRE-OnFire (SRE-OnFire-Incident-Docs) (Drafts) Platform Team Workboards (Clinic Duty Team) (Later) WMF-JobQueue (EventBus infra)
T242722	T242722: Document the danger of the release timestamp feature in code and on-wiki	open	Medium (orange)			WMF-JobQueue (Meta) Sustainability (Incident Followup) Platform Team Workboards (Clinic Duty Team) (Later)
T242726	T242726: Improve the Kafka job queue's handling of unknown new jobs	open	Medium (orange)			Platform Engineering Roadmap Decision Making (Icebox) Sustainability (Incident Followup) WMF-JobQueue (EventBus infra)
T243096	T243096: Jobrunner monitoring still calles /rpc/runJobs.php	resolved	Medium (orange)			Patch-For-Review Platform Team Workboards (Clinic Duty Team) (Blocked Externally) WMF-JobQueue (Legacy infra) serviceops (Incoming 🐫)		T175146: [RfC] Move RunJobs.php to the mediawiki (core) repository
T244387	T244387: Change-Prop consumer group must respect service name	resolved	Needs Triage (violet)			Platform Team Workboards (Clinic Duty Team) (Done) WMF-JobQueue (Untriaged) ChangeProp (Backlog)		T220399: Migrate cpjobqueue to kubernetes
T244758	T244758: ChangeProp old job warning should take job delay into account	resolved	Needs Triage (violet)			Platform Team Workboards (Clinic Duty Team) (Done) ChangeProp (Backlog) WMF-JobQueue (Untriaged)
T244770	T244770: Enable RunSingleJobHandler endpoint on Job Runner Cluster	resolved	Needs Triage (violet)			Patch-For-Review WMF-JobQueue (Untriaged) serviceops (Incoming 🐫)		T244826: Create rest endpoint for executing jobs instead of /rpc/RunSingleJob
T244826	T244826: Create rest endpoint for executing jobs instead of /rpc/RunSingleJob	resolved	Needs Triage (violet)			MW-1.35-notes (1.35.0-wmf.22; 2020-03-03) MediaWiki-Core-JobQueue Platform Team Workboards (Clinic Duty Team) (Done) WMF-JobQueue (EventBus infra)	T244828: Investigate alternatives to MEDIAWIKI_JOB_RUNNER global T244770: Enable RunSingleJobHandler endpoint on Job Runner Cluster T246156: Convert JobRunner into a service class	T175146: [RfC] Move RunJobs.php to the mediawiki (core) repository
T244828	T244828: Investigate alternatives to MEDIAWIKI_JOB_RUNNER global	resolved	Needs Triage (violet)			Platform Team Workboards (Clinic Duty Team) (Done) WMF-JobQueue (Core) MediaWiki-Core-JobQueue Performance-Team (Radar) (Watching)	T247130: Remove usage of MEDIAWIKI_JOB_RUNNER from WikimediaEvents extension T247129: Remove usage of MEDIAWIKI_JOB_RUNNER from CirrusSearch extension T247128: Remove usage of MEDIAWIKI_JOB_RUNNER from Translate extension	T244826: Create rest endpoint for executing jobs instead of /rpc/RunSingleJob
T245803	T245803: Make changeprop chart depend on Kafka-dev for minikube	resolved	Needs Triage (violet)			Patch-For-Review serviceops (Incoming 🐫) WMF-JobQueue (Untriaged) Platform Team Initiatives (Containerise Services) ChangeProp (Backlog)		T220399: Migrate cpjobqueue to kubernetes
T246156	T246156: Convert JobRunner into a service class	resolved	Needs Triage (violet)			Platform Team Workboards (Clinic Duty Team) (Done) Patch-For-Review MW-1.35-notes (1.35.0-wmf.22; 2020-03-03) WMF-JobQueue (Untriaged) MediaWiki-Core-JobQueue	T246369: JobRunner - clean up deprecations	T244826: Create rest endpoint for executing jobs instead of /rpc/RunSingleJob
T246371	T246371: Move job traffic from rpc/RunSingleJob to REST endpoint	open	Low (yellow)			MediaWiki-Core-JobQueue Platform Team Workboards (Clinic Duty Team) (Waiting for deployment) WMF-JobQueue (EventBus infra) serviceops (serviceops-radar) (Backlog) ChangeProp (Backlog)		T175146: [RfC] Move RunJobs.php to the mediawiki (core) repository T266515: Set ENV SERVERGROUP for jobrunner MW web requests
T246389	T246389: Enable MW REST API on job runners and video scalers (for the new rest.php job executor)	open	Medium (orange)			Platform Team Workboards (Clinic Duty Team) (Blocked Externally) serviceops (Unsorted) Patch-For-Review MediaWiki-Core-JobQueue WMF-JobQueue (EventBus infra)	T247114: Find a way to set elevated timeouts for job running	T175146: [RfC] Move RunJobs.php to the mediawiki (core) repository
T247114	T247114: Find a way to set elevated timeouts for job running	open	Medium (orange)			MediaWiki-Core-JobQueue serviceops (Unsorted) Platform Team Workboards (Clinic Duty Team) (Blocked Externally) Patch-For-Review WMF-JobQueue (Untriaged)		T246389: Enable MW REST API on job runners and video scalers (for the new rest.php job executor)
T247622	T247622: RunSingleJob.php timeout too low at 180 seconds	resolved	High (red)			WMF-JobQueue (Untriaged) serviceops (Incoming 🐫) Platform Engineering (Inbox)
T248602	T248602: Lots of "EventBus: Unable to deliver all events: 504: Gateway Timeout"	duplicate	Medium (orange)			serviceops (Incoming 🐫) Platform Engineering (Inbox) WMF-JobQueue (Untriaged)
T249745	T249745: Could not enqueue jobs: "Unable to deliver all events: 503: Service Unavailable"	open	High (red)			WMF-JobQueue (Untriaged) User-brennen (Logs/Train) Platform Team Workboards (Clinic Duty Team) (Later) Wikimedia-production-error (Older) serviceops (Unsorted)
T255684	T255684: Fix aggregation of change-prop exec time metric	open	Medium (orange)			ChangeProp (Backlog) Platform Team Workboards (Clinic Duty Team) (Later) WMF-JobQueue (Untriaged)
T257583	T257583: Run EventBus tests in MediaWiki core CI	open	Needs Triage (violet)			Release-Engineering-Team (Radar) (Watching/External) Analytics (Analytics-Radar) (Radar - Watching) Platform Engineering Code Jam (Ideas Q1 21/22) Platform Engineering (Tracking/Watching) Continuous-Integration-Config (Backlog) WMF-JobQueue (Untriaged) Event-Platform (Backlog) ChangeProp (Backlog) Platform Engineering Roadmap Decision Making (Code Jam)
T260062	T260062: Jobqueue warnings for old processMediaModeration jobs should be turned off	open	Needs Triage (violet)			WMF-JobQueue (Untriaged) MediaWiki-extensions-MediaModeration (Backlog)		T256982: MediaModeration Productionizing
T260274	T260274: JobQueueError: Could not enqueue jobs from stream [stream]	duplicate	High (red)			Platform Team Workboards (Clinic Duty Team) (Blocked Externally) Patch-For-Review WMF-JobQueue (Untriaged) Wikimedia-production-error (Older)
T261691	T261691: Investigate change-prop commits when messages stop coming into the topic	open	High (red)			ChangeProp (Backlog) Platform Team Workboards (Clinic Duty Team) (Ready (WIP:5)) WMF-JobQueue (Untriaged)
T263301	T263301: Old image unexpectedly overwritten by a revision several years later (after Internal server error)	open	High (red)			MediaWiki-Uploading WMF-JobQueue (Untriaged) Platform Team Workboards (Clinic Duty Team) (Waiting for Review) MW-1.36-notes (1.36.0-wmf.35; 2021-03-16) Wikimedia-production-error (Sep 2020)
T267520	T267520: Translation pages are updated after a long delay on Wikimedia sites	resolved	High (red)			Platform Team Workboards (Clinic Duty Team) (Done) MediaWiki-extensions-Translate (maintenance and operational issues) WMF-JobQueue (Untriaged)
T275432	T275432: MassMessage not delivering	open	Medium (orange)			Platform Team Workboards (Clinic Duty Team) (Later) MassMessage (Backlog) WMF-JobQueue (Untriaged)
T278382	T278382: Clean up CirrusSearch job retries	open	Medium (orange)			Platform Team Workboards (Clinic Duty Team) (Later) CirrusSearch (Uncategorised) WMF-JobQueue (Untriaged) Discovery-Search (making others happy)
T278906	T278906: Change cpjobqueue "processing" time metrics from pre-aggregated quantile to native Prometheus histogram bucket	open	Medium (orange)			Platform Team Workboards (Clinic Duty Team) (Later) observability (Radar) WMF-JobQueue (Untriaged)
T299302	T299302: Linter jobs are running slowly	resolved	High (red)			Platform Engineering (Inbox) serviceops (Incoming 🐫) MediaWiki-extensions-Linter (Backlog) WMF-JobQueue (Untriaged)
T93049	T93049: Same MassMessage is being sent more than once	open	High (red)			Platform Team Workboards (Clinic Duty Team) (Done) MassMessage (Backlog) SRE (Backlog) WMF-JobQueue (Untriaged)
T96113	T96113: Set up dedicated local-dc runners for 'enqueue' router jobs	invalid	Needs Triage (violet)			Sustainability (MediaWiki-MultiDC) (Later) WMF-JobQueue (Untriaged) Platform Engineering (Inbox)