Tasks By Project

Project: Sustainability (MediaWiki-MultiDC)

Switch to Active Tasks 38 Phabricator task(s).

Phabricator Link	Wiki Link	Status	Priority	Author	Assignee	Projects	Subtasks	Parent Tasks
T111575	T111575: Make $wgSessionCacheType and $wgMainStash caches multi-DC ready	declined	Medium (orange)			Performance-Team (Doing (old)) Sustainability (MediaWiki-MultiDC) (Later) Epic	T134811: Consider REST with SSL (HyperSwitch/Cassandra) for session storage	T108253: Make sure CentralAuth login tokens work with two datacenters T88445: MediaWiki active/active datacenter investigation and work (tracking)
T114271	T114271: Audit *all* datastores to see how DR failover is handled	open	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Later) Performance-Team (Radar) (Watching) User-mobrovac (Backlog) Epic	T122387: Log multi-DB transaction in MediaWiki	T88445: MediaWiki active/active datacenter investigation and work (tracking)
T120009	T120009: Flow: Use WAN cache delete() and slave populations to avoid merge()	resolved	High (red)			Patch-For-Review Sustainability (MediaWiki-MultiDC) (Later) Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2016) (Product Review) StructuredDiscussions (Backlog)	T94029: Spike: Avoid use of merge() in Flow caches T120008: Remove in-process Memcached wrapper or find an appropriate solution for cross-DC world	T88445: MediaWiki active/active datacenter investigation and work (tracking)
T122708	T122708: ShortUrl must not write to master db on page views (DBPerformance warning)	open	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Discuss next) Performance-Team (Radar) (Perf recommendation) MediaWiki-extensions-ShortUrl (Backlog)	T256993: Deploy read-only mode for ShortUrl	T92357: Fix database master queries from HTTP GET/HEAD before active-active multi-dc
T127455	T127455: Enable HTTPS for Swift traffic	resolved	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Later) SRE-swift-storage (Inbox) Patch-For-Review SRE (Backlog)		T88445: MediaWiki active/active datacenter investigation and work (tracking)
T130946	T130946: Make ?action=markpatrolled require POST	resolved	Low (yellow)			MediaWiki-Patrolling (Backlog) MW-1.29-release (WMF-deploy-2016-11-08_(1.29.0-wmf.2)) MW-1.29-release-notes Patch-For-Review Sustainability (MediaWiki-MultiDC) (Later) Performance-Team (Doing (old))		T88445: MediaWiki active/active datacenter investigation and work (tracking)
T134809	T134809: Apache <=> mariadb SSL/TLS for cross-datacenter writes	stalled	Medium (orange)			Performance-Team (Radar) (Watching) DBA (Meta/Epic) Sustainability (MediaWiki-MultiDC) (Discuss next) SRE (Acknowledged)	T196378: Investigate solutions for MySQL connection pooling T171071: Perform testing for TLS effect on connection rate T136218: Audit mysql database class and hhvm binding support of SSL T111654: Set up TLS for MariaDB replication	T88445: MediaWiki active/active datacenter investigation and work (tracking)
T134811	T134811: Consider REST with SSL (HyperSwitch/Cassandra) for session storage	resolved	Low (yellow)			SRE (Acknowledged) Services (designing) Performance-Team (Radar) (Watching) Platform Team Workboards (Done with CPT) Sustainability (MediaWiki-MultiDC) (Discuss next)	T137272: Create BagOStuff subclass for HTTP	T111575: Make $wgSessionCacheType and $wgMainStash caches multi-DC ready T88445: MediaWiki active/active datacenter investigation and work (tracking)
T150506	T150506: Avoid lazyImportLocalNames() master writes on GET requests (Run a script to backfill them once for all)	resolved	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Discuss next) MW-1.36-notes (1.36.0-wmf.36; 2021-03-23) MediaWiki-extensions-CentralAuth (Incoming) User-Majavah (Done) Patch-For-Review Performance-Team (Radar) (Watching) MW-1.37-notes (1.37.0-wmf.4; 2021-05-04) Platform Team Workboards (Clinic Duty Team) (Waiting for Review)		T154552: ApiLogin should not open master connection to centralauth DB
T151466	T151466: Performance Q2 2017/18 goal: Install and use mcrouter in deployment-prep	resolved	Low (yellow)			Release-Engineering-Team (Watching / External) Beta-Cluster-Infrastructure (Backlog) Performance-Team (Doing (old)) Sustainability (MediaWiki-MultiDC) (Later)	T190979: build new version of mcrouter package T175418: Create new instances memc05 and memc06 running memcached	T175213: 2017/18 Annual Plan Program 8: Multi-datacenter support, Q2 goals
T151903	T151903: Special:Search performs DB writes on GET request	resolved	Lowest (sky)			CirrusSearch (Uncategorised) Performance-Team (Radar) (Perf recommendation) MW-1.34-notes (1.34.0-wmf.5; 2019-05-14) Discovery Patch-For-Review Sustainability (MediaWiki-MultiDC) (Later) Discovery-Search (later on...)		T92357: Fix database master queries from HTTP GET/HEAD before active-active multi-dc
T154552	T154552: ApiLogin should not open master connection to centralauth DB	stalled	Medium (orange)			MediaWiki-Authentication-and-authorization (Backlog) MediaWiki-extensions-CentralAuth (Incoming) Sustainability (MediaWiki-MultiDC) (Later)	T150506: Avoid lazyImportLocalNames() master writes on GET requests (Run a script to backfill them once for all)
T154556	T154556: Babel autocreates category and system user on GET	resolved	Needs Triage (violet)			MediaWiki-extensions-Babel (BabelBot) Sustainability (MediaWiki-MultiDC) (Current: Performance Team) MW-1.31-release-notes (WMF-deploy-2018-04-03 (1.31.0-wmf.28)) Patch-For-Review		T92357: Fix database master queries from HTTP GET/HEAD before active-active multi-dc
T154596	T154596: SpecialModifyEntity master queries on page views	duplicate	Medium (orange)			MediaWiki-General Wikidata (incoming) Sustainability (MediaWiki-MultiDC) (Later)		T92357: Fix database master queries from HTTP GET/HEAD before active-active multi-dc
T164860	T164860: Update Echo's caching strategy for multi-dc compatibility	resolved	Needs Triage (violet)			Collaboration-Team-Triage (Near-Term Interest) Performance-Team (Radar) (Watching) Growth-Team (Current Sprint) (Code Review) MW-1.32-notes (WMF-deploy-2018-08-21 (1.32.0-wmf.18)) Sustainability (MediaWiki-MultiDC) (Later) Notifications (Backlog)		T88445: MediaWiki active/active datacenter investigation and work (tracking)
T171071	T171071: Perform testing for TLS effect on connection rate	resolved	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Discuss next) SRE (Backlog) Performance-Team (Doing (old)) DBA (Blocked external/Not db team) Patch-For-Review	T175672: Make apache/maintenance hosts TLS connections to mariadb work	T134809: Apache mariadb SSL/TLS for cross-datacenter writes
T175418	T175418: Create new instances memc05 and memc06 running memcached	resolved	Low (yellow)			Beta-Cluster-Infrastructure (To Triage) Release-Engineering-Team (Watching / External) Sustainability (MediaWiki-MultiDC) (Later)		T151466: Performance Q2 2017/18 goal: Install and use mcrouter in deployment-prep
T175672	T175672: Make apache/maintenance hosts TLS connections to mariadb work	open	Medium (orange)			DBA (Backlog) Sustainability (MediaWiki-MultiDC) (Discuss next) Performance-Team (Radar) (Watching) Services (watching)		T171071: Perform testing for TLS effect on connection rate
T188801	T188801: Migrate wl_notificationtimestamp updates to the job queue	resolved	Medium (orange)			MediaWiki-Watchlist (Backlog) Patch-For-Review Growth-Team (Inbox) MW-1.33-notes (1.33.0-wmf.22; 2019-03-19) Sustainability (MediaWiki-MultiDC) (Current: Performance Team)		T92357: Fix database master queries from HTTP GET/HEAD before active-active multi-dc
T196378	T196378: Investigate solutions for MySQL connection pooling	open	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Later) Performance-Team (Radar) (Watching) DBA (Backlog)		T134809: Apache mariadb SSL/TLS for cross-datacenter writes
T204245	T204245: Run MediaWiki media originals active/active	open	Medium (orange)			Performance-Team (Radar) (Watching) Epic Services (watching) User-fgiunchedi (Radar) Sustainability (MediaWiki-MultiDC) (Discuss next)		T88445: MediaWiki active/active datacenter investigation and work (tracking)
T212129	T212129: Move MainStash out of Redis to a simpler multi-dc aware solution	open	Medium (orange)			SRE (Acknowledged) Performance-Team (Backlog: Future Goals) User-mobrovac (Backlog) MediaWiki-General User-jijiki (St) Patch-For-Review serviceops (serviceops-radar) (Watched) Sustainability (MediaWiki-MultiDC) (Current: Performance Team)	T222851: Improve Echo seentime code for multi-DC access T229062: Look into a simple way to have global keys with db-replicated T254634: Determine and implement multi-dc strategy for ChronologyProtector T267270: Determine multi-dc strategy for CentralAuth T269324: Productionize x2 databases T274174: Add modtoken field and flags to objectcache table	T113916: Switch ResourceLoader file dependency tracking to MultiDC-friendly backend T243520: Decommission the "session redis" cluster T267581: Phasing out "redis_sessions" MediaWiki cluster and away from the memcached cluster T270223: FY2021-2022: Enable basic Multi-DC operations for read traffic (tracking) T88445: MediaWiki active/active datacenter investigation and work (tracking)
T216287	T216287: BannerMessageGroup::registerGroupHook of CentralNotice must not query master on GET request (page views)	open	High (red)			Fundraising-Backlog (Q3 2021-2022) Wikimedia-production-error (Older) Wikimedia-FR-Tech-Projects (FR-Q2-FY2019-20-cleanup-list) (Backlog) Wikimedia-FR-Tech-Projects (Fr-CentralNotice-Translation-Bugs) (Backlog) Sustainability (MediaWiki-MultiDC) (Current: Other) MediaWiki-extensions-CentralNotice (Backlog) Performance-Team (Radar) (Perf recommendation)		T92357: Fix database master queries from HTTP GET/HEAD before active-active multi-dc
T219592	T219592: Frequent Echo DB_MASTER write queries on HTTP GET	open	Medium (orange)			Patch-For-Review Services (watching) Sustainability (MediaWiki-MultiDC) (Later) Performance-Team (Radar) (Perf recommendation) Notifications (Backlog) Growth-Team (Current Sprint) (Code Review)		T88445: MediaWiki active/active datacenter investigation and work (tracking)
T227376	T227376: Move callers away from getMainObjectStash() that do not need it	open	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Later) Platform Team Workboards (External Code Reviews) (External Code Review Needed) Patch-For-Review WMF-General-or-Unknown Performance-Team (Backlog: Maintenance)	T236414: CPT review/work for MediaWiki caching class maintenance ramp-up
T232258	T232258: DBPerformance warning: Unexpected master query on GET from difference page	resolved	Needs Triage (violet)			MW-1.34-notes (1.34.0-wmf.22; 2019-09-10) Platform Engineering (Triage Meeting Inbox) Sustainability (MediaWiki-MultiDC) (Later) Performance-Team (Radar) (Perf recommendation)
T236414	T236414: CPT review/work for MediaWiki caching class maintenance ramp-up	open	Medium (orange)			Platform Team Workboards (External Code Reviews) (External Code Review Needed) Sustainability (MediaWiki-MultiDC) (Current: Platform Team) Performance-Team (Radar) (Watching)		T227376: Move callers away from getMainObjectStash() that do not need it
T254634	T254634: Determine and implement multi-dc strategy for ChronologyProtector	resolved	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Current: Platform Team) Wikimedia-Rdbms (Rdbms library) Performance-Team (Doing: Goal-oriented) User-jijiki (Inbox 🐅) Patch-For-Review serviceops (Unsorted) Platform Engineering (Tracking/Watching) MW-1.36-notes (1.36.0-wmf.36; 2021-03-23)		T212129: Move MainStash out of Redis to a simpler multi-dc aware solution T243520: Decommission the "session redis" cluster T270223: FY2021-2022: Enable basic Multi-DC operations for read traffic (tracking)
T267270	T267270: Determine multi-dc strategy for CentralAuth	open	Low (yellow)			Code-Health-Objective Sustainability (MediaWiki-MultiDC) (Current: Platform Team) MW-1.36-notes (1.36.0-wmf.36; 2021-03-23) Performance-Team (Radar) (Watching) serviceops (Incoming 🐫) Platform Team Workboards (Clinic Duty Team) (Ready (WIP:5)) Platform Team Initiatives (Session Management Service (CDP2))	T278392: Storage solution for cross-datacenter tokens	T212129: Move MainStash out of Redis to a simpler multi-dc aware solution T270223: FY2021-2022: Enable basic Multi-DC operations for read traffic (tracking)
T274724	T274724: Add support for "Max-Age" to WebResponse::setCookie (more reliable than "Expires")	open	Needs Triage (violet)			MediaWiki-General Sustainability (MediaWiki-MultiDC) (Later) Wikimedia-Rdbms (Rdbms library) Performance-Team (Radar) (Perf recommendation)
T278392	T278392: Storage solution for cross-datacenter tokens	open	Medium (orange)			Patch-For-Review MediaWiki-extensions-OAuth (Backlog) Performance-Team (Next: Goal / Oct-Dec '21) MediaWiki-extensions-CentralAuth (Incoming) ConfirmEdit (CAPTCHA extension) (Backlog) Sustainability (MediaWiki-MultiDC) (Later)		T267270: Determine multi-dc strategy for CentralAuth
T283265	T283265: Many Special pages that query user blocks make primary database connections on GET requests	open	High (red)			Performance-Team (Radar) (Perf recommendation) Anti-Harassment (Production-error) Platform Team Workboards (MW Expedition) (Waiting for Review) Patch-For-Review Sustainability (MediaWiki-MultiDC) (Current: Other)
T88445	T88445: MediaWiki active/active datacenter investigation and work (tracking)	open	Medium (orange)			User-mobrovac (Backlog) Platform Team Workboards (Initiatives) (Later) Sustainability (MediaWiki-MultiDC) (Later) Platform Team Initiatives (Multi-DC (TEC1)) Performance-Team (Radar) (Watching) Epic	T219592: Frequent Echo DB_MASTER write queries on HTTP GET T212129: Move MainStash out of Redis to a simpler multi-dc aware solution T221159: FY18/19 TEC1.6 Q4: Improve or replace the usage of GTID_WAIT with pt-heartbeat in MW T206016: Create a service for session storage T114271: Audit *all* datastores to see how DR failover is handled T164860: Update Echo's caching strategy for multi-dc compatibility T120543: Investigate write mode flag cleanup for Flow API modules T92863: Configure 'enqueue' job queue type to be DC-local and in a dedicated runner loop T89389: Try to avoid doCascadeProtectionUpdates() call on page view T88506: Make FileRepo file cache misses use slaves instead of the master T137326: Log post-send DB updates and make sure their frequency is acceptable T124795: codfw is in read only according to mediawiki T120009: Flow: Use WAN cache delete() and slave populations to avoid merge() T119642: Create a Master-master topology between datacenters for easier failover (setup circular replication dallas -> eqiad for mysql databases) T114273: Cleanup active-DC based MW config code and make it more robust and easy to change T111266: Make LoadBalancer slave lag check and read-only mode more robust (for example, using pt-heartbeat) T94028: DB master connections requested by Flow on GET/HEAD requests T91869: Implement a replication strategy for Swift T220170: Address Database hardware infrastructure blockers on datacenter switchover & multi-dc deployment T204245: Run MediaWiki media originals active/active T135027: MASTER_POS_WAIT() alternative that works cross-DC T134809: Apache mariadb SSL/TLS for cross-datacenter writes T127455: Enable HTTPS for Swift traffic T114398: Make and document DC switch-over scripts T113204: Smart caching logic for handling cross-DC network outages T113192: Consider using delayed rebound purges for CDN T112708: Support for master/slave FileBackend distinction in FileBackendMultiwrite T111575: Make $wgSessionCacheType and $wgMainStash caches multi-DC ready T134811: Consider REST with SSL (HyperSwitch/Cassandra) for session storage T108253: Make sure CentralAuth login tokens work with two datacenters T99208: Make sure $wgUseLocalMessageCache works with multiple DCs T97686: Keep TorExitNodes node list cache populated in *both* datacenters T97620: Convert various core/extension cache users to ReplicatedBagOStuff T97562: WANObjectCache relay daemon or mcrouter support T97335: Make CachingSiteStore use WANObjectCache T95126: Make RedisBagOStuff support tag name hashing T94480: Audit and fix extensions that call saveSettings() to lazy-set preferences when loaded T94448: Echo doing master queries on simple GET requests T93144: Check multi-datacenter compatibility with GettingStarted's use of Redis T93141: Convert various core/extension cache users to the WAN cache as needed T93006: Figure out a cross-DC strategy for the BloomFilter caches T92357: Fix database master queries from HTTP GET/HEAD before active-active multi-dc T92007: Investigate a better alternative for making user_newtalk talk updates T91870: Figure out a replication strategy for ElasticSearch T91837: Consider moving various DB writes on page views to using local jobs T91820: Create HTTP verb and sticky cookie DC routing in VCL T91816: Add code to enable setting sticky DC cookies for POST requests T91819: Use local jobqueue class for jobs enqueued on pages views T91815: Audit cache usage to see what can be DC-local and what needs cross-DC purges T91284: Avoid wl_notificationtimestamp updates on page views T91279: Augment user_touched with an in-memory field T89308: Create a local job class that enqueues jobs to final location T89184: Remove cache anti-dependencies T88666: RFC: Master/slave datacenter strategy for MediaWiki T88635: ObjectCacheSessionHandler should avoid pointless writes in write() T88634: Make a ReplicatedBagOStuff class for multi-DC use T88493: Devise stashing strategy for multi-DC mediawiki T88492: Devise caching (memcached) strategy for multi-DC mediawiki T130946: Make ?action=markpatrolled require POST T119641: Split-brain strategy for services that use config managed by etcd T270223: FY2021-2022: Enable basic Multi-DC operations for read traffic (tracking)
T88666	T88666: RFC: Master/slave datacenter strategy for MediaWiki	resolved	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Later) Performance-Team (Inbox) TechCom-RFC (TechCom-RFC-Closed) (Implemented)	T111877: incorporate master/slave datacenter guidelines into developer docs	T88445: MediaWiki active/active datacenter investigation and work (tracking)
T91820	T91820: Create HTTP verb and sticky cookie DC routing in VCL	open	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Discuss next) Traffic-Icebox (Backlog) SRE (Acknowledged) Performance-Team (Radar) (Watching)	T91816: Add code to enable setting sticky DC cookies for POST requests T121440: Dedicated post-edit cache busting cookie to prevent stale reads (session consistency)	T270223: FY2021-2022: Enable basic Multi-DC operations for read traffic (tracking) T88445: MediaWiki active/active datacenter investigation and work (tracking)
T92357	T92357: Fix database master queries from HTTP GET/HEAD before active-active multi-dc	open	Medium (orange)			Sustainability (MediaWiki-MultiDC) (Later) Performance-Team (Backlog: Maintenance) MediaWiki-General	T216287: BannerMessageGroup::registerGroupHook of CentralNotice must not query master on GET request (page views) T154795: CheckUser opens DB master connection when email is sent T154719: PageTriage opens master connection on GET for ArticleMetadata cache misses T154556: Babel autocreates category and system user on GET T154554: AbuseFilter "Examine past edits" feature opens master conn on GET in certain cases involving Scribunto T135170: Require POST in ?action=purge T129973: Dig through logs from 15 Mar 2016 read-only test and file bugs T103429: Investigation: Parser save hook handler does master writes in GETs T95753: Translate extensions uses the master a lot on page views T188801: Migrate wl_notificationtimestamp updates to the job queue T179760: File metadata gets refreshed when accessing the file description page T154596: SpecialModifyEntity master queries on page views T154555: Special:SetSiteLink, other SpecialModifyEntity subclasses open master connection on GET T136224: OATHAuth doing DB master queries on HTTP GET T134842: SpecialCentralAutoLogin calls User::saveSettings() on HTTP GET presend T134841: MessageGroupStats::queueUpdates trigger on page views T134608: CentralAuth uses master on POST requests for API/specialpages that return false for doesWrites() T133422: DB master queries for entities on parse T122708: ShortUrl must not write to master db on page views (DBPerformance warning) T119689: Enable $wgCentralAuthUseSlaves to avoid master queries T110399: WikiPageEntityMetaDataLookup querying DB master on HTTP GET T95232: High frequency of master queries on GET requests due to Flow T95156: Wikidata needlessly queries master DB to populate deprecated wbUserIsBlocked JS variable T94030: Avoid opening master db connection on special pages (e.g. Special:NewItem) when not needed T151903: Special:Search performs DB writes on GET request	T88445: MediaWiki active/active datacenter investigation and work (tracking)
T96113	T96113: Set up dedicated local-dc runners for 'enqueue' router jobs	invalid	Needs Triage (violet)			Sustainability (MediaWiki-MultiDC) (Later) WMF-JobQueue (Untriaged) Platform Engineering (Inbox)
T97562	T97562: WANObjectCache relay daemon or mcrouter support	resolved	Medium (orange)			Wikimedia-Rdbms (Untriaged) Services (watching) Sustainability (MediaWiki-MultiDC) (Later) Performance-Team (Inbox)	T123954: Investigate proper set up for using Kafka MirrorMaker with new main Kafka clusters. T194225: Enable mcrouter on the memcached servers themselves T134554: Create a plugin for recent-changes daemon to be able to process purge events for memcache T134535: Create a class to make EventRelayer to send events to EventBus endpoint T125138: Create Kafka event relayer subclass able to handle WAN cache and CDN purges	T88445: MediaWiki active/active datacenter investigation and work (tracking)