Difference between revisions of "T212129: Move MainStash out of Redis to a simpler multi-dc aware solution"

Latest revision as of 23:31, 10 January 2022

Phabricator Link	T212129
Status	open
Priority	Medium (orange)
Points
Phabricator Task Created	2018/12/17 09:55 AM
Wiki Page Created	2019/06/09 01:16 PM
Phabricator Task Last Modified	2022/01/10 09:42 PM
Wiki Page Last Updated	2022/01/10 11:31 PM
Phabricator Task Closed
Authored By	Joe (Giuseppe Lavagetto)
Assigned To	aaron (Aaron Schulz)
Projects	MediaWiki-General Patch-For-Review Performance-Team (Backlog: Future Goals) SRE (Acknowledged) Sustainability (MediaWiki-MultiDC) (Current: Performance Team) User-jijiki (St) User-mobrovac (Backlog) serviceops (serviceops-radar) (Watched)
Platform Engineering Initiative Column
Platform Team Workboards Column
Subtasks	T222851: Improve Echo seentime code for multi-DC access (resolved) T229062: Look into a simple way to have global keys with db-replicated (resolved) T254634: Determine and implement multi-dc strategy for ChronologyProtector (resolved) T267270: Determine multi-dc strategy for CentralAuth (open) T269324: Productionize x2 databases (resolved) T274174: Add modtoken field and flags to objectcache table (resolved)
Parent Tasks	T113916: Switch ResourceLoader file dependency tracking to MultiDC-friendly backend T243520: Decommission the "session redis" cluster T267581: Phasing out "redis_sessions" MediaWiki cluster and away from the memcached cluster T270223: FY2021-2022: Enable basic Multi-DC operations for read traffic (tracking) T88445: MediaWiki active/active datacenter investigation and work (tracking)

Column Transitions: (Added project: ⇑, Removed project: ⇓,Entered column: ⇒, Exited column: ⇐)

Project	Column	Date
⇑ MediaWiki-Cache		17 December 2018
⇑ SRE		17 December 2018
⇑ Performance-Team		17 December 2018
⇑ Platform Engineering		17 December 2018
⇑ serviceops		17 December 2018
⇓ Performance-Team		18 December 2018
⇑ Performance-Team (Radar)		18 December 2018
⇓ Platform Engineering		15 January 2019
Platform Engineering	⇐ Inbox	15 January 2019
Platform Engineering	⇒ Needs Cleaning - Security, stability, performance, and scalability (TEC1)	15 January 2019
⇑ Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1))		15 January 2019
⇑ Platform Team Workboards (Doing)		15 January 2019
Platform Team Workboards	⇐ Doing	17 January 2019
Platform Team Workboards	⇒ Doing	17 January 2019
Performance-Team (Radar)	⇐ Limbo	20 January 2019
Performance-Team (Radar)	⇒ Watching	20 January 2019
SRE	⇐ Backlog	26 January 2019
SRE	⇒ Acknowledged	26 January 2019
⇑ User-jijiki		8 February 2019
User-jijiki	⇐ Inbox 🐅	8 February 2019
User-jijiki	⇒ In Progress 🏋️♀️	8 February 2019
⇑ Services (doing)		12 February 2019
⇑ User-mobrovac		12 February 2019
User-jijiki	⇐ In Progress 🏋️♀️	14 February 2019
User-jijiki	⇒ St	14 February 2019
serviceops	⇐ Incoming 🐫	20 June 2019
serviceops	⇒ Stalled 🐌	20 June 2019
⇓ serviceops		21 June 2019
⇑ serviceops (serviceops-radar)		21 June 2019
serviceops (serviceops-radar)	⇐ Backlog	21 June 2019
serviceops (serviceops-radar)	⇒ Watched	21 June 2019
⇓ Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1))		5 July 2019
⇓ Services (doing)		5 July 2019
⇓ Platform Team Workboards (Doing)		5 July 2019
⇑ Platform Engineering (Mainstash Multi-DC)		5 July 2019
⇓ MediaWiki-Cache		15 July 2019
⇑ MediaWiki-General		15 July 2019
⇓ Platform Engineering (Mainstash Multi-DC)		26 July 2019
Platform Engineering	⇐ Mainstash Multi-DC	26 July 2019
Platform Engineering	⇒ mop	26 July 2019
⇑ Platform Team Initiatives (Mainstash Multi-DC)		26 July 2019
⇓ Platform Team Initiatives (Mainstash Multi-DC)		29 October 2019
⇑ Sustainability (MediaWiki-MultiDC)		6 April 2020
Sustainability (MediaWiki-MultiDC)	⇐ Later	6 April 2020
Sustainability (MediaWiki-MultiDC)	⇒ Discuss next	6 April 2020
Sustainability (MediaWiki-MultiDC)	⇐ Discuss next	23 June 2020
Sustainability (MediaWiki-MultiDC)	⇒ Current: Performance Team	23 June 2020
⇓ Performance-Team (Radar)		13 July 2020
⇑ Performance-Team		13 July 2020
Performance-Team	⇐ Inbox	13 July 2020
Performance-Team	⇒ Backlog: Future Goals	13 July 2020
⇑ Patch-For-Review		10 January 2022

@@ Line 2: / Line 2: @@
 |name=Move MainStash out of Redis to a simpler multi-dc aware solution
 |status=open
-|color=red
+|color=orange
 |points=
 |dateCreated=1545058547
-|dateModified=1591118878
+|dateModified=1641868956
 |author={{Phabricator User
 |type=author
@@ Line 21: / Line 21: @@
 }}{{Phabricator Project
 |name=Sustainability (MediaWiki-MultiDC)
-|column=Next-up
+|column=Current: Performance Team
-|entryDate=1586185302
+|entryDate=1592945583
 }}{{Phabricator Project
-|name=Operations
+|name=Patch-For-Review
+|entryDate=1545058547
+}}{{Phabricator Project
+|name=Performance-Team
+|column=Backlog: Future Goals
+|entryDate=1594674204
+}}{{Phabricator Project
+|name=SRE
 |column=Acknowledged
 |entryDate=1548543278
-}}{{Phabricator Project
-|name=Performance-Team (Radar)
-|column=Watching
-|entryDate=1548037271
 }}{{Phabricator Project
 |name=User-jijiki
@@ Line 44: / Line 47: @@
 |entryDate=1561107174
 }}
-|subtasks=235705,229062,222851
+|subtasks=274174,269324,254634,229062,222851,267270
 |transitions={{Transition
+|date=1641868948
+|type=Added Project
+|project=Patch-For-Review
+}}{{Transition
+|date=1594674204
+|type=Entered Column
+|project=Performance-Team
+|column=Backlog: Future Goals
+}}{{Transition
+|date=1594674204
+|type=Exited Column
+|project=Performance-Team
+|column=Inbox
+}}{{Transition
+|date=1594674192
+|type=Removed Project
+|project=Performance-Team (Radar)
+}}{{Transition
+|date=1594674192
+|type=Added Project
+|project=Performance-Team
+}}{{Transition
+|date=1592945583
+|type=Entered Column
+|project=Sustainability (MediaWiki-MultiDC)
+|column=Current: Performance Team
+}}{{Transition
+|date=1592945583
+|type=Exited Column
+|project=Sustainability (MediaWiki-MultiDC)
+|column=Discuss next
+}}{{Transition
 |date=1586185302
 |type=Entered Column
 |project=Sustainability (MediaWiki-MultiDC)
-|column=Next-up
+|column=Discuss next
 }}{{Transition
 |date=1586185302
 |type=Exited Column
 |project=Sustainability (MediaWiki-MultiDC)
-|column=Backlog
+|column=Later
 }}{{Transition
 |date=1586185295
@@ Line 62: / Line 97: @@
 |date=1572375001
 |type=Removed Project
-|project=CPT Initiatives (Mainstash Multi-DC)
+|project=Platform Team Initiatives (Mainstash Multi-DC)
 }}{{Transition
 |date=1564167982
 |type=Removed Project
-|project=Core Platform Team (Mainstash Multi-DC)
+|project=Platform Engineering (Mainstash Multi-DC)
 }}{{Transition
 |date=1564167982
 |type=Added Project
-|project=CPT Initiatives (Mainstash Multi-DC)
+|project=Platform Team Initiatives (Mainstash Multi-DC)
 }}{{Transition
 |date=1564167982
 |type=Entered Column
-|project=Core Platform Team
+|project=Platform Engineering
 |column=mop
 }}{{Transition
 |date=1564167982
 |type=Exited Column
-|project=Core Platform Team
+|project=Platform Engineering
 |column=Mainstash Multi-DC
 }}{{Transition
@@ Line 96: / Line 131: @@
 |date=1562347984
 |type=Removed Project
-|project=Core Platform Team Workboards (Doing)
+|project=Platform Team Workboards (Doing)
 }}{{Transition
 |date=1562347984
 |type=Removed Project
-|project=Core Platform Team (Needs Cleaning - Security, stability, performance, and scalability (TEC1))
+|project=Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1))
 }}{{Transition
 |date=1562347984
 |type=Added Project
-|project=Core Platform Team (Mainstash Multi-DC)
+|project=Platform Engineering (Mainstash Multi-DC)
 }}{{Transition
 |date=1561107174
@@ Line 127: / Line 162: @@
 |type=Entered Column
 |project=serviceops
-|column=Incoming
+|column=Stalled 🐌
 }}{{Transition
 |date=1561040541
 |type=Exited Column
 |project=serviceops
-|column=Backlog
+|column=Incoming 🐫
 }}{{Transition
 |date=1550142057
@@ Line 142: / Line 177: @@
 |type=Exited Column
 |project=User-jijiki
-|column=In Progress
+|column=In Progress 🏋️‍♀️
 }}{{Transition
 |date=1550019456
@@ Line 155: / Line 190: @@
 |type=Entered Column
 |project=User-jijiki
-|column=In Progress
+|column=In Progress 🏋️‍♀️
 }}{{Transition
 |date=1549623643
 |type=Exited Column
 |project=User-jijiki
-|column=Backlog/Radar
+|column=Inbox 🐅
 }}{{Transition
 |date=1549611406
@@ Line 168: / Line 203: @@
 |date=1548543278
 |type=Entered Column
-|project=Operations
+|project=SRE
 |column=Acknowledged
 }}{{Transition
 |date=1548543278
 |type=Exited Column
-|project=Operations
+|project=SRE
 |column=Backlog
 }}{{Transition
@@ Line 188: / Line 223: @@
 |date=1547747900
 |type=Entered Column
-|project=Core Platform Team Workboards
+|project=Platform Team Workboards
 |column=Doing
 }}{{Transition
 |date=1547747900
 |type=Exited Column
-|project=Core Platform Team Workboards
+|project=Platform Team Workboards
 |column=Doing
 }}{{Transition
 |date=1547565225
 |type=Added Project
-|project=Core Platform Team Workboards (Doing)
+|project=Platform Team Workboards (Doing)
 }}{{Transition
 |date=1547564943
 |type=Removed Project
-|project=Core Platform Team
+|project=Platform Engineering
 }}{{Transition
 |date=1547564943
 |type=Added Project
-|project=Core Platform Team (Needs Cleaning - Security, stability, performance, and scalability (TEC1))
+|project=Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1))
 }}{{Transition
 |date=1547564943
 |type=Entered Column
-|project=Core Platform Team
+|project=Platform Engineering
 |column=Needs Cleaning - Security, stability, performance, and scalability (TEC1)
 }}{{Transition
 |date=1547564943
 |type=Exited Column
-|project=Core Platform Team
+|project=Platform Engineering
 |column=Inbox
 }}{{Transition
@@ Line 236: / Line 271: @@
 |date=1545058547
 |type=Added Project
-|project=Operations
+|project=SRE
 }}{{Transition
 |date=1545058547
 |type=Added Project
-|project=Core Platform Team
+|project=Platform Engineering
 }}{{Transition
 |date=1545058547