Difference between revisions of "T212129: Move MainStash out of Redis to a simpler multi-dc aware solution"

Latest revision as of 23:31, 10 January 2022

Phabricator Link	T212129
Status	open
Priority	Medium (orange)
Points
Phabricator Task Created	2018/12/17 09:55 AM
Wiki Page Created	2019/06/09 01:16 PM
Phabricator Task Last Modified	2022/01/10 09:42 PM
Wiki Page Last Updated	2022/01/10 11:31 PM
Phabricator Task Closed
Authored By	Joe (Giuseppe Lavagetto)
Assigned To	aaron (Aaron Schulz)
Projects	MediaWiki-General Patch-For-Review Performance-Team (Backlog: Future Goals) SRE (Acknowledged) Sustainability (MediaWiki-MultiDC) (Current: Performance Team) User-jijiki (St) User-mobrovac (Backlog) serviceops (serviceops-radar) (Watched)
Platform Engineering Initiative Column
Platform Team Workboards Column
Subtasks	T222851: Improve Echo seentime code for multi-DC access (resolved) T229062: Look into a simple way to have global keys with db-replicated (resolved) T254634: Determine and implement multi-dc strategy for ChronologyProtector (resolved) T267270: Determine multi-dc strategy for CentralAuth (open) T269324: Productionize x2 databases (resolved) T274174: Add modtoken field and flags to objectcache table (resolved)
Parent Tasks	T113916: Switch ResourceLoader file dependency tracking to MultiDC-friendly backend T243520: Decommission the "session redis" cluster T267581: Phasing out "redis_sessions" MediaWiki cluster and away from the memcached cluster T270223: FY2021-2022: Enable basic Multi-DC operations for read traffic (tracking) T88445: MediaWiki active/active datacenter investigation and work (tracking)

Column Transitions: (Added project: ⇑, Removed project: ⇓,Entered column: ⇒, Exited column: ⇐)

Project	Column	Date
⇑ serviceops		17 December 2018
⇑ MediaWiki-Cache		17 December 2018
⇑ SRE		17 December 2018
⇑ Performance-Team		17 December 2018
⇑ Platform Engineering		17 December 2018
⇓ Performance-Team		18 December 2018
⇑ Performance-Team (Radar)		18 December 2018
⇓ Platform Engineering		15 January 2019
Platform Engineering	⇐ Inbox	15 January 2019
Platform Engineering	⇒ Needs Cleaning - Security, stability, performance, and scalability (TEC1)	15 January 2019
⇑ Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1))		15 January 2019
⇑ Platform Team Workboards (Doing)		15 January 2019
Platform Team Workboards	⇐ Doing	17 January 2019
Platform Team Workboards	⇒ Doing	17 January 2019
Performance-Team (Radar)	⇐ Limbo	20 January 2019
Performance-Team (Radar)	⇒ Watching	20 January 2019
SRE	⇐ Backlog	26 January 2019
SRE	⇒ Acknowledged	26 January 2019
⇑ User-jijiki		8 February 2019
User-jijiki	⇐ Inbox 🐅	8 February 2019
User-jijiki	⇒ In Progress 🏋️♀️	8 February 2019
⇑ User-mobrovac		12 February 2019
⇑ Services (doing)		12 February 2019
User-jijiki	⇐ In Progress 🏋️♀️	14 February 2019
User-jijiki	⇒ St	14 February 2019
serviceops	⇐ Incoming 🐫	20 June 2019
serviceops	⇒ Stalled 🐌	20 June 2019
⇓ serviceops		21 June 2019
⇑ serviceops (serviceops-radar)		21 June 2019
serviceops (serviceops-radar)	⇐ Backlog	21 June 2019
serviceops (serviceops-radar)	⇒ Watched	21 June 2019
⇓ Services (doing)		5 July 2019
⇓ Platform Team Workboards (Doing)		5 July 2019
⇓ Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1))		5 July 2019
⇑ Platform Engineering (Mainstash Multi-DC)		5 July 2019
⇓ MediaWiki-Cache		15 July 2019
⇑ MediaWiki-General		15 July 2019
⇓ Platform Engineering (Mainstash Multi-DC)		26 July 2019
Platform Engineering	⇐ Mainstash Multi-DC	26 July 2019
Platform Engineering	⇒ mop	26 July 2019
⇑ Platform Team Initiatives (Mainstash Multi-DC)		26 July 2019
⇓ Platform Team Initiatives (Mainstash Multi-DC)		29 October 2019
⇑ Sustainability (MediaWiki-MultiDC)		6 April 2020
Sustainability (MediaWiki-MultiDC)	⇐ Later	6 April 2020
Sustainability (MediaWiki-MultiDC)	⇒ Discuss next	6 April 2020
Sustainability (MediaWiki-MultiDC)	⇐ Discuss next	23 June 2020
Sustainability (MediaWiki-MultiDC)	⇒ Current: Performance Team	23 June 2020
⇓ Performance-Team (Radar)		13 July 2020
⇑ Performance-Team		13 July 2020
Performance-Team	⇐ Inbox	13 July 2020
Performance-Team	⇒ Backlog: Future Goals	13 July 2020
⇑ Patch-For-Review		10 January 2022

@@ Line 1: / Line 1: @@
 {{Phabricator Task
-|name=Use a multi-dc aware store for ObjectCache's MainStash if needed.
+|name=Move MainStash out of Redis to a simpler multi-dc aware solution
 |status=open
-|color=violet
+|color=orange
 |points=
 |dateCreated=1545058547
-|dateModified=1579022011
+|dateModified=1641868956
 |author={{Phabricator User
 |type=author
@@ Line 20: / Line 20: @@
 |entryDate=1545058547
 }}{{Phabricator Project
-|name=Operations
+|name=Sustainability (MediaWiki-MultiDC)
+|column=Current: Performance Team
+|entryDate=1592945583
+}}{{Phabricator Project
+|name=Patch-For-Review
+|entryDate=1545058547
+}}{{Phabricator Project
+|name=Performance-Team
+|column=Backlog: Future Goals
+|entryDate=1594674204
+}}{{Phabricator Project
+|name=SRE
 |column=Acknowledged
 |entryDate=1548543278
-}}{{Phabricator Project
-|name=Performance-Team (Radar)
-|column=Watching
-|entryDate=1548037271
 }}{{Phabricator Project
 |name=User-jijiki
@@ Line 40: / Line 47: @@
 |entryDate=1561107174
 }}
-|subtasks=222851
+|subtasks=274174,269324,254634,229062,222851,267270
 |transitions={{Transition
-|project=Core Platform Team
+|date=1641868948
+|type=Added Project
+|project=Patch-For-Review
+}}{{Transition
+|date=1594674204
+|type=Entered Column
+|project=Performance-Team
+|column=Backlog: Future Goals
+}}{{Transition
+|date=1594674204
+|type=Exited Column
+|project=Performance-Team
+|column=Inbox
+}}{{Transition
+|date=1594674192
+|type=Removed Project
+|project=Performance-Team (Radar)
+}}{{Transition
+|date=1594674192
+|type=Added Project
+|project=Performance-Team
+}}{{Transition
+|date=1592945583
+|type=Entered Column
+|project=Sustainability (MediaWiki-MultiDC)
+|column=Current: Performance Team
+}}{{Transition
+|date=1592945583
+|type=Exited Column
+|project=Sustainability (MediaWiki-MultiDC)
+|column=Discuss next
+}}{{Transition
+|date=1586185302
+|type=Entered Column
+|project=Sustainability (MediaWiki-MultiDC)
+|column=Discuss next
+}}{{Transition
+|date=1586185302
+|type=Exited Column
+|project=Sustainability (MediaWiki-MultiDC)
+|column=Later
+}}{{Transition
+|date=1586185295
+|type=Added Project
+|project=Sustainability (MediaWiki-MultiDC)
+}}{{Transition
+|date=1572375001
+|type=Removed Project
+|project=Platform Team Initiatives (Mainstash Multi-DC)
+}}{{Transition
+|date=1564167982
+|type=Removed Project
+|project=Platform Engineering (Mainstash Multi-DC)
+}}{{Transition
+|date=1564167982
+|type=Added Project
+|project=Platform Team Initiatives (Mainstash Multi-DC)
+}}{{Transition
+|date=1564167982
+|type=Entered Column
+|project=Platform Engineering
 |column=mop
-|transitionDate=1564167982
-|transitionType=Entered Column
 }}{{Transition
-|project=Core Platform Team
+|date=1564167982
+|type=Exited Column
+|project=Platform Engineering
 |column=Mainstash Multi-DC
-|transitionDate=1564167982
-|transitionType=Exited Column
 }}{{Transition
+|date=1563230074
+|type=Removed Project
+|project=MediaWiki-Cache
+}}{{Transition
+|date=1563230074
+|type=Added Project
+|project=MediaWiki-General
+}}{{Transition
+|date=1562347984
+|type=Removed Project
+|project=Services (doing)
+}}{{Transition
+|date=1562347984
+|type=Removed Project
+|project=Platform Team Workboards (Doing)
+}}{{Transition
+|date=1562347984
+|type=Removed Project
+|project=Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1))
+}}{{Transition
+|date=1562347984
+|type=Added Project
+|project=Platform Engineering (Mainstash Multi-DC)
+}}{{Transition
+|date=1561107174
+|type=Entered Column
 |project=serviceops (serviceops-radar)
 |column=Watched
-|transitionDate=1561107174
-|transitionType=Entered Column
 }}{{Transition
+|date=1561107174
+|type=Exited Column
 |project=serviceops (serviceops-radar)
 |column=Backlog
-|transitionDate=1561107174
-|transitionType=Exited Column
 }}{{Transition
+|date=1561106844
+|type=Removed Project
+|project=serviceops
+}}{{Transition
+|date=1561106844
+|type=Added Project
+|project=serviceops (serviceops-radar)
+}}{{Transition
+|date=1561040541
+|type=Entered Column
 |project=serviceops
-|column=Incoming
+|column=Stalled 🐌
-|transitionDate=1561040541
-|transitionType=Entered Column
 }}{{Transition
+|date=1561040541
+|type=Exited Column
 |project=serviceops
-|column=Backlog
+|column=Incoming 🐫
-|transitionDate=1561040541
-|transitionType=Exited Column
 }}{{Transition
+|date=1550142057
+|type=Entered Column
 |project=User-jijiki
 |column=St
-|transitionDate=1550142057
-|transitionType=Entered Column
 }}{{Transition
+|date=1550142057
+|type=Exited Column
+|project=User-jijiki
+|column=In Progress 🏋️‍♀️
+}}{{Transition
+|date=1550019456
+|type=Added Project
+|project=Services (doing)
+}}{{Transition
+|date=1550019456
+|type=Added Project
+|project=User-mobrovac
+}}{{Transition
+|date=1549623643
+|type=Entered Column
 |project=User-jijiki
-|column=In Progress
+|column=In Progress 🏋️‍♀️
-|transitionDate=1550142057
-|transitionType=Exited Column
 }}{{Transition
+|date=1549623643
+|type=Exited Column
 |project=User-jijiki
-|column=In Progress
+|column=Inbox 🐅
-|transitionDate=1549623643
-|transitionType=Entered Column
 }}{{Transition
+|date=1549611406
+|type=Added Project
 |project=User-jijiki
-|column=Backlog/Radar
-|transitionDate=1549623643
-|transitionType=Exited Column
 }}{{Transition
-|project=Operations
+|date=1548543278
+|type=Entered Column
+|project=SRE
 |column=Acknowledged
-|transitionDate=1548543278
-|transitionType=Entered Column
 }}{{Transition
-|project=Operations
+|date=1548543278
+|type=Exited Column
+|project=SRE
 |column=Backlog
-|transitionDate=1548543278
-|transitionType=Exited Column
 }}{{Transition
+|date=1548037271
+|type=Entered Column
 |project=Performance-Team (Radar)
 |column=Watching
-|transitionDate=1548037271
-|transitionType=Entered Column
 }}{{Transition
+|date=1548037271
+|type=Exited Column
 |project=Performance-Team (Radar)
 |column=Limbo
-|transitionDate=1548037271
-|transitionType=Exited Column
 }}{{Transition
-|project=Core Platform Team Workboards
+|date=1547747900
+|type=Entered Column
+|project=Platform Team Workboards
 |column=Doing
-|transitionDate=1547747900
-|transitionType=Entered Column
 }}{{Transition
-|project=Core Platform Team Workboards
+|date=1547747900
+|type=Exited Column
+|project=Platform Team Workboards
 |column=Doing
-|transitionDate=1547747900
-|transitionType=Exited Column
 }}{{Transition
-|project=Core Platform Team
+|date=1547565225
+|type=Added Project
+|project=Platform Team Workboards (Doing)
+}}{{Transition
+|date=1547564943
+|type=Removed Project
+|project=Platform Engineering
+}}{{Transition
+|date=1547564943
+|type=Added Project
+|project=Platform Engineering (Needs Cleaning - Security, stability, performance, and scalability (TEC1))
+}}{{Transition
+|date=1547564943
+|type=Entered Column
+|project=Platform Engineering
 |column=Needs Cleaning - Security, stability, performance, and scalability (TEC1)
-|transitionDate=1547564943
-|transitionType=Entered Column
 }}{{Transition
-|project=Core Platform Team
+|date=1547564943
+|type=Exited Column
+|project=Platform Engineering
 |column=Inbox
-|transitionDate=1547564943
+}}{{Transition
-|transitionType=Exited Column
+|date=1545160650
+|type=Removed Project
+|project=Performance-Team
+}}{{Transition
+|date=1545160650
+|type=Added Project
+|project=Performance-Team (Radar)
+}}{{Transition
+|date=1545058547
+|type=Added Project
+|project=serviceops
+}}{{Transition
+|date=1545058547
+|type=Added Project
+|project=MediaWiki-Cache
+}}{{Transition
+|date=1545058547
+|type=Added Project
+|project=SRE
+}}{{Transition
+|date=1545058547
+|type=Added Project
+|project=Platform Engineering
+}}{{Transition
+|date=1545058547
+|type=Added Project
+|project=Performance-Team
 }}
 }}