Difference between revisions of "T249755: Cassandra3 migration for Analytics AQS"

Latest revision as of 08:57, 4 January 2022

Phabricator Link	T249755
Status	open
Priority	High (red)
Points
Phabricator Task Created	2020/04/08 02:41 PM
Wiki Page Created	2021/09/09 06:53 AM
Phabricator Task Last Modified	2021/12/10 02:41 AM
Wiki Page Last Updated	2022/01/04 08:57 AM
Phabricator Task Closed
Authored By	Nuria (Nuria)
Assigned To	BTullis (Ben)
Projects	Analytics (Analytics-Clusters) (Q2 2021/2022) Cassandra (Backlog) Data-Engineering (Epics) Data-Engineering-Kanban (Q2 Epics) Epic Platform Team Workboards (Platform Engineering Reliability) (Watching)
Platform Engineering Initiative Column
Platform Team Workboards Column	Platform Engineering Reliability: Watching
Subtasks	T255141: Upgrade the Cassandra AQS cluster to Cassandra 3.11 (duplicate) T280649: Add a spark job loading Cassandra 3 (resolved) T278699: AQS Cassandra driver needs to be updated (declined) T257572: Set up a testing environment for the AQS Cassandra 3 migration (open) T289161: Update cassandra oozie jobs to load cassandra3 using Spark job (resolved) T278701: Store AQS schema and grants in git (resolved) T249756: Cassandra3 migration plan proposal (resolved) T280155: Dual loading from Hive into old and new AQS clusters (declined) T290068: Check AQS with cassandra (serving + data) (resolved) T297460: Send cassandra3 (new hosts) logs to logstash (open) T297803: Switch over the Cassandra AQS cluster to the new hosts (open) T298516: Investigate high levels of garbage collection on new AQS nodes (open)
Parent Tasks

Column Transitions: (Added project: ⇑, Removed project: ⇓,Entered column: ⇒, Exited column: ⇐)

Project	Column	Date
⇑ Analytics		8 April 2020
⇑ Cassandra		8 April 2020
Analytics	⇐ Incoming	13 April 2020
Analytics	⇒ Operational Excellence	13 April 2020
⇑ Patch-For-Review		26 March 2021
⇓ Patch-For-Review		29 March 2021
Cassandra	⇐ Backlog	7 June 2021
Cassandra	⇒ Backlog	7 June 2021
⇑ Data-Engineering		12 August 2021
⇑ Epic		12 August 2021
Data-Engineering	⇐ Incoming	12 August 2021
Data-Engineering	⇒ Epics	12 August 2021
⇑ Data-Engineering-Kanban		12 August 2021
Data-Engineering-Kanban	⇐ Next Up	12 August 2021
Data-Engineering-Kanban	⇒ Q2 Epics	12 August 2021
Data-Engineering	⇐ Epics	12 August 2021
Data-Engineering	⇒ Epics	12 August 2021
Data-Engineering	⇐ Epics	12 August 2021
Data-Engineering	⇒ Epics	12 August 2021
⇑ Patch-For-Review		7 September 2021
⇓ Patch-For-Review		7 September 2021
⇑ Platform Team Workboards (Platform Engineering Reliability)		9 September 2021
⇓ Analytics		15 September 2021
⇑ Analytics (Analytics-Clusters)		15 September 2021
Analytics (Analytics-Clusters)	⇐ Backlog	15 September 2021
Analytics (Analytics-Clusters)	⇒ Q1 2021/2022	15 September 2021
⇑ Patch-For-Review		17 September 2021
⇓ Patch-For-Review		20 September 2021
Platform Team Workboards (Platform Engineering Reliability)	⇐ Backlog	29 September 2021
Platform Team Workboards (Platform Engineering Reliability)	⇒ Watching	29 September 2021
Data-Engineering	⇐ Epics	18 October 2021
Data-Engineering	⇒ Epics	18 October 2021
Data-Engineering	⇐ Epics	25 October 2021
Data-Engineering	⇒ Epics	25 October 2021
Data-Engineering-Kanban	⇐ Q2 Epics	25 October 2021
Data-Engineering-Kanban	⇒ Next Up	25 October 2021
Data-Engineering-Kanban	⇐ Next Up	25 October 2021
Data-Engineering-Kanban	⇒ Next Up	25 October 2021
Data-Engineering-Kanban	⇐ Next Up	25 October 2021
Data-Engineering-Kanban	⇒ Q2 Epics	25 October 2021
Analytics (Analytics-Clusters)	⇐ Q1 2021/2022	25 October 2021
Analytics (Analytics-Clusters)	⇒ Q2 2021/2022	25 October 2021
Data-Engineering	⇐ Epics	1 November 2021
Data-Engineering	⇒ Epics	1 November 2021

@@ Line 5: / Line 5: @@
 |points=
 |dateCreated=1586371274
-|dateModified=1634568893
+|dateModified=1639122106
 |author={{Phabricator User
 |type=author
@@ Line 18: / Line 18: @@
 |projects={{Phabricator Project
 |name=Analytics (Analytics-Clusters)
-|column=Q1 2021/2022
+|column=Q2 2021/2022
-|entryDate=1631726276
+|entryDate=1635176045
 }}{{Phabricator Project
 |name=Cassandra
@@ Line 26: / Line 26: @@
 }}{{Phabricator Project
 |name=Data-Engineering-Kanban
-|column=Q1 Epics
+|column=Q2 Epics
-|entryDate=1628789208
+|entryDate=1635175828
 }}{{Phabricator Project
 |name=Data-Engineering
 |column=Epics
-|entryDate=1634568893
+|entryDate=1635785224
 }}{{Phabricator Project
 |name=Epic
@@ Line 40: / Line 40: @@
 |entryDate=1632915928
 }}
-|subtasks=280649,278699,257572,290068,289161,278701,255141,249756,280155
+|subtasks=280649,278699,257572,298516,297803,297460,290068,289161,278701,255141,249756,280155
 |transitions={{Transition
+|date=1635785224
+|type=Entered Column
+|project=Data-Engineering
+|column=Epics
+}}{{Transition
+|date=1635785224
+|type=Exited Column
+|project=Data-Engineering
+|column=Epics
+}}{{Transition
+|date=1635176045
+|type=Entered Column
+|project=Analytics (Analytics-Clusters)
+|column=Q2 2021/2022
+}}{{Transition
+|date=1635176045
+|type=Exited Column
+|project=Analytics (Analytics-Clusters)
+|column=Q1 2021/2022
+}}{{Transition
+|date=1635175828
+|type=Entered Column
+|project=Data-Engineering-Kanban
+|column=Q2 Epics
+}}{{Transition
+|date=1635175828
+|type=Exited Column
+|project=Data-Engineering-Kanban
+|column=Next Up
+}}{{Transition
+|date=1635175812
+|type=Entered Column
+|project=Data-Engineering-Kanban
+|column=Next Up
+}}{{Transition
+|date=1635175812
+|type=Exited Column
+|project=Data-Engineering-Kanban
+|column=Next Up
+}}{{Transition
+|date=1635175808
+|type=Entered Column
+|project=Data-Engineering-Kanban
+|column=Next Up
+}}{{Transition
+|date=1635175808
+|type=Exited Column
+|project=Data-Engineering-Kanban
+|column=Q2 Epics
+}}{{Transition
+|date=1635175596
+|type=Entered Column
+|project=Data-Engineering
+|column=Epics
+}}{{Transition
+|date=1635175596
+|type=Exited Column
+|project=Data-Engineering
+|column=Epics
+}}{{Transition
 |date=1634568893
 |type=Entered Column
@@ Line 123: / Line 183: @@
 |type=Entered Column
 |project=Data-Engineering-Kanban
-|column=Q1 Epics
+|column=Q2 Epics
 }}{{Transition
 |date=1628789208