T249755: Cassandra3 migration for Analytics AQS

Phabricator Link	T249755
Status	open
Priority	High (red)
Points
Phabricator Task Created	2020/04/08 02:41 PM
Wiki Page Created	2021/09/09 06:53 AM
Phabricator Task Last Modified	2021/12/10 02:41 AM
Wiki Page Last Updated	2022/01/04 08:57 AM
Phabricator Task Closed
Authored By	Nuria (Nuria)
Assigned To	BTullis (Ben)
Projects	Analytics (Analytics-Clusters) (Q2 2021/2022) Cassandra (Backlog) Data-Engineering (Epics) Data-Engineering-Kanban (Q2 Epics) Epic Platform Team Workboards (Platform Engineering Reliability) (Watching)
Platform Engineering Initiative Column
Platform Team Workboards Column	Platform Engineering Reliability: Watching
Subtasks	T255141: Upgrade the Cassandra AQS cluster to Cassandra 3.11 (duplicate) T280649: Add a spark job loading Cassandra 3 (resolved) T278699: AQS Cassandra driver needs to be updated (declined) T257572: Set up a testing environment for the AQS Cassandra 3 migration (open) T289161: Update cassandra oozie jobs to load cassandra3 using Spark job (resolved) T278701: Store AQS schema and grants in git (resolved) T249756: Cassandra3 migration plan proposal (resolved) T280155: Dual loading from Hive into old and new AQS clusters (declined) T290068: Check AQS with cassandra (serving + data) (resolved) T297460: Send cassandra3 (new hosts) logs to logstash (open) T297803: Switch over the Cassandra AQS cluster to the new hosts (open) T298516: Investigate high levels of garbage collection on new AQS nodes (open)
Parent Tasks

Column Transitions: (Added project: ⇑, Removed project: ⇓,Entered column: ⇒, Exited column: ⇐)

Project	Column	Date
⇑ Analytics		8 April 2020
⇑ Cassandra		8 April 2020
Analytics	⇐ Incoming	13 April 2020
Analytics	⇒ Operational Excellence	13 April 2020
⇑ Patch-For-Review		26 March 2021
⇓ Patch-For-Review		29 March 2021
Cassandra	⇐ Backlog	7 June 2021
Cassandra	⇒ Backlog	7 June 2021
⇑ Data-Engineering		12 August 2021
⇑ Epic		12 August 2021
Data-Engineering	⇐ Incoming	12 August 2021
Data-Engineering	⇒ Epics	12 August 2021
⇑ Data-Engineering-Kanban		12 August 2021
Data-Engineering-Kanban	⇐ Next Up	12 August 2021
Data-Engineering-Kanban	⇒ Q2 Epics	12 August 2021
Data-Engineering	⇐ Epics	12 August 2021
Data-Engineering	⇒ Epics	12 August 2021
Data-Engineering	⇐ Epics	12 August 2021
Data-Engineering	⇒ Epics	12 August 2021
⇑ Patch-For-Review		7 September 2021
⇓ Patch-For-Review		7 September 2021
⇑ Platform Team Workboards (Platform Engineering Reliability)		9 September 2021
⇓ Analytics		15 September 2021
⇑ Analytics (Analytics-Clusters)		15 September 2021
Analytics (Analytics-Clusters)	⇐ Backlog	15 September 2021
Analytics (Analytics-Clusters)	⇒ Q1 2021/2022	15 September 2021
⇑ Patch-For-Review		17 September 2021
⇓ Patch-For-Review		20 September 2021
Platform Team Workboards (Platform Engineering Reliability)	⇐ Backlog	29 September 2021
Platform Team Workboards (Platform Engineering Reliability)	⇒ Watching	29 September 2021
Data-Engineering	⇐ Epics	18 October 2021
Data-Engineering	⇒ Epics	18 October 2021
Data-Engineering	⇐ Epics	25 October 2021
Data-Engineering	⇒ Epics	25 October 2021
Data-Engineering-Kanban	⇐ Q2 Epics	25 October 2021
Data-Engineering-Kanban	⇒ Next Up	25 October 2021
Data-Engineering-Kanban	⇐ Next Up	25 October 2021
Data-Engineering-Kanban	⇒ Next Up	25 October 2021
Data-Engineering-Kanban	⇐ Next Up	25 October 2021
Data-Engineering-Kanban	⇒ Q2 Epics	25 October 2021
Analytics (Analytics-Clusters)	⇐ Q1 2021/2022	25 October 2021
Analytics (Analytics-Clusters)	⇒ Q2 2021/2022	25 October 2021
Data-Engineering	⇐ Epics	1 November 2021
Data-Engineering	⇒ Epics	1 November 2021