T206785: Modern Event Platform: Stream Intake Service (EventGate): Implementation

Phabricator Link	T206785
Status	resolved
Priority	High (red)
Points	21
Phabricator Task Created	2018/10/11 02:41 PM
Wiki Page Created	2019/06/09 01:20 PM
Phabricator Task Last Modified	2021/01/14 03:10 PM
Wiki Page Last Updated	2021/10/29 02:10 PM
Phabricator Task Closed	2019/05/14 05:35 PM
Authored By	Ottomata (Andrew Otto)
Assigned To	Ottomata (Andrew Otto)
Projects	Analytics (Event Platform) Analytics-EventLogging (Backlog) Analytics-Kanban Event-Platform (Done) Platform Team Legacy (Watching / External) Services (watching)
Platform Engineering Initiative Column
Platform Team Workboards Column
Subtasks	T220725: Factor lib/kafka.js out of eventgate and change-propagation into its own library (declined) T206815: Prototype in node intake service (resolved) T219513: EventGate should extract event time from events and produce to kafka with timestamp (resolved) T219332: Modern Event Platform: Stream Intake Service: Documentation (resolved) T219032: EventGate should be able to configure hasty and guaranteed kafka producers individually (resolved) T218680: EventGate Helm chart should POST test event for readinessProbe (resolved) T218305: EventGate wikimedia implementation should emit rdkafka stats (resolved) T217661: EventGate (in k8s) takes a long time to load new schemas (resolved) T214080: Rewrite Avro schemas (ApiAction, CirrusSearchRequestSet) as JSONSchema and produce to EventGate (resolved) T211247: Modern Event Platform: Stream Intake Service: Implementation: Deployment Pipeline (resolved) T208251: Modern Event Platform: Stream Intake Service: EventGate security review (resolved) T220661: EventGate service runner worker occasionally killed, usually during higher load (resolved) T213564: Datacenter aware configs for EventGate topic prefixes (resolved)
Parent Tasks	T201068: Modern Event Platform: Stream Intake Service

Column Transitions: (Added project: ⇑, Removed project: ⇓,Entered column: ⇒, Exited column: ⇐)

Project	Column	Date
⇑ Analytics-EventLogging		11 October 2018
⇑ Services (watching)		11 October 2018
⇑ Analytics		11 October 2018
⇑ Event-Platform		11 October 2018
Analytics	⇐ Incoming	15 October 2018
Analytics	⇒ Event Platform	15 October 2018
⇑ Platform Team Legacy (Watching / External)		30 November 2018
Event-Platform	⇐ Backlog	5 December 2018
Event-Platform	⇒ In Progress	5 December 2018
⇑ Patch-For-Review		20 February 2019
⇑ Analytics-Kanban		23 April 2019
Analytics-Kanban	⇐ Next Up	23 April 2019
Analytics-Kanban	⇒ Done	23 April 2019
Analytics-Kanban	⇐ Done	26 April 2019
Analytics-Kanban	⇒ Done	26 April 2019
Event-Platform	⇐ In Progress	9 May 2019
Event-Platform	⇒ Done	9 May 2019
⇓ Patch-For-Review		14 January 2021