Active Tasks By Project

Project: Airflow

Switch to All Tasks 8 Phabricator task(s).

Phabricator Link	Wiki Link	Status	Priority	Author	Assignee	Projects	Subtasks	Parent Tasks
T271429	T271429: Replace Oozie with better workflow scheduler	open	High (red)	nshahquinn-wmf (Neil Shah-Quinn)		Data-Engineering (Transform) Airflow (Epics) Product-Analytics (Tracking) Epic	T272973: Generalize the current Airflow puppet/scap code to deploy a dedicated Analytics instance T284172: &#91 SPIKE&#93 analytics-airflow jobs development T241246: Spike: POC of refine with airflow T217059: Spike &#91 2019-2020 work&#93 Oozie Replacement. Airflow Study / Argo Study	T282033: Airflow collaborations
T282033	T282033: Airflow collaborations	open	High (red)	Milimetric (Dan Andreescu)		Airflow (Epics) Data-Engineering (Transform) Platform Team Workboards (Image Suggestion API) (Backlog) Epic	T270613: &#91 SPIKE&#93 can we orchestrate the Similarusers pipeline with airflow? T280799: &#91 SPIKE&#93 📊Research how to run image matching on airflow T282035: Catalog, Categorize, and Templetize existing scheduled workflows T272973: Generalize the current Airflow puppet/scap code to deploy a dedicated Analytics instance T284225: Create airflow instances for Platform Engineering and Research T271429: Replace Oozie with better workflow scheduler T284566: Replace Airflow's HDFS client (snakebite) with pyarrow T288247: SPIKE - Will Hadoop 3 container support help us for Airflow deployment pipelines? T288271: Make it possible to use anaconda + stacked conda envs for Airflow executors T290664: Agree on a repository structure for Airflow-related code T290918: hdfs directory for analytics-research T294026: &#91 Airflow&#93 Create repository for Airflow DAGs T294024: &#91 Airflow&#93 Automate sync'ing archiva packages to HDFS
T282035	T282035: Catalog, Categorize, and Templetize existing scheduled workflows	open	Medium (orange)	Milimetric (Dan Andreescu)		Platform Engineering (Tracking/Watching) Airflow (Backlog) Data-Engineering (Transform)		T282033: Airflow collaborations
T284566	T284566: Replace Airflow's HDFS client (snakebite) with pyarrow	open	Medium (orange)	Ottomata (Andrew Otto)		Platform Engineering (Tracking/Watching) Airflow (Backlog) Data-Engineering (Transform)		T282033: Airflow collaborations
T285692	T285692: Write a job entirely in Airflow with spark and/or sparkSQL	open	High (red)	mforns (Marcel Ruiz Forns)	mforns (Marcel Ruiz Forns)	Patch-For-Review Airflow (Done) Data-Engineering-Kanban (Done) Data-Engineering (Transform)		T284172: [SPIKE] analytics-airflow jobs development
T288247	T288247: SPIKE - Will Hadoop 3 container support help us for Airflow deployment pipelines?	open	Needs Triage (violet)	Ottomata (Andrew Otto)	Ottomata (Andrew Otto)	Analytics-Kanban Airflow (Backlog) Data-Engineering (Ops)		T282033: Airflow collaborations
T294024	T294024: [Airflow] Automate sync'ing archiva packages to HDFS	open	High (red)	mforns (Marcel Ruiz Forns)	Ottomata (Andrew Otto)	Airflow (Done) Data-Engineering-Kanban (Ready to Deploy) Data-Engineering (Transform)	T288271: Make it possible to use anaconda + stacked conda envs for Airflow executors	T282033: Airflow collaborations
T294026	T294026: [Airflow] Create repository for Airflow DAGs	open	High (red)	mforns (Marcel Ruiz Forns)	mforns (Marcel Ruiz Forns)	Data-Engineering-Kanban (Done) Airflow (Done) Data-Engineering (Transform)		T282033: Airflow collaborations