Orchestrating Data Pipelines at Lyft: comparing Flyte and Airflow

Orchestrating Data Pipelines at Lyft: comparing Flyte and Airflow

摘要

We will focus on comparing Airflow and Flyte implementations at Lyft: dive into the architecture and summarize its benefits and drawbacks.