Overview
- Apache Airflow—fully managed service
- Workflow management—author, schedule, monitor
- Connect data, processing and services
- Hybrid cloud—Google Cloud, other clouds and on-prem
- Directed Acyclic Graphs (DAGs)
- Defines tasks and dependencies
- Written in Python
- Monitor with Cloud Monitoring
- Use cases:
- ETL pipeline orchestration
- Automated analytics and ML jobs