Unit 1: Airflow Fundamentals
Unit 2: Airflow UI and Architecture
Unit 3: Setting Up Airflow
Airflow for Data Engineering: Core Concepts, Basic Pipelines, and Job Integration
Master Airflow for data engineering: build, schedule, and monitor data pipelines with hands-on examples and real-world integrations.
Unit 1: DAG Fundamentals
Unit 2: Dependencies and Scheduling
Unit 3: Error Handling and Best Practices
Unit 1: DAG Scheduling Deep Dive
Unit 2: Monitoring DAGs in the UI
Unit 3: Troubleshooting and Logging
Unit 1: Connecting to Data Storage
Unit 2: Transferring Data with Operators
Unit 3: Data Validation and Security
Unit 1: Compute Service Integration Overview
Unit 2: Databricks Integration in Detail
Unit 3: Snowflake Integration in Detail
Unit 4: Advanced Integration Concepts
Unit 1: XComs: Sharing Data Between Tasks
Unit 2: Advanced Task Dependencies
Unit 3: Conditional Task Execution and Dynamic DAGs