» » Creed - My Own Prison

Exclusive — Airflow Xcom

For true exclusivity and performance, many teams use a . This allows you to: Store the actual data in S3, GCS, or Azure Blob Storage . Only store the reference (the URI) in the Airflow database. Implement lifecycle policies to auto-delete old XCom data.

In modern Airflow, the has made XComs feel more integrated than ever. Instead of manually "pushing" and "pulling" values, you simply return a value from one Python function and pass it as an argument to another. This creates an "exclusive" flow where data and dependencies are inextricably linked. Key Characteristics airflow xcom exclusive