Airflow Xcom Exclusive __hot__ ★ Quick
Mastering Apache Airflow XComs: Managing Exclusive Data Exchange
With Exclusive Mode (Order)
- Unexpected missing XCom: confirm execution_date/run_id and task_id match; check producer succeeded.
- Stale/overwritten XCom: check for multiple writers (same task_id retries, or different tasks accidentally using same task_id due to dynamic task mapping).
- Large or failing XCom serialization: check XCom backend limits and serialization errors in worker logs.
: To share metadata or small result sets (like a filename or a record count) between tasks in a airflow xcom exclusive
Common patterns and pitfalls
When a task returns a dict, Airflow pushes each key independently. This can cause fragmentation. Use single return values or multiple_outputs=True carefully. : To share metadata or small result sets