Airflow Xcom Exclusive

: Tasks retrieve data using xcom_pull() , which can be filtered by task_ids , dag_id , or a specific key . Advanced "Exclusive" Strategies

XCom is not a general-purpose data storage system. It is exclusive to small amounts of metadata due to the following hard limits: airflow xcom exclusive

import redis r = redis.Redis()

: This operator features a strict mutual exclusivity between store_to_xcom_key and writing to a local file. You can either return the file content via XCom or save it to a filename, but not both. : Tasks retrieve data using xcom_pull() , which

@task def transform(data: dict): processed = [uid * 10 for uid in data["user_ids"]] return "result": processed : Tasks retrieve data using xcom_pull()