Skip to content

Instantly share code, notes, and snippets.

@potiuk
Created January 9, 2025 22:22
Show Gist options
  • Save potiuk/2f97cfb062627a595a2d9d89f10b2c58 to your computer and use it in GitHub Desktop.
Save potiuk/2f97cfb062627a595a2d9d89f10b2c58 to your computer and use it in GitHub Desktop.
[2025-01-09T22:10:10.339+0000] {manager.py:224} WARNING - DagFileProcessorManager (PID=48) exited with exit code 1 - re-launching
[2025-01-09T22:10:10.343+0000] {manager.py:169} INFO - Launched DagFileProcessorManager with pid: 71
[2025-01-09T22:10:10.351+0000] {settings.py:63} INFO - Configured default timezone UTC
127.0.0.1 - - [09/Jan/2025 22:10:37] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:11:07] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:11:37] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:12:07] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:12:37] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:13:07] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:13:37] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:14:07] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:14:37] "GET /health HTTP/1.1" 200 -
[2025-01-09T22:15:06.218+0000] {scheduler_job_runner.py:1942} INFO - Adopting or resetting orphaned tasks for active dag runs
2025-01-09 22:15:07 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/tutorial_objectstorage.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Importing /opt/airflow/airflow/example_dags/tutorial_objectstorage.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_trigger_controller_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Importing /opt/airflow/airflow/example_dags/example_trigger_controller_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Loaded DAG <DAG: example_trigger_controller_dag> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_trigger_controller_dag.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_trigger_controller_dag","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_trigger_controller_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.OnceTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"test_trigger_dagrun":["operator","test_trigger_dagrun"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TriggerDagRunOperator","template_ext":[],"task_id":"test_trigger_dagrun","template_fields_renderers":{"conf":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["trigger_dag_id","trigger_run_id","logical_date","conf","wait_for_completion","skip_when_already_exists"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.trigger_dagrun","_is_empty":false,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.operators.trigger_dagrun.TriggerDagRunLink":{}}],"trigger_dag_id":"example_trigger_target_dag","conf":{"message":"Hello World"},"wait_for_completion":false,"skip_when_already_exists":false},"__type":"operator"}],"dag_dependencies":[{"source":"example_trigger_controller_dag","target":"example_trigger_target_dag","dependency_type":"trigger","dependency_id":"test_trigger_dagrun"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:07 [debug ] Loaded DAG <DAG: tutorial_objectstorage> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:07.194+0000] {dag.py:1861} INFO - Sync 1 DAGs
127.0.0.1 - - [09/Jan/2025 22:15:07] "GET /health HTTP/1.1" 200 -
[2025-01-09T22:15:07.812+0000] {dag.py:2418} INFO - Setting next_dagrun for example_trigger_controller_dag to 2021-01-01 00:00:00+00:00, run_after=2021-01-01 00:00:00+00:00
2025-01-09 22:15:07 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/tutorial_objectstorage.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"tutorial_objectstorage","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/tutorial_objectstorage.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"\n ### Object Storage Tutorial Documentation\n This is a tutorial DAG to showcase the usage of the Object Storage API.\n Documentation that goes along with the Airflow Object Storage tutorial is\n located\n [here](https://airflow.apache.org/docs/apache-airflow/stable/tutorial/objectstorage.html)\n ","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"get_air_quality_data":["operator","get_air_quality_data"],"analyze":["operator","analyze"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"get_air_quality_data","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Get Air Quality Data\n This task gets air quality data from the Finnish Meteorological Institute's\n open data API. The data is saved as parquet.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["analyze"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_2602cd38116f80be795f2eb2d2b89bbea48b4b39_tutorial_objectstorage.get_air_quality_data","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"analyze","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Analyze\n This task analyzes the air quality data, prints the results\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_2602cd38116f80be795f2eb2d2b89bbea48b4b39_tutorial_objectstorage.analyze","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): get_air_quality_data>),)","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:07 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:07.849+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:07.854+0000] {dag.py:2418} INFO - Setting next_dagrun for tutorial_objectstorage to None, run_after=None
2025-01-09 22:15:07 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_sensors.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Importing /opt/airflow/airflow/example_dags/example_sensors.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Loaded DAG <DAG: example_sensors> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Plugins are already loaded. Skipping. [airflow.plugins_manager] [task]
2025-01-09 22:15:07 [debug ] Initialize custom taskinstance deps plugins [airflow.plugins_manager] [task]
2025-01-09 22:15:07 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:07 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:07 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:07 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:07 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:07 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_params_ui_tutorial.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Importing /opt/airflow/airflow/example_dags/example_params_ui_tutorial.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_sensors.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_sensors","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_sensors.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"wait_some_seconds":["operator","wait_some_seconds"],"wait_some_seconds_async":["operator","wait_some_seconds_async"],"fire_immediately":["operator","fire_immediately"],"timeout_after_second_date_in_the_future":["operator","timeout_after_second_date_in_the_future"],"fire_immediately_async":["operator","fire_immediately_async"],"timeout_after_second_date_in_the_future_async":["operator","timeout_after_second_date_in_the_future_async"],"Sensor_succeeds":["operator","Sensor_succeeds"],"Sensor_fails_after_3_seconds":["operator","Sensor_fails_after_3_seconds"],"remove_file":["operator","remove_file"],"wait_for_file":["operator","wait_for_file"],"wait_for_file_async":["operator","wait_for_file_async"],"create_file_after_3_seconds":["operator","create_file_after_3_seconds"],"success_sensor_python":["operator","success_sensor_python"],"failure_timeout_sensor_python":["operator","failure_timeout_sensor_python"],"week_day_sensor_failing_on_timeout":["operator","week_day_sensor_failing_on_timeout"],"print_date_in_bash":["operator","print_date_in_bash"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeDeltaSensor","template_ext":[],"task_id":"wait_some_seconds","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time_delta","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeDeltaSensorAsync","template_ext":[],"task_id":"wait_some_seconds_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time_delta","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensor","template_ext":[],"task_id":"fire_immediately","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensor","template_ext":[],"task_id":"timeout_after_second_date_in_the_future","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensorAsync","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.temporal.DateTimeTrigger","trigger_kwargs":{"__var":{"moment":"","end_from_trigger":false},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"fire_immediately_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensorAsync","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.temporal.DateTimeTrigger","trigger_kwargs":{"__var":{"moment":"","end_from_trigger":false},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"timeout_after_second_date_in_the_future_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashSensor","template_ext":[],"task_id":"Sensor_succeeds","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.bash","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"bash_command":"exit 0"},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashSensor","template_ext":[],"task_id":"Sensor_fails_after_3_seconds","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.bash","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"bash_command":"exit 1"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"remove_file","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["wait_for_file"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"rm -rf /tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#91818a","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"FileSensor","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.file.FileTrigger","trigger_kwargs":{"__var":{},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"wait_for_file","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["filepath"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["wait_for_file_async"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.filesystem","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"filepath":"/tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#91818a","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"FileSensor","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.file.FileTrigger","trigger_kwargs":{"__var":{},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"wait_for_file_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["filepath"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.filesystem","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"filepath":"/tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_file_after_3_seconds","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 3; touch /tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonSensor","template_ext":[],"task_id":"success_sensor_python","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8157bb0bc39931d610b49002036b0a741f6799bf_example_sensors.success_callable","_task_module":"airflow.providers.standard.sensors.python","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"op_args":[],"op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonSensor","template_ext":[],"task_id":"failure_timeout_sensor_python","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8157bb0bc39931d610b49002036b0a741f6799bf_example_sensors.failure_callable","_task_module":"airflow.providers.standard.sensors.python","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"op_args":[],"op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"DayOfWeekSensor","template_ext":[],"task_id":"week_day_sensor_failing_on_timeout","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.weekday","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"print_date_in_bash","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"trigger_rule":"none_failed","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"date"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:07.921+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:07.928+0000] {dag.py:2418} INFO - Setting next_dagrun for example_sensors to None, run_after=None
2025-01-09 22:15:07 [debug ] Loaded DAG <DAG: example_params_ui_tutorial> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:07 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:07 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:07 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_params_ui_tutorial.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_params_ui_tutorial","dag_display_name":"Params UI tutorial","timezone":"UTC","tags":["example","params","ui"],"start_date":1646352000.0,"fileloc":"/opt/airflow/airflow/example_dags/example_params_ui_tutorial.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"DAG demonstrating various options for a trigger form generated by DAG params.\n\nThe DAG attribute `params` is used to define a default dictionary of parameters which are usually passed\nto the DAG and which are used to render a trigger form.\n","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"show_params":["operator","show_params"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"description":"DAG demonstrating various options for a trigger form generated by DAG params","_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"show_params","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"_task_display_name":"Show used parameters","on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"params":[["x",{"__class":"airflow.models.param.Param","default":3,"description":null,"schema":{"__var":{},"__type":"dict"}}],["text",{"__class":"airflow.models.param.Param","default":"Hello World!","description":null,"schema":{"__var":{},"__type":"dict"}}],["flag",{"__class":"airflow.models.param.Param","default":false,"description":null,"schema":{"__var":{},"__type":"dict"}}],["a_simple_list",{"__class":"airflow.models.param.Param","default":["one","two","three","actually one value is made per line"],"description":null,"schema":{"__var":{},"__type":"dict"}}],["most_loved_number",{"__class":"airflow.models.param.Param","default":42,"description":null,"schema":{"__var":{"type":"integer","title":"Your favorite number","description_md":"Everybody should have a **favorite** number. Not only _math teachers_. If you can not think of any at the moment please think of the 42 which is very famous becauseof the book [The Hitchhiker's Guide to the Galaxy](https://en.wikipedia.org/wiki/Phrases_from_The_Hitchhiker%27s_Guide_to_the_Galaxy#The_Answer_to_the_Ultimate_Question_of_Life,_the_Universe,_and_Everything_is_42)."},"__type":"dict"}}],["pick_one",{"__class":"airflow.models.param.Param","default":"value 42","description":"You can use JSON schema enum's to generate drop down selection boxes.","schema":{"__var":{"type":"string","title":"Select one Value","enum":["value 16","value 17","value 18","value 19","value 20","value 21","value 22","value 23","value 24","value 25","value 26","value 27","value 28","value 29","value 30","value 31","value 32","value 33","value 34","value 35","value 36","value 37","value 38","value 39","value 40","value 41","value 42","value 43","value 44","value 45","value 46","value 47","value 48","value 49","value 50","value 51","value 52","value 53","value 54","value 55","value 56","value 57","value 58","value 59","value 60","value 61","value 62","value 63"]},"__type":"dict"}}],["pick_with_label",{"__class":"airflow.models.param.Param","default":3,"description":"With drop down selections you can also have nice display labels for the values.","schema":{"__var":{"type":"number","title":"Select one Number","enum":[1,2,3,4,5,6,7,8,9],"values_display":{"__var":{"1":"One","2":"Two","3":"Three","4":"Four - is like you take three and get one for free!","5":"Five","6":"Six","7":"Seven","8":"Eight","9":"Nine"},"__type":"dict"}},"__type":"dict"}}],["proposals",{"__class":"airflow.models.param.Param","default":"some value","description":"You can use JSON schema examples's to generate drop down selection boxes but allow also to enter custom values. Try typing an 'a' and see options.","schema":{"__var":{"type":"string","title":"Field with proposals","examples":["Alpha","Bravo","Charlie","Delta","Echo","Foxtrot","Golf","Hotel","India","Juliett","Kilo","Lima","Mike","November","Oscar","Papa","Quebec","Romeo","Sierra","Tango","Uniform","Victor","Whiskey","X-ray","Yankee","Zulu"]},"__type":"dict"}}],["multi_select",{"__class":"airflow.models.param.Param","default":["two","three"],"description":"Select from the list of options.","schema":{"__var":{"type":"array","title":"Multi Select","examples":["one","two","three","four","five"]},"__type":"dict"}}],["multi_select_with_label",{"__class":"airflow.models.param.Param","default":["2","3"],"description":"Select from the list of options. See that options can have nicer text and still technical valuesare propagated as values during trigger to the DAG.","schema":{"__var":{"type":"array","title":"Multi Select with Labels","examples":["1","2","3","4","5"],"values_display":{"__var":{"1":"One box of choccolate","2":"Two bananas","3":"Three apples"},"__type":"dict"}},"__type":"dict"}}],["array_of_numbers",{"__class":"airflow.models.param.Param","default":[1,2,3],"description":"Only integers are accepted in this array","schema":{"__var":{"type":"array","title":"Array of numbers","items":{"__var":{"type":"number"},"__type":"dict"}},"__type":"dict"}}],["bool",{"__class":"airflow.models.param.Param","default":true,"description":"A On/Off selection with a proper description.","schema":{"__var":{"type":"boolean","title":"Please confirm"},"__type":"dict"}}],["date_time",{"__class":"airflow.models.param.Param","default":"2025-01-09T12:17:00+00:00","description":"Please select a date and time, use the button on the left for a pop-up calendar.","schema":{"__var":{"type":"string","format":"date-time","title":"Date-Time Picker"},"__type":"dict"}}],["date",{"__class":"airflow.models.param.Param","default":"2025-01-09","description":"Please select a date, use the button on the left for a pop-up calendar. See that here are no times!","schema":{"__var":{"type":"string","format":"date","title":"Date Picker"},"__type":"dict"}}],["time",{"__class":"airflow.models.param.Param","default":"12:13:14","description":"Please select a time, use the button on the left for a pop-up tool.","schema":{"__var":{"type":["string","null"],"format":"time","title":"Time Picker"},"__type":"dict"}}],["multiline_text",{"__class":"airflow.models.param.Param","default":"A multiline text Param\nthat will keep the newline\ncharacters in its value.","description":"This field allows for multiline text input. The returned value will be a single with newline (\\n) characters kept intact.","schema":{"__var":{"type":["string","null"],"format":"multiline"},"__type":"dict"}}],["required_field",{"__class":"airflow.models.param.Param","default":{"__var":null,"__type":"arg_not_set"},"description":"This field is required. You can not submit without having text in here.","schema":{"__var":{"type":"string","title":"Required text field"},"__type":"dict"}}],["optional_field",{"__class":"airflow.models.param.Param","default":"optional text, you can trigger also w/o text","description":null,"schema":{"__var":{"type":["null","string"],"title":"Optional text field","description_md":"This field is optional. As field content is JSON schema validated you must allow the `null` type."},"__type":"dict"}}],["checked_text",{"__class":"airflow.models.param.Param","default":"length-checked-field","description":null,"schema":{"__var":{"type":"string","title":"Text field with length check","description_md":"This field is required. And you need to provide something between 10 and 30\n characters. See the JSON\n [schema description (string)](https://json-schema.org/understanding-json-schema/reference/string.html)\n for more details","minLength":10,"maxLength":20,"section":"JSON Schema validation options"},"__type":"dict"}}],["checked_number",{"__class":"airflow.models.param.Param","default":100,"description":null,"schema":{"__var":{"type":"number","title":"Number field with value check","description_md":"This field is required. You need to provide any number between 64 and 128.\n See the JSON\n [schema description (numbers)](https://json-schema.org/understanding-json-schema/reference/numeric.html)\n for more details","minimum":64,"maximum":128,"section":"JSON Schema validation options"},"__type":"dict"}}],["object",{"__class":"airflow.models.param.Param","default":{"__var":{"key":"value"},"__type":"dict"},"description":null,"schema":{"__var":{"type":["object","null"],"title":"JSON entry field","section":"Special advanced stuff with form fields"},"__type":"dict"}}],["array_of_objects",{"__class":"airflow.models.param.Param","default":[{"__var":{"name":"account_name","country":"country_name"},"__type":"dict"}],"description":null,"schema":{"__var":{"description_md":"Array with complex objects and validation rules. See [JSON Schema validation options in specs](https://json-schema.org/understanding-json-schema/reference/array.html#items).","type":"array","title":"JSON array field","items":{"__var":{"type":"object","properties":{"__var":{"name":{"__var":{"type":"string"},"__type":"dict"},"country_name":{"__var":{"type":"string"},"__type":"dict"}},"__type":"dict"},"required":["name"]},"__type":"dict"},"section":"Special advanced stuff with form fields"},"__type":"dict"}}],["hidden_secret_field",{"__class":"airflow.models.param.Param","default":"constant value","description":null,"schema":{"__var":{"const":"constant value"},"__type":"dict"}}]],"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_44cb27f57d5b198d3a3990eb68b78ee8a1565228_example_params_ui_tutorial.show_params","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[["x",{"__class":"airflow.models.param.Param","default":3,"description":null,"schema":{"__var":{},"__type":"dict"}}],["text",{"__class":"airflow.models.param.Param","default":"Hello World!","description":null,"schema":{"__var":{},"__type":"dict"}}],["flag",{"__class":"airflow.models.param.Param","default":false,"description":null,"schema":{"__var":{},"__type":"dict"}}],["a_simple_list",{"__class":"airflow.models.param.Param","default":["one","two","three","actually one value is made per line"],"description":null,"schema":{"__var":{},"__type":"dict"}}],["most_loved_number",{"__class":"airflow.models.param.Param","default":42,"description":null,"schema":{"__var":{"type":"integer","title":"Your favorite number","description_md":"Everybody should have a **favorite** number. Not only _math teachers_. If you can not think of any at the moment please think of the 42 which is very famous becauseof the book [The Hitchhiker's Guide to the Galaxy](https://en.wikipedia.org/wiki/Phrases_from_The_Hitchhiker%27s_Guide_to_the_Galaxy#The_Answer_to_the_Ultimate_Question_of_Life,_the_Universe,_and_Everything_is_42)."},"__type":"dict"}}],["pick_one",{"__class":"airflow.models.param.Param","default":"value 42","description":"You can use JSON schema enum's to generate drop down selection boxes.","schema":{"__var":{"type":"string","title":"Select one Value","enum":["value 16","value 17","value 18","value 19","value 20","value 21","value 22","value 23","value 24","value 25","value 26","value 27","value 28","value 29","value 30","value 31","value 32","value 33","value 34","value 35","value 36","value 37","value 38","value 39","value 40","value 41","value 42","value 43","value 44","value 45","value 46","value 47","value 48","value 49","value 50","value 51","value 52","value 53","value 54","value 55","value 56","value 57","value 58","value 59","value 60","value 61","value 62","value 63"]},"__type":"dict"}}],["pick_with_label",{"__class":"airflow.models.param.Param","default":3,"description":"With drop down selections you can also have nice display labels for the values.","schema":{"__var":{"type":"number","title":"Select one Number","enum":[1,2,3,4,5,6,7,8,9],"values_display":{"__var":{"1":"One","2":"Two","3":"Three","4":"Four - is like you take three and get one for free!","5":"Five","6":"Six","7":"Seven","8":"Eight","9":"Nine"},"__type":"dict"}},"__type":"dict"}}],["proposals",{"__class":"airflow.models.param.Param","default":"some value","description":"You can use JSON schema examples's to generate drop down selection boxes but allow also to enter custom values. Try typing an 'a' and see options.","schema":{"__var":{"type":"string","title":"Field with proposals","examples":["Alpha","Bravo","Charlie","Delta","Echo","Foxtrot","Golf","Hotel","India","Juliett","Kilo","Lima","Mike","November","Oscar","Papa","Quebec","Romeo","Sierra","Tango","Uniform","Victor","Whiskey","X-ray","Yankee","Zulu"]},"__type":"dict"}}],["multi_select",{"__class":"airflow.models.param.Param","default":["two","three"],"description":"Select from the list of options.","schema":{"__var":{"type":"array","title":"Multi Select","examples":["one","two","three","four","five"]},"__type":"dict"}}],["multi_select_with_label",{"__class":"airflow.models.param.Param","default":["2","3"],"description":"Select from the list of options. See that options can have nicer text and still technical valuesare propagated as values during trigger to the DAG.","schema":{"__var":{"type":"array","title":"Multi Select with Labels","examples":["1","2","3","4","5"],"values_display":{"__var":{"1":"One box of choccolate","2":"Two bananas","3":"Three apples"},"__type":"dict"}},"__type":"dict"}}],["array_of_numbers",{"__class":"airflow.models.param.Param","default":[1,2,3],"description":"Only integers are accepted in this array","schema":{"__var":{"type":"array","title":"Array of numbers","items":{"__var":{"type":"number"},"__type":"dict"}},"__type":"dict"}}],["bool",{"__class":"airflow.models.param.Param","default":true,"description":"A On/Off selection with a proper description.","schema":{"__var":{"type":"boolean","title":"Please confirm"},"__type":"dict"}}],["date_time",{"__class":"airflow.models.param.Param","default":"2025-01-09T12:17:00+00:00","description":"Please select a date and time, use the button on the left for a pop-up calendar.","schema":{"__var":{"type":"string","format":"date-time","title":"Date-Time Picker"},"__type":"dict"}}],["date",{"__class":"airflow.models.param.Param","default":"2025-01-09","description":"Please select a date, use the button on the left for a pop-up calendar. See that here are no times!","schema":{"__var":{"type":"string","format":"date","title":"Date Picker"},"__type":"dict"}}],["time",{"__class":"airflow.models.param.Param","default":"12:13:14","description":"Please select a time, use the button on the left for a pop-up tool.","schema":{"__var":{"type":["string","null"],"format":"time","title":"Time Picker"},"__type":"dict"}}],["multiline_text",{"__class":"airflow.models.param.Param","default":"A multiline text Param\nthat will keep the newline\ncharacters in its value.","description":"This field allows for multiline text input. The returned value will be a single with newline (\\n) characters kept intact.","schema":{"__var":{"type":["string","null"],"format":"multiline"},"__type":"dict"}}],["required_field",{"__class":"airflow.models.param.Param","default":{"__var":null,"__type":"arg_not_set"},"description":"This field is required. You can not submit without having text in here.","schema":{"__var":{"type":"string","title":"Required text field"},"__type":"dict"}}],["optional_field",{"__class":"airflow.models.param.Param","default":"optional text, you can trigger also w/o text","description":null,"schema":{"__var":{"type":["null","string"],"title":"Optional text field","description_md":"This field is optional. As field content is JSON schema validated you must allow the `null` type."},"__type":"dict"}}],["checked_text",{"__class":"airflow.models.param.Param","default":"length-checked-field","description":null,"schema":{"__var":{"type":"string","title":"Text field with length check","description_md":"This field is required. And you need to provide something between 10 and 30\n characters. See the JSON\n [schema description (string)](https://json-schema.org/understanding-json-schema/reference/string.html)\n for more details","minLength":10,"maxLength":20,"section":"JSON Schema validation options"},"__type":"dict"}}],["checked_number",{"__class":"airflow.models.param.Param","default":100,"description":null,"schema":{"__var":{"type":"number","title":"Number field with value check","description_md":"This field is required. You need to provide any number between 64 and 128.\n See the JSON\n [schema description (numbers)](https://json-schema.org/understanding-json-schema/reference/numeric.html)\n for more details","minimum":64,"maximum":128,"section":"JSON Schema validation options"},"__type":"dict"}}],["object",{"__class":"airflow.models.param.Param","default":{"__var":{"key":"value"},"__type":"dict"},"description":null,"schema":{"__var":{"type":["object","null"],"title":"JSON entry field","section":"Special advanced stuff with form fields"},"__type":"dict"}}],["array_of_objects",{"__class":"airflow.models.param.Param","default":[{"__var":{"name":"account_name","country":"country_name"},"__type":"dict"}],"description":null,"schema":{"__var":{"description_md":"Array with complex objects and validation rules. See [JSON Schema validation options in specs](https://json-schema.org/understanding-json-schema/reference/array.html#items).","type":"array","title":"JSON array field","items":{"__var":{"type":"object","properties":{"__var":{"name":{"__var":{"type":"string"},"__type":"dict"},"country_name":{"__var":{"type":"string"},"__type":"dict"}},"__type":"dict"},"required":["name"]},"__type":"dict"},"section":"Special advanced stuff with form fields"},"__type":"dict"}}],["hidden_secret_field",{"__class":"airflow.models.param.Param","default":"constant value","description":null,"schema":{"__var":{"const":"constant value"},"__type":"dict"}}]]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:07.982+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:07.986+0000] {dag.py:2418} INFO - Setting next_dagrun for example_params_ui_tutorial to None, run_after=None
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_outlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_outlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Initializing Providers Manager[asset_uris] [airflow.providers_manager] [task]
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: latest_only_with_trigger> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Initialization of Providers Manager[asset_uris] took 0.04 seconds [airflow.providers_manager] [task]
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"latest_only_with_trigger","timezone":"UTC","tags":["example3"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.DeltaDataIntervalTimetable","__var":{"delta":14400.0}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"latest_only":["operator","latest_only"],"task1":["operator","task1"],"task2":["operator","task2"],"task3":["operator","task3"],"task4":["operator","task4"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e9ffdb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"LatestOnlyOperator","template_ext":[],"task_id":"latest_only","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task1"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.latest_only","_is_empty":false,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task3","task4"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task3","task4"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task4","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"all_done","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_with_extra_by_context> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_with_extra_from_classic_operator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_with_extra_by_yield> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:08.061+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:08.068+0000] {dag.py:2418} INFO - Setting next_dagrun for latest_only_with_trigger to 2025-01-09 16:00:00+00:00, run_after=2025-01-09 20:00:00+00:00
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_with_extra_by_context","timezone":"UTC","tags":["produces"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"asset_with_extra_by_context":["operator","asset_with_extra_by_context"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"asset_with_extra_by_context","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"test-asset","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_f06f1ad2457a51bd0234f46fd69f068d5815c10b_example_outlet_event_extra.asset_with_extra_by_context","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset_with_extra_by_context","target":"asset","dependency_type":"asset","dependency_id":"test-asset"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_with_extra_from_classic_operator","timezone":"UTC","tags":["produces"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"asset_with_extra_from_classic_operator":["operator","asset_with_extra_from_classic_operator"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"asset_with_extra_from_classic_operator","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"test-asset","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":":"},"__type":"operator"}],"dag_dependencies":[{"source":"asset_with_extra_from_classic_operator","target":"asset","dependency_type":"asset","dependency_id":"test-asset"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_with_extra_by_yield","timezone":"UTC","tags":["produces"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"asset_with_extra_by_yield":["operator","asset_with_extra_by_yield"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"asset_with_extra_by_yield","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"test-asset","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_f06f1ad2457a51bd0234f46fd69f068d5815c10b_example_outlet_event_extra.asset_with_extra_by_yield","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset_with_extra_by_yield","target":"asset","dependency_type":"asset","dependency_id":"test-asset"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:08.095+0000] {dag.py:1861} INFO - Sync 3 DAGs
[2025-01-09T22:15:08.149+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_with_extra_by_context to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:08.153+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_with_extra_by_yield to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:08.155+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_with_extra_from_classic_operator to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_latest_only.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_latest_only.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: latest_only> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"latest_only","timezone":"UTC","tags":["example2","example3"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.DeltaDataIntervalTimetable","__var":{"delta":14400.0}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"latest_only":["operator","latest_only"],"task1":["operator","task1"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e9ffdb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"LatestOnlyOperator","template_ext":[],"task_id":"latest_only","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task1"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.latest_only","_is_empty":false,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:08.196+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:08.202+0000] {dag.py:2418} INFO - Setting next_dagrun for latest_only to 2025-01-09 16:00:00+00:00, run_after=2025-01-09 20:00:00+00:00
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_inlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_inlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: read_asset_event_from_classic> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: read_asset_event> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_inlet_event_extra.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"read_asset_event_from_classic","timezone":"UTC","tags":["consumes"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_inlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"read_asset_event_from_classic":["operator","read_asset_event_from_classic"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"read_asset_event_from_classic","template_fields_renderers":{"bash_command":"bash","env":"json"},"inlets":[{"__var":{"name":"s3://output/1.txt","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo '{{ inlet_events['s3://output/1.txt'][-1].extra | tojson }}'"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"read_asset_event","timezone":"UTC","tags":["consumes"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_inlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"read_asset_event":["operator","read_asset_event"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"read_asset_event","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"inlets":[{"__var":{"name":"s3://output/1.txt","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_97c8ee958e8f6968fd91b9366ca9be7043a80f60_example_inlet_event_extra.read_asset_event","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_external_task_marker_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_external_task_marker_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:08.262+0000] {dag.py:1861} INFO - Sync 2 DAGs
[2025-01-09T22:15:08.272+0000] {dag.py:2418} INFO - Setting next_dagrun for read_asset_event to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:08.276+0000] {dag.py:2418} INFO - Setting next_dagrun for read_asset_event_from_classic to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: example_external_task_marker_child> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: example_external_task_marker_parent> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_external_task_marker_dag.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_external_task_marker_child","timezone":"UTC","tags":["example2"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_external_task_marker_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"child_task1":["operator","child_task1"],"child_task2":["operator","child_task2"],"child_task3":["operator","child_task3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#4db7db","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalTaskSensor","template_ext":[],"task_id":"child_task1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["external_dag_id","external_task_id","external_task_ids","external_task_group_id"],"_needs_expansion":false,"is_teardown":false,"reschedule":true,"downstream_task_ids":["child_task2"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.external_task","_is_empty":false,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.sensors.external_task.ExternalDagLink":{}}],"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"external_dag_id":"example_external_task_marker_parent","external_task_id":"parent_task","external_task_ids":["parent_task"]},"__type":"operator"},{"__var":{"ui_color":"#4db7db","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalTaskSensor","template_ext":[],"task_id":"child_task2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["external_dag_id","external_task_id","external_task_ids","external_task_group_id"],"_needs_expansion":false,"is_teardown":false,"reschedule":true,"downstream_task_ids":["child_task3"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.external_task","_is_empty":false,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.sensors.external_task.ExternalDagLink":{}}],"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"external_dag_id":"example_external_task_marker_parent","external_task_group_id":"parent_dag_task_group_id"},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"child_task3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[{"source":"example_external_task_marker_parent","target":"example_external_task_marker_child","dependency_type":"sensor","dependency_id":"child_task1"},{"source":"example_external_task_marker_parent","target":"example_external_task_marker_child","dependency_type":"sensor","dependency_id":"child_task2"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_external_task_marker_parent","timezone":"UTC","tags":["example2"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_external_task_marker_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"parent_task":["operator","parent_task"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#4db7db","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalTaskMarker","template_ext":[],"recursion_depth":10,"task_id":"parent_task","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["external_dag_id","external_task_id","logical_date"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.external_task","_is_empty":true,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.sensors.external_task.ExternalDagLink":{}}],"external_dag_id":"example_external_task_marker_child","external_task_id":"child_task1","logical_date":"{{ logical_date.isoformat() }}"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:08.311+0000] {dag.py:1861} INFO - Sync 2 DAGs
[2025-01-09T22:15:08.318+0000] {dag.py:2418} INFO - Setting next_dagrun for example_external_task_marker_child to None, run_after=None
[2025-01-09T22:15:08.319+0000] {dag.py:2418} INFO - Setting next_dagrun for example_external_task_marker_parent to None, run_after=None
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: example_branch_dop_operator_v3> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_branch_dop_operator_v3","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"*/1 * * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"should_run":["operator","should_run"],"empty_task_1":["operator","empty_task_1"],"empty_task_2":["operator","empty_task_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"default_args":{"__var":{"depends_on_past":true},"__type":"dict"},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BranchPythonDecoratedOperator","template_ext":[],"task_id":"should_run","depends_on_past":true,"template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n Determine which empty_task should be run based on if the logical date minute is even or odd.\n\n :param dict kwargs: Context\n :return: Id of the task to run\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["empty_task_1","empty_task_2"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_fd80fe6ebb99ee119311efc72db973227162960a_example_branch_python_dop_operator_3.should_run","_task_module":"airflow.decorators.branch_python","_operator_name":"@task.branch","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"empty_task_1","depends_on_past":true,"template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"empty_task_2","depends_on_past":true,"template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:08.373+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:08.385+0000] {dag.py:2418} INFO - Setting next_dagrun for example_branch_dop_operator_v3 to 2025-01-09 22:14:00+00:00, run_after=2025-01-09 22:15:00+00:00
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_assets.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_assets.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: consume_1_and_2_with_asset_expressions> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_consumes_1> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_consumes_1_never_scheduled> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_produces_2> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_consumes_unknown_never_scheduled> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: consume_1_or_2_with_asset_expressions> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_produces_1> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_consumes_1_and_2> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: consume_1_or_both_2_and_3_with_asset_expressions> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: conditional_asset_and_time_based_timetable> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"consume_1_and_2_with_asset_expressions","timezone":"UTC","tags":[],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_1_and_2_with_asset_expressions":["operator","consume_1_and_2_with_asset_expressions"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consume_1_and_2_with_asset_expressions","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"consume_1_and_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"consume_1_and_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"consume_1_and_2_with_asset_expressions","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_1","timezone":"UTC","tags":["asset-scheduled","consumes"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consuming_1":["operator","consuming_1"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consuming_1","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_1_task/asset_other.txt","uri":"s3://consuming_1_task/asset_other.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_1","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset_consumes_1","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_1_task/asset_other.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_1_never_scheduled","timezone":"UTC","tags":["asset-scheduled","consumes"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://unrelated/this-asset-doesnt-get-triggered","uri":"s3://unrelated/this-asset-doesnt-get-triggered","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consuming_3":["operator","consuming_3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consuming_3","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_1_never_scheduled","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"asset_consumes_1_never_scheduled","dependency_type":"asset","dependency_id":"s3://unrelated/this-asset-doesnt-get-triggered"},{"source":"asset_consumes_1_never_scheduled","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_produces_2","timezone":"UTC","tags":["asset-scheduled","produces"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"producing_task_2":["operator","producing_task_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"producing_task_2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset_produces_2","target":"asset","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_unknown_never_scheduled","timezone":"UTC","tags":["asset-scheduled"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://unrelated/asset3.txt","uri":"s3://unrelated/asset3.txt","group":"asset","extra":{}},{"__type":"asset","name":"s3://unrelated/asset_other_unknown.txt","uri":"s3://unrelated/asset_other_unknown.txt","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"unrelated_task":["operator","unrelated_task"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"unrelated_task","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://unrelated_task/asset_other_unknown.txt","uri":"s3://unrelated_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_unknown_never_scheduled","dependency_type":"asset","dependency_id":"s3://unrelated/asset3.txt"},{"source":"asset","target":"asset_consumes_unknown_never_scheduled","dependency_type":"asset","dependency_id":"s3://unrelated/asset_other_unknown.txt"},{"source":"asset_consumes_unknown_never_scheduled","target":"asset","dependency_type":"asset","dependency_id":"s3://unrelated_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"consume_1_or_2_with_asset_expressions","timezone":"UTC","tags":[],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_any","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_1_or_2_with_asset_expressions":["operator","consume_1_or_2_with_asset_expressions"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consume_1_or_2_with_asset_expressions","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"consume_1_or_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"consume_1_or_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"consume_1_or_2_with_asset_expressions","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_produces_1","timezone":"UTC","tags":["asset-scheduled","produces"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"producing_task_1":["operator","producing_task_1"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"producing_task_1","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset_produces_1","target":"asset","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_1_and_2","timezone":"UTC","tags":["asset-scheduled","consumes"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consuming_2":["operator","consuming_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consuming_2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_1_and_2","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"asset_consumes_1_and_2","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"asset_consumes_1_and_2","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"consume_1_or_both_2_and_3_with_asset_expressions","timezone":"UTC","tags":[],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_any","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag3/output_3.txt","uri":"s3://dag3/output_3.txt","group":"asset","extra":{"hi":"bye"}}]}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_1_or_both_2_and_3_with_asset_expressions":["operator","consume_1_or_both_2_and_3_with_asset_expressions"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consume_1_or_both_2_and_3_with_asset_expressions","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"consume_1_or_both_2_and_3_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"consume_1_or_both_2_and_3_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"asset","target":"consume_1_or_both_2_and_3_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag3/output_3.txt"},{"source":"consume_1_or_both_2_and_3_with_asset_expressions","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"conditional_asset_and_time_based_timetable","timezone":"UTC","tags":["asset-time-based-timetable"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.assets.AssetOrTimeSchedule","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]},"timetable":{"__type":"airflow.timetables.trigger.CronTriggerTimetable","__var":{"expression":"0 1 * * 3","timezone":"UTC","interval":0.0,"run_immediately":false}}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"conditional_asset_and_time_based_timetable":["operator","conditional_asset_and_time_based_timetable"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"conditional_asset_and_time_based_timetable","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://asset_time_based/asset_other_unknown.txt","uri":"s3://asset_time_based/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"conditional_asset_and_time_based_timetable","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"conditional_asset_and_time_based_timetable","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"conditional_asset_and_time_based_timetable","target":"asset","dependency_type":"asset","dependency_id":"s3://asset_time_based/asset_other_unknown.txt"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:08.432+0000] {dag.py:1861} INFO - Sync 10 DAGs
[2025-01-09T22:15:08.441+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_1 to None, run_after=None
[2025-01-09T22:15:08.443+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_1_and_2 to None, run_after=None
[2025-01-09T22:15:08.445+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_1_never_scheduled to None, run_after=None
[2025-01-09T22:15:08.446+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_unknown_never_scheduled to None, run_after=None
[2025-01-09T22:15:08.449+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_produces_1 to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:08.451+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_produces_2 to None, run_after=None
[2025-01-09T22:15:08.455+0000] {dag.py:2418} INFO - Setting next_dagrun for conditional_asset_and_time_based_timetable to 2025-01-08 01:00:00+00:00, run_after=2025-01-08 01:00:00+00:00
[2025-01-09T22:15:08.456+0000] {dag.py:2418} INFO - Setting next_dagrun for consume_1_and_2_with_asset_expressions to None, run_after=None
[2025-01-09T22:15:08.457+0000] {dag.py:2418} INFO - Setting next_dagrun for consume_1_or_2_with_asset_expressions to None, run_after=None
[2025-01-09T22:15:08.459+0000] {dag.py:2418} INFO - Setting next_dagrun for consume_1_or_both_2_and_3_with_asset_expressions to None, run_after=None
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_asset_with_watchers.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_asset_with_watchers.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: example_asset_with_watchers> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: example_create_file> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_asset_with_watchers.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_asset_with_watchers","timezone":"UTC","tags":[],"fileloc":"/opt/airflow/airflow/example_dags/example_asset_with_watchers.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"example_asset","uri":"example_asset","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"delete_file":["operator","delete_file"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"delete_file","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_7b99e56f49be0452f4f9715d58326bb6ec761a8a_example_asset_with_watchers.delete_file","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"example_asset_with_watchers","dependency_type":"asset","dependency_id":"example_asset"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_create_file","timezone":"UTC","tags":[],"fileloc":"/opt/airflow/airflow/example_dags/example_asset_with_watchers.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"create_file":["operator","create_file"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"create_file","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_7b99e56f49be0452f4f9715d58326bb6ec761a8a_example_asset_with_watchers.create_file","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:08.519+0000] {dag.py:1861} INFO - Sync 2 DAGs
[2025-01-09T22:15:08.527+0000] {dag.py:2418} INFO - Setting next_dagrun for example_asset_with_watchers to None, run_after=None
[2025-01-09T22:15:08.529+0000] {dag.py:2418} INFO - Setting next_dagrun for example_create_file to None, run_after=None
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_asset_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_asset_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset1_producer> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: consumes_asset_decorator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset2_producer> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_asset_decorator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset1_producer","timezone":"UTC","tags":[],"fileloc":"/opt/airflow/airflow/example_dags/example_asset_decorator.py","timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"__main__":["operator","__main__"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_AssetMainOperator","template_ext":[],"task_id":"__main__","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"asset1_producer","uri":"s3://bucket/asset1_producer","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_744a3ca386764aa43ae75440efe028aad0f31b0f_example_asset_decorator.asset1_producer","_task_module":"airflow.sdk.definitions.asset.decorators","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset1_producer","target":"asset","dependency_type":"asset","dependency_id":"asset1_producer"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"consumes_asset_decorator","timezone":"UTC","tags":["asset-scheduled","consumes"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_asset_decorator.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_any","objects":[{"__type":"asset","name":"asset1_producer","uri":"s3://bucket/asset1_producer","group":"asset","extra":{}},{"__type":"asset","name":"asset2_producer","uri":"s3://bucket/object","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"process_nothing":["operator","process_nothing"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"process_nothing","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"process_nothing","uri":"process_nothing","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_744a3ca386764aa43ae75440efe028aad0f31b0f_example_asset_decorator.process_nothing","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"consumes_asset_decorator","dependency_type":"asset","dependency_id":"asset1_producer"},{"source":"asset","target":"consumes_asset_decorator","dependency_type":"asset","dependency_id":"asset2_producer"},{"source":"consumes_asset_decorator","target":"asset","dependency_type":"asset","dependency_id":"process_nothing"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset2_producer","timezone":"UTC","tags":[],"fileloc":"/opt/airflow/airflow/example_dags/example_asset_decorator.py","timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"__main__":["operator","__main__"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_AssetMainOperator","template_ext":[],"task_id":"__main__","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"inlets":[{"__var":{"name":"asset1_producer"},"__type":"asset_ref"}],"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"asset2_producer","uri":"s3://bucket/object","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_744a3ca386764aa43ae75440efe028aad0f31b0f_example_asset_decorator.asset2_producer","_task_module":"airflow.sdk.definitions.asset.decorators","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset2_producer","target":"asset","dependency_type":"asset","dependency_id":"asset2_producer"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:08.590+0000] {dag.py:1861} INFO - Sync 3 DAGs
[2025-01-09T22:15:08.597+0000] {dag.py:2418} INFO - Setting next_dagrun for asset1_producer to None, run_after=None
[2025-01-09T22:15:08.599+0000] {dag.py:2418} INFO - Setting next_dagrun for asset2_producer to None, run_after=None
[2025-01-09T22:15:08.600+0000] {dag.py:2418} INFO - Setting next_dagrun for consumes_asset_decorator to None, run_after=None
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_alias_example_alias_producer_with_no_taskflow> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_alias_example_alias_consumer_with_no_taskflow> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_s3_bucket_consumer_with_no_taskflow> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_s3_bucket_producer_with_no_taskflow> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_alias_example_alias_producer_with_no_taskflow","timezone":"UTC","tags":["asset-alias","producer"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"produce_asset_events_through_asset_alias_with_no_taskflow":["operator","produce_asset_events_through_asset_alias_with_no_taskflow"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"produce_asset_events_through_asset_alias_with_no_taskflow","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"example-alias-no-taskflow","group":"asset"},"__type":"asset_alias"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_2123b618d97a58f5ff404ff3e82c2be16595566a_example_asset_alias_with_no_taskflow.produce_asset_events_through_asset_alias_with_no_taskflow","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset_alias_example_alias_producer_with_no_taskflow","target":"asset-alias","dependency_type":"asset-alias","dependency_id":"example-alias-no-taskflow"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_alias_example_alias_consumer_with_no_taskflow","timezone":"UTC","tags":["asset-alias","consumer"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset_alias","name":"example-alias-no-taskflow","group":"asset"}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_asset_event_from_asset_alias":["operator","consume_asset_event_from_asset_alias"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"consume_asset_event_from_asset_alias","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"inlets":[{"__var":{"name":"example-alias-no-taskflow","group":"asset"},"__type":"asset_alias"}],"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_2123b618d97a58f5ff404ff3e82c2be16595566a_example_asset_alias_with_no_taskflow.consume_asset_event_from_asset_alias","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset-alias","target":"asset_alias_example_alias_consumer_with_no_taskflow","dependency_type":"asset-alias","dependency_id":"example-alias-no-taskflow"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_s3_bucket_consumer_with_no_taskflow","timezone":"UTC","tags":["asset","consumer"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://bucket/my-task-with-no-taskflow","uri":"s3://bucket/my-task-with-no-taskflow","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_asset_event":["operator","consume_asset_event"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"consume_asset_event","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_2123b618d97a58f5ff404ff3e82c2be16595566a_example_asset_alias_with_no_taskflow.consume_asset_event","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_s3_bucket_consumer_with_no_taskflow","dependency_type":"asset","dependency_id":"s3://bucket/my-task-with-no-taskflow"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_s3_bucket_producer_with_no_taskflow","timezone":"UTC","tags":["asset","producer"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"produce_asset_events":["operator","produce_asset_events"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"produce_asset_events","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://bucket/my-task-with-no-taskflow","uri":"s3://bucket/my-task-with-no-taskflow","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_2123b618d97a58f5ff404ff3e82c2be16595566a_example_asset_alias_with_no_taskflow.produce_asset_events","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset_s3_bucket_producer_with_no_taskflow","target":"asset","dependency_type":"asset","dependency_id":"s3://bucket/my-task-with-no-taskflow"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:08.643+0000] {dag.py:1861} INFO - Sync 4 DAGs
[2025-01-09T22:15:08.646+0000] {collection.py:85} INFO - Creating ORM DAG for asset_alias_example_alias_producer_with_no_taskflow
[2025-01-09T22:15:08.646+0000] {collection.py:85} INFO - Creating ORM DAG for asset_alias_example_alias_consumer_with_no_taskflow
[2025-01-09T22:15:08.646+0000] {collection.py:85} INFO - Creating ORM DAG for asset_s3_bucket_consumer_with_no_taskflow
[2025-01-09T22:15:08.647+0000] {collection.py:85} INFO - Creating ORM DAG for asset_s3_bucket_producer_with_no_taskflow
[2025-01-09T22:15:08.651+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_alias_example_alias_consumer_with_no_taskflow to None, run_after=None
[2025-01-09T22:15:08.652+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_alias_example_alias_producer_with_no_taskflow to None, run_after=None
[2025-01-09T22:15:08.653+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_s3_bucket_consumer_with_no_taskflow to None, run_after=None
[2025-01-09T22:15:08.653+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_s3_bucket_producer_with_no_taskflow to None, run_after=None
[2025-01-09T22:15:08.706+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:asset_alias_example_alias_producer_with_no_taskflow
[2025-01-09T22:15:08.711+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:asset_alias_example_alias_producer_with_no_taskflow
[2025-01-09T22:15:08.714+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:asset_alias_example_alias_producer_with_no_taskflow
[2025-01-09T22:15:08.716+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:asset_alias_example_alias_producer_with_no_taskflow
[2025-01-09T22:15:08.719+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:asset_alias_example_alias_producer_with_no_taskflow
[2025-01-09T22:15:08.722+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:asset_alias_example_alias_producer_with_no_taskflow
[2025-01-09T22:15:08.725+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:asset_alias_example_alias_producer_with_no_taskflow
[2025-01-09T22:15:08.730+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:asset_alias_example_alias_consumer_with_no_taskflow
[2025-01-09T22:15:08.733+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:asset_alias_example_alias_consumer_with_no_taskflow
[2025-01-09T22:15:08.736+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:asset_alias_example_alias_consumer_with_no_taskflow
[2025-01-09T22:15:08.739+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:asset_alias_example_alias_consumer_with_no_taskflow
[2025-01-09T22:15:08.741+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:asset_alias_example_alias_consumer_with_no_taskflow
[2025-01-09T22:15:08.744+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:asset_alias_example_alias_consumer_with_no_taskflow
[2025-01-09T22:15:08.747+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:asset_alias_example_alias_consumer_with_no_taskflow
[2025-01-09T22:15:08.752+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:asset_s3_bucket_consumer_with_no_taskflow
[2025-01-09T22:15:08.754+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:asset_s3_bucket_consumer_with_no_taskflow
[2025-01-09T22:15:08.757+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:asset_s3_bucket_consumer_with_no_taskflow
[2025-01-09T22:15:08.759+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:asset_s3_bucket_consumer_with_no_taskflow
[2025-01-09T22:15:08.761+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:asset_s3_bucket_consumer_with_no_taskflow
[2025-01-09T22:15:08.764+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:asset_s3_bucket_consumer_with_no_taskflow
[2025-01-09T22:15:08.767+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:asset_s3_bucket_consumer_with_no_taskflow
[2025-01-09T22:15:08.772+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:asset_s3_bucket_producer_with_no_taskflow
[2025-01-09T22:15:08.775+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:asset_s3_bucket_producer_with_no_taskflow
[2025-01-09T22:15:08.777+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:asset_s3_bucket_producer_with_no_taskflow
[2025-01-09T22:15:08.780+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:asset_s3_bucket_producer_with_no_taskflow
[2025-01-09T22:15:08.783+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:asset_s3_bucket_producer_with_no_taskflow
[2025-01-09T22:15:08.786+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:asset_s3_bucket_producer_with_no_taskflow
[2025-01-09T22:15:08.788+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:asset_s3_bucket_producer_with_no_taskflow
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_asset_alias.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_asset_alias.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_alias_example_alias_consumer> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_s3_bucket_consumer> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_s3_bucket_producer> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: asset_alias_example_alias_producer> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_asset_alias.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_alias_example_alias_consumer","timezone":"UTC","tags":["asset-alias","consumer"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_asset_alias.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset_alias","name":"example-alias","group":"asset"}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_asset_event_from_asset_alias":["operator","consume_asset_event_from_asset_alias"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"consume_asset_event_from_asset_alias","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"inlets":[{"__var":{"name":"example-alias","group":"asset"},"__type":"asset_alias"}],"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_6c7865804c1b73f37e723141ba6f4f299b634a5f_example_asset_alias.consume_asset_event_from_asset_alias","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset-alias","target":"asset_alias_example_alias_consumer","dependency_type":"asset-alias","dependency_id":"example-alias"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_s3_bucket_consumer","timezone":"UTC","tags":["asset","consumer"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_asset_alias.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://bucket/my-task","uri":"s3://bucket/my-task","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_asset_event":["operator","consume_asset_event"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"consume_asset_event","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_6c7865804c1b73f37e723141ba6f4f299b634a5f_example_asset_alias.consume_asset_event","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_s3_bucket_consumer","dependency_type":"asset","dependency_id":"s3://bucket/my-task"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_s3_bucket_producer","timezone":"UTC","tags":["asset","producer"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_asset_alias.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"produce_asset_events":["operator","produce_asset_events"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"produce_asset_events","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://bucket/my-task","uri":"s3://bucket/my-task","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_6c7865804c1b73f37e723141ba6f4f299b634a5f_example_asset_alias.produce_asset_events","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset_s3_bucket_producer","target":"asset","dependency_type":"asset","dependency_id":"s3://bucket/my-task"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_alias_example_alias_producer","timezone":"UTC","tags":["asset-alias","producer"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_asset_alias.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"produce_asset_events_through_asset_alias":["operator","produce_asset_events_through_asset_alias"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"produce_asset_events_through_asset_alias","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"example-alias","group":"asset"},"__type":"asset_alias"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_6c7865804c1b73f37e723141ba6f4f299b634a5f_example_asset_alias.produce_asset_events_through_asset_alias","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset_alias_example_alias_producer","target":"asset-alias","dependency_type":"asset-alias","dependency_id":"example-alias"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:08.815+0000] {dag.py:1861} INFO - Sync 4 DAGs
[2025-01-09T22:15:08.818+0000] {collection.py:85} INFO - Creating ORM DAG for asset_alias_example_alias_consumer
[2025-01-09T22:15:08.818+0000] {collection.py:85} INFO - Creating ORM DAG for asset_s3_bucket_consumer
[2025-01-09T22:15:08.818+0000] {collection.py:85} INFO - Creating ORM DAG for asset_s3_bucket_producer
[2025-01-09T22:15:08.818+0000] {collection.py:85} INFO - Creating ORM DAG for asset_alias_example_alias_producer
[2025-01-09T22:15:08.822+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_alias_example_alias_consumer to None, run_after=None
[2025-01-09T22:15:08.823+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_alias_example_alias_producer to None, run_after=None
[2025-01-09T22:15:08.824+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_s3_bucket_consumer to None, run_after=None
[2025-01-09T22:15:08.825+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_s3_bucket_producer to None, run_after=None
[2025-01-09T22:15:08.847+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:asset_alias_example_alias_consumer
[2025-01-09T22:15:08.851+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:asset_alias_example_alias_consumer
[2025-01-09T22:15:08.854+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:asset_alias_example_alias_consumer
[2025-01-09T22:15:08.857+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:asset_alias_example_alias_consumer
[2025-01-09T22:15:08.860+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:asset_alias_example_alias_consumer
[2025-01-09T22:15:08.863+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:asset_alias_example_alias_consumer
[2025-01-09T22:15:08.866+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:asset_alias_example_alias_consumer
[2025-01-09T22:15:08.872+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:asset_s3_bucket_consumer
[2025-01-09T22:15:08.875+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:asset_s3_bucket_consumer
[2025-01-09T22:15:08.878+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:asset_s3_bucket_consumer
[2025-01-09T22:15:08.882+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:asset_s3_bucket_consumer
[2025-01-09T22:15:08.885+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:asset_s3_bucket_consumer
[2025-01-09T22:15:08.887+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:asset_s3_bucket_consumer
[2025-01-09T22:15:08.890+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:asset_s3_bucket_consumer
[2025-01-09T22:15:08.895+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:asset_s3_bucket_producer
[2025-01-09T22:15:08.898+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:asset_s3_bucket_producer
[2025-01-09T22:15:08.901+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:asset_s3_bucket_producer
[2025-01-09T22:15:08.903+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:asset_s3_bucket_producer
[2025-01-09T22:15:08.906+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:asset_s3_bucket_producer
[2025-01-09T22:15:08.908+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:asset_s3_bucket_producer
[2025-01-09T22:15:08.910+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:asset_s3_bucket_producer
[2025-01-09T22:15:08.915+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:asset_alias_example_alias_producer
[2025-01-09T22:15:08.917+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:asset_alias_example_alias_producer
[2025-01-09T22:15:08.920+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:asset_alias_example_alias_producer
[2025-01-09T22:15:08.922+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:asset_alias_example_alias_producer
[2025-01-09T22:15:08.925+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:asset_alias_example_alias_producer
[2025-01-09T22:15:08.927+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:asset_alias_example_alias_producer
[2025-01-09T22:15:08.930+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:asset_alias_example_alias_producer
2025-01-09 22:15:08 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/tutorial_taskflow_templates.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Importing /opt/airflow/airflow/example_dags/tutorial_taskflow_templates.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Loaded DAG <DAG: tutorial_taskflow_templates> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:08 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/tutorial_taskflow_templates.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"tutorial_taskflow_templates","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/tutorial_taskflow_templates.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"doc_md":"\n ### TaskFlow API Tutorial Documentation\n This is a simple data pipeline example which demonstrates the use of\n the templates in the TaskFlow API.\n Documentation that goes along with the Airflow TaskFlow API tutorial is\n located\n [here](https://airflow.apache.org/docs/apache-airflow/stable/tutorial_taskflow_api.html)\n ","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"template_test":["operator","template_test"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[".sql"],"task_id":"template_test","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"params":[["foobar",{"__class":"airflow.models.param.Param","default":"param_from_task","description":null,"schema":{"__var":{},"__type":"dict"}}],["other_param",{"__class":"airflow.models.param.Param","default":"from_dag","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_77edc6d3de61dbce01a5d817f8e5b9d90a49152a_tutorial_taskflow_templates.template_test","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"sql":"sql/test.sql","test_var":"{{ run_id }}"}},"__type":"operator"}],"dag_dependencies":[],"params":[["foobar",{"__class":"airflow.models.param.Param","default":"param_from_dag","description":null,"schema":{"__var":{},"__type":"dict"}}],["other_param",{"__class":"airflow.models.param.Param","default":"from_dag","description":null,"schema":{"__var":{},"__type":"dict"}}]]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:08.951+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:08.953+0000] {collection.py:85} INFO - Creating ORM DAG for tutorial_taskflow_templates
[2025-01-09T22:15:08.959+0000] {dag.py:2418} INFO - Setting next_dagrun for tutorial_taskflow_templates to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:08.974+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:tutorial_taskflow_templates
[2025-01-09T22:15:08.977+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:tutorial_taskflow_templates
[2025-01-09T22:15:08.980+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:tutorial_taskflow_templates
[2025-01-09T22:15:08.984+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:tutorial_taskflow_templates
[2025-01-09T22:15:08.987+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:tutorial_taskflow_templates
[2025-01-09T22:15:08.990+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:tutorial_taskflow_templates
[2025-01-09T22:15:08.993+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:tutorial_taskflow_templates
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/tutorial_taskflow_api_virtualenv.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/tutorial_taskflow_api_virtualenv.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: tutorial_taskflow_api_virtualenv> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/tutorial_taskflow_api_virtualenv.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"tutorial_taskflow_api_virtualenv","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/tutorial_taskflow_api_virtualenv.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"\n ### TaskFlow API example using virtualenv\n This is a simple data pipeline example which demonstrates the use of\n the TaskFlow API using three simple tasks for Extract, Transform, and Load.\n ","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"extract":["operator","extract"],"transform":["operator","transform"],"load":["operator","load"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonVirtualenvDecoratedOperator","template_ext":[".txt"],"task_id":"extract","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Extract task\n A simple Extract task to get data ready for the rest of the data\n pipeline. In this case, getting data is simulated by reading from a\n hardcoded JSON string.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["transform"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_5c610e1eebb549778d73fad8c18ac2edffc9322f_tutorial_taskflow_api_virtualenv.extract","_task_module":"airflow.decorators.python_virtualenv","_operator_name":"@task.virtualenv","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"requirements":["funcsigs"]},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"multiple_outputs":true,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"transform","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Transform task\n A simple Transform task which takes in the collection of order data and\n computes the total order value.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["load"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_5c610e1eebb549778d73fad8c18ac2edffc9322f_tutorial_taskflow_api_virtualenv.transform","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonVirtualenvDecoratedOperator): extract>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"load","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Load task\n A simple Load task which takes in the result of the Transform task and\n instead of saving it to end user review, just prints it out.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_5c610e1eebb549778d73fad8c18ac2edffc9322f_tutorial_taskflow_api_virtualenv.load","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): transform>, 'total_order_value'),)","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:09.025+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.028+0000] {collection.py:85} INFO - Creating ORM DAG for tutorial_taskflow_api_virtualenv
[2025-01-09T22:15:09.030+0000] {dag.py:2418} INFO - Setting next_dagrun for tutorial_taskflow_api_virtualenv to None, run_after=None
[2025-01-09T22:15:09.043+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:tutorial_taskflow_api_virtualenv
[2025-01-09T22:15:09.047+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:tutorial_taskflow_api_virtualenv
[2025-01-09T22:15:09.051+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:tutorial_taskflow_api_virtualenv
[2025-01-09T22:15:09.057+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:tutorial_taskflow_api_virtualenv
[2025-01-09T22:15:09.061+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:tutorial_taskflow_api_virtualenv
[2025-01-09T22:15:09.065+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:tutorial_taskflow_api_virtualenv
[2025-01-09T22:15:09.070+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:tutorial_taskflow_api_virtualenv
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/tutorial_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/tutorial_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: tutorial_dag> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/tutorial_dag.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"tutorial_dag","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/tutorial_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"\n### DAG Tutorial Documentation\nThis DAG is demonstrating an Extract -> Transform -> Load pipeline\n","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"extract":["operator","extract"],"transform":["operator","transform"],"load":["operator","load"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"default_args":{"__var":{"retries":2},"__type":"dict"},"description":"DAG tutorial","_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"extract","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"#### Extract task\nA simple Extract task to get data ready for the rest of the data pipeline.\nIn this case, getting data is simulated by reading from a hardcoded JSON string.\nThis data is then put into xcom, so that it can be processed by the next task.\n","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["transform"],"retries":2,"weight_rule":"downstream","python_callable_name":"unusual_prefix_2c75fd4b99a28dd28436ec2a866c9fac92aa38b9_tutorial_dag.extract","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"transform","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"#### Transform task\nA simple Transform task which takes in the collection of order data from xcom\nand computes the total order value.\nThis computed value is then put into xcom, so that it can be processed by the next task.\n","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["load"],"retries":2,"weight_rule":"downstream","python_callable_name":"unusual_prefix_2c75fd4b99a28dd28436ec2a866c9fac92aa38b9_tutorial_dag.transform","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"load","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"#### Load task\nA simple Load task which takes in the result of the Transform task, by reading it\nfrom xcom and instead of saving it to end user review, just prints it out.\n","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"retries":2,"weight_rule":"downstream","python_callable_name":"unusual_prefix_2c75fd4b99a28dd28436ec2a866c9fac92aa38b9_tutorial_dag.load","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:09.105+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.107+0000] {collection.py:85} INFO - Creating ORM DAG for tutorial_dag
[2025-01-09T22:15:09.110+0000] {dag.py:2418} INFO - Setting next_dagrun for tutorial_dag to None, run_after=None
[2025-01-09T22:15:09.124+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:tutorial_dag
[2025-01-09T22:15:09.128+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:tutorial_dag
[2025-01-09T22:15:09.131+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:tutorial_dag
[2025-01-09T22:15:09.133+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:tutorial_dag
[2025-01-09T22:15:09.137+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:tutorial_dag
[2025-01-09T22:15:09.140+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:tutorial_dag
[2025-01-09T22:15:09.143+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:tutorial_dag
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/tutorial.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/tutorial.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: tutorial> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/tutorial.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"tutorial","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/tutorial.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.DeltaDataIntervalTimetable","__var":{"delta":86400.0}},"doc_md":"\n This is a documentation placed anywhere\n ","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"print_date":["operator","print_date"],"sleep":["operator","sleep"],"templated":["operator","templated"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"default_args":{"__var":{"depends_on_past":false,"email":["[email protected]"],"email_on_failure":false,"email_on_retry":false,"retries":1,"retry_delay":{"__var":300.0,"__type":"timedelta"}},"__type":"dict"},"description":"A simple tutorial DAG","_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"print_date","template_fields_renderers":{"bash_command":"bash","env":"json"},"email":["[email protected]"],"doc_md":"#### Task Documentation\nYou can document your task using the attributes `doc_md` (markdown),\n`doc` (plain text), `doc_rst`, `doc_json`, `doc_yaml` which gets\nrendered in the UI's Task Instance Details page.\n![img](https://imgs.xkcd.com/comics/fixing_problems.png)\n**Image Credit:** Randall Munroe, [XKCD](https://xkcd.com/license.html)\n","is_setup":false,"email_on_retry":false,"on_failure_fail_dagrun":false,"pool":"default_pool","retry_delay":300.0,"template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["sleep","templated"],"retries":1,"weight_rule":"downstream","email_on_failure":false,"_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"date"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"sleep","template_fields_renderers":{"bash_command":"bash","env":"json"},"email":["[email protected]"],"is_setup":false,"email_on_retry":false,"on_failure_fail_dagrun":false,"pool":"default_pool","retry_delay":300.0,"template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"retries":3,"weight_rule":"downstream","email_on_failure":false,"_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"templated","template_fields_renderers":{"bash_command":"bash","env":"json"},"email":["[email protected]"],"is_setup":false,"email_on_retry":false,"on_failure_fail_dagrun":false,"pool":"default_pool","retry_delay":300.0,"template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"retries":1,"weight_rule":"downstream","email_on_failure":false,"_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"\n{% for i in range(5) %}\n echo \"{{ ds }}\"\n echo \"{{ macros.ds_add(ds, 7)}}\"\n{% endfor %}\n"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:09.165+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.167+0000] {collection.py:85} INFO - Creating ORM DAG for tutorial
[2025-01-09T22:15:09.171+0000] {dag.py:2418} INFO - Setting next_dagrun for tutorial to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:09.185+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:tutorial
[2025-01-09T22:15:09.188+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:tutorial
[2025-01-09T22:15:09.191+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:tutorial
[2025-01-09T22:15:09.194+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:tutorial
[2025-01-09T22:15:09.197+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:tutorial
[2025-01-09T22:15:09.199+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:tutorial
[2025-01-09T22:15:09.202+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:tutorial
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/plugins/event_listener.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/plugins/event_listener.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/plugins/event_listener.py","serialized_dags":[],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_xcomargs.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_xcomargs.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_xcom.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_xcom.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_xcom_args_with_operators> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_xcom_args> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_xcomargs.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_xcom_args_with_operators","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_xcomargs.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"c":["operator","c"],"d":["operator","d"],"print_value":["operator","print_value"],"print_value__1":["operator","print_value__1"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"c","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["print_value"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo c"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"d","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo c"},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"print_value","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty function","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["print_value__1"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_60b7fdcc78a1b8f10bed0db69375b340f14060b2_example_xcomargs.print_value","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"('first!',)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"print_value__1","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty function","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["d"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_60b7fdcc78a1b8f10bed0db69375b340f14060b2_example_xcomargs.print_value","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"('second!',)","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_xcom_args","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_xcomargs.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"generate_value":["operator","generate_value"],"print_value":["operator","print_value"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"generate_value","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty function","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["print_value"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_60b7fdcc78a1b8f10bed0db69375b340f14060b2_example_xcomargs.generate_value","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"print_value","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty function","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_60b7fdcc78a1b8f10bed0db69375b340f14060b2_example_xcomargs.print_value","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): generate_value>),)","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:09.292+0000] {dag.py:1861} INFO - Sync 2 DAGs
[2025-01-09T22:15:09.295+0000] {collection.py:85} INFO - Creating ORM DAG for example_xcom_args_with_operators
[2025-01-09T22:15:09.295+0000] {collection.py:85} INFO - Creating ORM DAG for example_xcom_args
[2025-01-09T22:15:09.296+0000] {dag.py:2418} INFO - Setting next_dagrun for example_xcom_args to None, run_after=None
[2025-01-09T22:15:09.298+0000] {dag.py:2418} INFO - Setting next_dagrun for example_xcom_args_with_operators to None, run_after=None
[2025-01-09T22:15:09.310+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_xcom_args_with_operators
[2025-01-09T22:15:09.313+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_xcom_args_with_operators
[2025-01-09T22:15:09.316+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_xcom_args_with_operators
[2025-01-09T22:15:09.319+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_xcom_args_with_operators
[2025-01-09T22:15:09.322+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_xcom_args_with_operators
[2025-01-09T22:15:09.324+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_xcom_args_with_operators
[2025-01-09T22:15:09.327+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_xcom_args_with_operators
[2025-01-09T22:15:09.332+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_xcom_args
[2025-01-09T22:15:09.335+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_xcom_args
[2025-01-09T22:15:09.337+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_xcom_args
[2025-01-09T22:15:09.340+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_xcom_args
[2025-01-09T22:15:09.342+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_xcom_args
[2025-01-09T22:15:09.345+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_xcom_args
[2025-01-09T22:15:09.347+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_xcom_args
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_xcom> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_xcom.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_xcom","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_xcom.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.OnceTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"bash_push":["operator","bash_push"],"bash_pull":["operator","bash_pull"],"pull_value_from_bash_push":["operator","pull_value_from_bash_push"],"push_by_returning":["operator","push_by_returning"],"puller":["operator","puller"],"push":["operator","push"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"bash_push","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["bash_pull","pull_value_from_bash_push"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo \"bash_push demo\" && echo \"Manually set xcom value {{ ti.xcom_push(key=\"manually_pushed_value\", value=\"manually_pushed_value\") }}\" && echo \"value_by_return\""},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"bash_pull","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"do_xcom_push":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo \"bash pull demo\" && echo \"The xcom pushed manually is {{ task_instance.xcom_pull(task_ids='bash_push', dag_id='example_xcom', key='manually_pushed_value') }}\" && echo \"The returned_value xcom is {{ task_instance.xcom_pull(task_ids='bash_push', dag_id='example_xcom', key='return_value') }}\" && echo \"finished\""},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"pull_value_from_bash_push","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_19ce7b53b36c0a5900129798637a23dcfc7ec40c_example_xcom.pull_value_from_bash_push","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"push_by_returning","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Pushes an XCom without a specific target, just by returning it","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["puller"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_19ce7b53b36c0a5900129798637a23dcfc7ec40c_example_xcom.push_by_returning","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"puller","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Pull all previously pushed XComs and check if the pushed values match the pulled values.","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_19ce7b53b36c0a5900129798637a23dcfc7ec40c_example_xcom.puller","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): push_by_returning>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"push","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Pushes an XCom without a specific target","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["puller"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_19ce7b53b36c0a5900129798637a23dcfc7ec40c_example_xcom.push","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:09.372+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.375+0000] {collection.py:85} INFO - Creating ORM DAG for example_xcom
[2025-01-09T22:15:09.380+0000] {dag.py:2418} INFO - Setting next_dagrun for example_xcom to 2021-01-01 00:00:00+00:00, run_after=2021-01-01 00:00:00+00:00
[2025-01-09T22:15:09.392+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_xcom
[2025-01-09T22:15:09.395+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_xcom
[2025-01-09T22:15:09.398+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_xcom
[2025-01-09T22:15:09.401+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_xcom
[2025-01-09T22:15:09.404+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_xcom
[2025-01-09T22:15:09.407+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_xcom
[2025-01-09T22:15:09.410+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_xcom
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_trigger_target_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_trigger_target_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_trigger_target_dag> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_trigger_target_dag.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_trigger_target_dag","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_trigger_target_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"run_this":["operator","run_this"],"bash_task":["operator","bash_task"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"run_this","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n Print the payload \"message\" passed to the DagRun conf attribute.\n\n :param dag_run: The DagRun object\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_e92e3af13243acb634f70a737385283b58013310_example_trigger_target_dag.run_this_func","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"bash_task","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo \"Here is the message: $message\"","env":{"message":"{{ dag_run.conf.get(\"message\") }}"}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:09.433+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.436+0000] {collection.py:85} INFO - Creating ORM DAG for example_trigger_target_dag
[2025-01-09T22:15:09.437+0000] {dag.py:2418} INFO - Setting next_dagrun for example_trigger_target_dag to None, run_after=None
[2025-01-09T22:15:09.449+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_trigger_target_dag
[2025-01-09T22:15:09.452+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_trigger_target_dag
[2025-01-09T22:15:09.454+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_trigger_target_dag
[2025-01-09T22:15:09.457+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_trigger_target_dag
[2025-01-09T22:15:09.460+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_trigger_target_dag
[2025-01-09T22:15:09.463+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_trigger_target_dag
[2025-01-09T22:15:09.467+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_trigger_target_dag
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_time_delta_sensor_async.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_time_delta_sensor_async.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_time_delta_sensor_async> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_time_delta_sensor_async.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_time_delta_sensor_async","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_time_delta_sensor_async.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"wait":["operator","wait"],"finish":["operator","finish"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeDeltaSensorAsync","template_ext":[],"task_id":"wait","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["finish"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time_delta","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"finish","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:09.486+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.489+0000] {collection.py:85} INFO - Creating ORM DAG for example_time_delta_sensor_async
[2025-01-09T22:15:09.491+0000] {dag.py:2418} INFO - Setting next_dagrun for example_time_delta_sensor_async to None, run_after=None
[2025-01-09T22:15:09.502+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_time_delta_sensor_async
[2025-01-09T22:15:09.505+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_time_delta_sensor_async
[2025-01-09T22:15:09.508+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_time_delta_sensor_async
[2025-01-09T22:15:09.511+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_time_delta_sensor_async
[2025-01-09T22:15:09.514+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_time_delta_sensor_async
[2025-01-09T22:15:09.516+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_time_delta_sensor_async
[2025-01-09T22:15:09.519+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_time_delta_sensor_async
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_task_group.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_task_group.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_task_group> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_task_group.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_task_group","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_task_group.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"start":["operator","start"],"section_1":["taskgroup",{"_group_id":"section_1","group_display_name":"","prefix_group_id":true,"tooltip":"Tasks for section_1","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"section_1.task_1":["operator","section_1.task_1"],"section_1.task_2":["operator","section_1.task_2"],"section_1.task_3":["operator","section_1.task_3"]},"upstream_group_ids":[],"downstream_group_ids":["section_2"],"upstream_task_ids":["start"],"downstream_task_ids":[]}],"section_2":["taskgroup",{"_group_id":"section_2","group_display_name":"","prefix_group_id":true,"tooltip":"Tasks for section_2","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"section_2.task_1":["operator","section_2.task_1"],"section_2.inner_section_2":["taskgroup",{"_group_id":"inner_section_2","group_display_name":"","prefix_group_id":true,"tooltip":"Tasks for inner_section2","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"section_2.inner_section_2.task_2":["operator","section_2.inner_section_2.task_2"],"section_2.inner_section_2.task_3":["operator","section_2.inner_section_2.task_3"],"section_2.inner_section_2.task_4":["operator","section_2.inner_section_2.task_4"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]}]},"upstream_group_ids":["section_1"],"downstream_group_ids":[],"upstream_task_ids":["section_1.task_2","section_1.task_3"],"downstream_task_ids":["end"]}],"end":["operator","end"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"start","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["section_1.task_1"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"section_1.task_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["section_1.task_2","section_1.task_3"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"section_1.task_2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["section_2.inner_section_2.task_2","section_2.inner_section_2.task_3","section_2.task_1"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo 1"},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"section_1.task_3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["section_2.inner_section_2.task_2","section_2.inner_section_2.task_3","section_2.task_1"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"section_2.task_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["end"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"section_2.inner_section_2.task_2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["section_2.inner_section_2.task_4"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo 1"},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"section_2.inner_section_2.task_3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["section_2.inner_section_2.task_4"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"section_2.inner_section_2.task_4","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["end"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"end","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:09.546+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.549+0000] {collection.py:85} INFO - Creating ORM DAG for example_task_group
[2025-01-09T22:15:09.552+0000] {dag.py:2418} INFO - Setting next_dagrun for example_task_group to None, run_after=None
[2025-01-09T22:15:09.564+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_task_group
[2025-01-09T22:15:09.568+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_task_group
[2025-01-09T22:15:09.571+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_task_group
[2025-01-09T22:15:09.575+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_task_group
[2025-01-09T22:15:09.578+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_task_group
[2025-01-09T22:15:09.581+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_task_group
[2025-01-09T22:15:09.584+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_task_group
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_short_circuit_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_short_circuit_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_short_circuit_operator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_short_circuit_operator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_short_circuit_operator","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_short_circuit_operator.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"condition_is_True":["operator","condition_is_True"],"condition_is_False":["operator","condition_is_False"],"true_1":["operator","true_1"],"true_2":["operator","true_2"],"false_1":["operator","false_1"],"false_2":["operator","false_2"],"task_1":["operator","task_1"],"task_2":["operator","task_2"],"task_3":["operator","task_3"],"task_4":["operator","task_4"],"task_5":["operator","task_5"],"task_6":["operator","task_6"],"task_7":["operator","task_7"],"short_circuit":["operator","short_circuit"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ShortCircuitOperator","template_ext":[],"task_id":"condition_is_True","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["true_1"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c838387874578793963b1bc24492ceeea35f44ce_example_short_circuit_operator.<lambda>","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ShortCircuitOperator","template_ext":[],"task_id":"condition_is_False","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["false_1"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c838387874578793963b1bc24492ceeea35f44ce_example_short_circuit_operator.<lambda>","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"true_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["true_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"true_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"false_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["false_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"false_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["short_circuit","task_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_3"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_5"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_4","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_6"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_5","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_7"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_6","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_7"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_7","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"all_done","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ShortCircuitOperator","template_ext":[],"task_id":"short_circuit","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_4"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c838387874578793963b1bc24492ceeea35f44ce_example_short_circuit_operator.<lambda>","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:09.610+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.612+0000] {collection.py:85} INFO - Creating ORM DAG for example_short_circuit_operator
[2025-01-09T22:15:09.616+0000] {dag.py:2418} INFO - Setting next_dagrun for example_short_circuit_operator to None, run_after=None
[2025-01-09T22:15:09.628+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_short_circuit_operator
[2025-01-09T22:15:09.632+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_short_circuit_operator
[2025-01-09T22:15:09.635+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_short_circuit_operator
[2025-01-09T22:15:09.638+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_short_circuit_operator
[2025-01-09T22:15:09.640+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_short_circuit_operator
[2025-01-09T22:15:09.643+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_short_circuit_operator
[2025-01-09T22:15:09.646+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_short_circuit_operator
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_setup_teardown.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_setup_teardown.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_setup_teardown> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_setup_teardown.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_setup_teardown","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_setup_teardown.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"root_setup":["operator","root_setup"],"normal":["operator","normal"],"root_teardown":["operator","root_teardown"],"section_1":["taskgroup",{"_group_id":"section_1","group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"section_1.taskgroup_setup":["operator","section_1.taskgroup_setup"],"section_1.normal":["operator","section_1.normal"],"section_1.taskgroup_teardown":["operator","section_1.taskgroup_teardown"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":["normal"],"downstream_task_ids":[]}]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"root_setup","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":true,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["normal","root_teardown"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo 'Hello from root_setup'"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"normal","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["root_teardown","section_1.taskgroup_setup"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo 'I am just a normal task'"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"root_teardown","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"trigger_rule":"all_done_setup_success","is_teardown":true,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo 'Goodbye from root_teardown'"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"section_1.taskgroup_setup","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":true,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["section_1.normal","section_1.taskgroup_teardown"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo 'Hello from taskgroup_setup'"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"section_1.normal","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["section_1.taskgroup_teardown"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo 'I am just a normal task'"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"section_1.taskgroup_teardown","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"trigger_rule":"all_done_setup_success","is_teardown":true,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo 'Hello from taskgroup_teardown'"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:09.668+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.671+0000] {collection.py:85} INFO - Creating ORM DAG for example_setup_teardown
[2025-01-09T22:15:09.673+0000] {dag.py:2418} INFO - Setting next_dagrun for example_setup_teardown to None, run_after=None
[2025-01-09T22:15:09.685+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_setup_teardown
[2025-01-09T22:15:09.688+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_setup_teardown
[2025-01-09T22:15:09.691+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_setup_teardown
[2025-01-09T22:15:09.693+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_setup_teardown
[2025-01-09T22:15:09.695+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_setup_teardown
[2025-01-09T22:15:09.698+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_setup_teardown
[2025-01-09T22:15:09.701+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_setup_teardown
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_python_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_python_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_python_operator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_python_operator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_python_operator","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_python_operator.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"print_the_context":["operator","print_the_context"],"log_sql_query":["operator","log_sql_query"],"sleep_for_0":["operator","sleep_for_0"],"sleep_for_1":["operator","sleep_for_1"],"sleep_for_2":["operator","sleep_for_2"],"sleep_for_3":["operator","sleep_for_3"],"sleep_for_4":["operator","sleep_for_4"],"virtualenv_python":["operator","virtualenv_python"],"external_python":["operator","external_python"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"print_the_context","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["external_python","log_sql_query"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_92fed1dd21665d21fcfedc3cb4dbbf615650b700_example_python_operator.print_context","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[".sql"],"task_id":"log_sql_query","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["sleep_for_0","sleep_for_1","sleep_for_2","sleep_for_3","sleep_for_4"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_92fed1dd21665d21fcfedc3cb4dbbf615650b700_example_python_operator.log_sql","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"templates_dict":{"query":"sql/sample.sql"},"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"sleep_for_0","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_92fed1dd21665d21fcfedc3cb4dbbf615650b700_example_python_operator.my_sleeping_function","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"random_base":0.0}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"sleep_for_1","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_92fed1dd21665d21fcfedc3cb4dbbf615650b700_example_python_operator.my_sleeping_function","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"random_base":0.1}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"sleep_for_2","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_92fed1dd21665d21fcfedc3cb4dbbf615650b700_example_python_operator.my_sleeping_function","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"random_base":0.2}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"sleep_for_3","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_92fed1dd21665d21fcfedc3cb4dbbf615650b700_example_python_operator.my_sleeping_function","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"random_base":0.3}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"sleep_for_4","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["virtualenv_python"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_92fed1dd21665d21fcfedc3cb4dbbf615650b700_example_python_operator.my_sleeping_function","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"random_base":0.4}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonVirtualenvOperator","template_ext":[".txt"],"task_id":"virtualenv_python","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_92fed1dd21665d21fcfedc3cb4dbbf615650b700_example_python_operator.callable_virtualenv","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"requirements":["colorama==0.4.0"]},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalPythonOperator","template_ext":[],"task_id":"external_python","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["virtualenv_python"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_92fed1dd21665d21fcfedc3cb4dbbf615650b700_example_python_operator.callable_external_python","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:09.727+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.730+0000] {collection.py:85} INFO - Creating ORM DAG for example_python_operator
[2025-01-09T22:15:09.732+0000] {dag.py:2418} INFO - Setting next_dagrun for example_python_operator to None, run_after=None
[2025-01-09T22:15:09.745+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_python_operator
[2025-01-09T22:15:09.748+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_python_operator
[2025-01-09T22:15:09.751+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_python_operator
[2025-01-09T22:15:09.754+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_python_operator
[2025-01-09T22:15:09.757+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_python_operator
[2025-01-09T22:15:09.760+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_python_operator
[2025-01-09T22:15:09.763+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_python_operator
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_python_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_python_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_python_decorator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_python_decorator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_python_decorator","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_python_decorator.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"print_the_context":["operator","print_the_context"],"log_sql_query":["operator","log_sql_query"],"sleep_for_0":["operator","sleep_for_0"],"sleep_for_1":["operator","sleep_for_1"],"sleep_for_2":["operator","sleep_for_2"],"sleep_for_3":["operator","sleep_for_3"],"sleep_for_4":["operator","sleep_for_4"],"virtualenv_python":["operator","virtualenv_python"],"external_python":["operator","external_python"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"print_the_context","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Print the Airflow context and ds variable from the context.","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["external_python","log_sql_query"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_9dd7b64c0d6f4491240e3ecaf812fed449da30d4_example_python_decorator.print_context","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[".sql"],"task_id":"log_sql_query","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["sleep_for_0","sleep_for_1","sleep_for_2","sleep_for_3","sleep_for_4"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_9dd7b64c0d6f4491240e3ecaf812fed449da30d4_example_python_decorator.log_sql","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"templates_dict":{"query":"sql/sample.sql"},"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"sleep_for_0","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"This is a function that will run within the DAG execution","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_9dd7b64c0d6f4491240e3ecaf812fed449da30d4_example_python_decorator.my_sleeping_function","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"random_base":0.0}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"sleep_for_1","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"This is a function that will run within the DAG execution","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_9dd7b64c0d6f4491240e3ecaf812fed449da30d4_example_python_decorator.my_sleeping_function","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"random_base":0.1}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"sleep_for_2","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"This is a function that will run within the DAG execution","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_9dd7b64c0d6f4491240e3ecaf812fed449da30d4_example_python_decorator.my_sleeping_function","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"random_base":0.2}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"sleep_for_3","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"This is a function that will run within the DAG execution","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_9dd7b64c0d6f4491240e3ecaf812fed449da30d4_example_python_decorator.my_sleeping_function","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"random_base":0.3}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"sleep_for_4","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"This is a function that will run within the DAG execution","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["virtualenv_python"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_9dd7b64c0d6f4491240e3ecaf812fed449da30d4_example_python_decorator.my_sleeping_function","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"random_base":0.4}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonVirtualenvDecoratedOperator","template_ext":[".txt"],"task_id":"virtualenv_python","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n Example function that will be performed in a virtual environment.\n\n Importing at the module level ensures that it will not attempt to import the\n library before it is installed.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_9dd7b64c0d6f4491240e3ecaf812fed449da30d4_example_python_decorator.callable_virtualenv","_task_module":"airflow.decorators.python_virtualenv","_operator_name":"@task.virtualenv","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"requirements":["colorama==0.4.0"]},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonExternalDecoratedOperator","template_ext":[],"task_id":"external_python","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n Example function that will be performed in a virtual environment.\n\n Importing at the module level ensures that it will not attempt to import the\n library before it is installed.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["virtualenv_python"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_9dd7b64c0d6f4491240e3ecaf812fed449da30d4_example_python_decorator.callable_external_python","_task_module":"airflow.decorators.external_python","_operator_name":"@task.external_python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:09.796+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:09.798+0000] {collection.py:85} INFO - Creating ORM DAG for example_python_decorator
[2025-01-09T22:15:09.801+0000] {dag.py:2418} INFO - Setting next_dagrun for example_python_decorator to None, run_after=None
[2025-01-09T22:15:09.815+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_python_decorator
[2025-01-09T22:15:09.817+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_python_decorator
[2025-01-09T22:15:09.820+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_python_decorator
[2025-01-09T22:15:09.823+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_python_decorator
[2025-01-09T22:15:09.826+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_python_decorator
[2025-01-09T22:15:09.829+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_python_decorator
[2025-01-09T22:15:09.832+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_python_decorator
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_python_context_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_python_context_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [error ] Failed to import: /opt/airflow/airflow/example_dags/example_python_context_operator.py [airflow.models.dagbag.DagBag] [task] error_detail=[{'exc_type': 'AirflowException', 'exc_value': 'The `use_airflow_context=True` is not yet implemented. It will work in Airflow 3 after AIP-72 context serialization is ready.', 'syntax_error': None, 'is_cause': False, 'frames': [{'filename': '/opt/airflow/airflow/models/dagbag.py', 'lineno': 384, 'name': 'parse'}, {'filename': '<frozen importlib._bootstrap_external>', 'lineno': 850, 'name': 'exec_module'}, {'filename': '<frozen importlib._bootstrap>', 'lineno': 228, 'name': '_call_with_frames_removed'}, {'filename': '/opt/airflow/airflow/example_dags/example_python_context_operator.py', 'lineno': 87, 'name': '<module>'}, {'filename': '/opt/airflow/task_sdk/src/airflow/sdk/definitions/baseoperator.py', 'lineno': 198, 'name': 'apply_defaults'}, {'filename': '/opt/airflow/providers/src/airflow/providers/standard/operators/python.py', 'lineno': 987, 'name': '__init__'}]}]
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_python_context_operator.py","serialized_dags":[],"warnings":[],"import_errors":{"/opt/airflow/airflow/example_dags/example_python_context_operator.py":"Traceback (most recent call last):\n File \"/opt/airflow/task_sdk/src/airflow/sdk/definitions/baseoperator.py\", line 198, in apply_defaults\n result = func(self, **kwargs, default_args=default_args)\n File \"/opt/airflow/providers/src/airflow/providers/standard/operators/python.py\", line 987, in __init__\n raise AirflowException(\nairflow.exceptions.AirflowException: The `use_airflow_context=True` is not yet implemented. It will work in Airflow 3 after AIP-72 context serialization is ready.\n"},"type":"DagFileParsingResult"}
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_python_context_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_python_context_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [error ] Failed to import: /opt/airflow/airflow/example_dags/example_python_context_decorator.py [airflow.models.dagbag.DagBag] [task] error_detail=[{'exc_type': 'AirflowException', 'exc_value': 'The `use_airflow_context=True` is not yet implemented. It will work in Airflow 3 after AIP-72 context serialization is ready.', 'syntax_error': None, 'is_cause': False, 'frames': [{'filename': '/opt/airflow/airflow/models/dagbag.py', 'lineno': 384, 'name': 'parse'}, {'filename': '<frozen importlib._bootstrap_external>', 'lineno': 850, 'name': 'exec_module'}, {'filename': '<frozen importlib._bootstrap>', 'lineno': 228, 'name': '_call_with_frames_removed'}, {'filename': '/opt/airflow/airflow/example_dags/example_python_context_decorator.py', 'lineno': 92, 'name': '<module>'}, {'filename': '/opt/airflow/task_sdk/src/airflow/sdk/definitions/dag.py', 'lineno': 1107, 'name': 'factory'}, {'filename': '/opt/airflow/airflow/example_dags/example_python_context_decorator.py', 'lineno': 86, 'name': 'example_python_context_decorator'}, {'filename': '/opt/airflow/airflow/decorators/base.py', 'lineno': 372, 'name': '__call__'}, {'filename': '/opt/airflow/task_sdk/src/airflow/sdk/definitions/baseoperator.py', 'lineno': 198, 'name': 'apply_defaults'}, {'filename': '/opt/airflow/airflow/decorators/python.py', 'lineno': 53, 'name': '__init__'}, {'filename': '/opt/airflow/task_sdk/src/airflow/sdk/definitions/baseoperator.py', 'lineno': 198, 'name': 'apply_defaults'}, {'filename': '/opt/airflow/airflow/decorators/base.py', 'lineno': 253, 'name': '__init__'}, {'filename': '/opt/airflow/task_sdk/src/airflow/sdk/definitions/baseoperator.py', 'lineno': 198, 'name': 'apply_defaults'}, {'filename': '/opt/airflow/providers/src/airflow/providers/standard/operators/python.py', 'lineno': 987, 'name': '__init__'}]}]
2025-01-09 22:15:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_python_context_decorator.py","serialized_dags":[],"warnings":[],"import_errors":{"/opt/airflow/airflow/example_dags/example_python_context_decorator.py":"Traceback (most recent call last):\n File \"/opt/airflow/task_sdk/src/airflow/sdk/definitions/baseoperator.py\", line 198, in apply_defaults\n result = func(self, **kwargs, default_args=default_args)\n File \"/opt/airflow/providers/src/airflow/providers/standard/operators/python.py\", line 987, in __init__\n raise AirflowException(\nairflow.exceptions.AirflowException: The `use_airflow_context=True` is not yet implemented. It will work in Airflow 3 after AIP-72 context serialization is ready.\n"},"type":"DagFileParsingResult"}
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_passing_params_via_test_command.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_passing_params_via_test_command.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_passing_params_via_test_command> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_complex.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_complex.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:09 [debug ] Loaded DAG <DAG: example_complex> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_complex.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_complex","timezone":"UTC","tags":["example","example2","example3"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_complex.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"create_entry_group":["operator","create_entry_group"],"create_entry_group_result":["operator","create_entry_group_result"],"create_entry_group_result2":["operator","create_entry_group_result2"],"create_entry_gcs":["operator","create_entry_gcs"],"create_entry_gcs_result":["operator","create_entry_gcs_result"],"create_entry_gcs_result2":["operator","create_entry_gcs_result2"],"create_tag":["operator","create_tag"],"create_tag_result":["operator","create_tag_result"],"create_tag_result2":["operator","create_tag_result2"],"create_tag_template":["operator","create_tag_template"],"create_tag_template_result":["operator","create_tag_template_result"],"create_tag_template_result2":["operator","create_tag_template_result2"],"create_tag_template_field":["operator","create_tag_template_field"],"create_tag_template_field_result":["operator","create_tag_template_field_result"],"create_tag_template_field_result2":["operator","create_tag_template_field_result2"],"delete_entry":["operator","delete_entry"],"delete_entry_group":["operator","delete_entry_group"],"delete_tag":["operator","delete_tag"],"delete_tag_template_field":["operator","delete_tag_template_field"],"delete_tag_template":["operator","delete_tag_template"],"get_entry_group":["operator","get_entry_group"],"get_entry_group_result":["operator","get_entry_group_result"],"get_entry":["operator","get_entry"],"get_entry_result":["operator","get_entry_result"],"get_tag_template":["operator","get_tag_template"],"get_tag_template_result":["operator","get_tag_template_result"],"list_tags":["operator","list_tags"],"list_tags_result":["operator","list_tags_result"],"lookup_entry":["operator","lookup_entry"],"lookup_entry_result":["operator","lookup_entry_result"],"rename_tag_template_field":["operator","rename_tag_template_field"],"search_catalog":["operator","search_catalog"],"search_catalog_result":["operator","search_catalog_result"],"update_entry":["operator","update_entry"],"update_tag":["operator","update_tag"],"update_tag_template":["operator","update_tag_template"],"update_tag_template_field":["operator","update_tag_template_field"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_entry_group","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["create_entry_gcs","create_entry_group_result","create_entry_group_result2","delete_entry_group","get_entry_group","search_catalog"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_entry_group"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_entry_group_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_entry_group_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_entry_group_result2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_entry_group_result2"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_entry_gcs","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["create_entry_gcs_result","create_entry_gcs_result2","create_tag_template","delete_entry","get_entry","lookup_entry","search_catalog","update_entry"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_entry_gcs"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_entry_gcs_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_entry_gcs_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_entry_gcs_result2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_entry_gcs_result2"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_tag","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["create_tag_result","create_tag_result2","delete_tag","list_tags","search_catalog","update_tag"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_tag"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_tag_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_tag_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_tag_result2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_tag_result2"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_tag_template","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["create_tag_template_field","create_tag_template_result","create_tag_template_result2","delete_tag_template_field","get_tag_template","search_catalog","update_tag_template"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_tag_template"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_tag_template_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_tag_template_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_tag_template_result2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_tag_template_result2"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_tag_template_field","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["create_tag","create_tag_template_field_result","create_tag_template_field_result2","delete_tag_template_field","rename_tag_template_field","search_catalog","update_tag_template_field"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_tag_template_field"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_tag_template_field_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_tag_template_field_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_tag_template_field_result2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo create_tag_template_field_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"delete_entry","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo delete_entry"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"delete_entry_group","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_entry"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo delete_entry_group"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"delete_tag","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_tag_template_field"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo delete_tag"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"delete_tag_template_field","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_tag_template"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo delete_tag_template_field"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"delete_tag_template","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_entry_group"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo delete_tag_template"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"get_entry_group","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_entry_group","get_entry_group_result"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo get_entry_group"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"get_entry_group_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo get_entry_group_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"get_entry","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_entry","get_entry_result"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo get_entry"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"get_entry_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo get_entry_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"get_tag_template","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_tag_template","get_tag_template_result"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo get_tag_template"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"get_tag_template_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo get_tag_template_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"list_tags","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_tag","list_tags_result"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo list_tags"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"list_tags_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo list_tags_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"lookup_entry","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_entry","lookup_entry_result"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo lookup_entry"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"lookup_entry_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo lookup_entry_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"rename_tag_template_field","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_tag_template_field"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo rename_tag_template_field"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"search_catalog","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_entry","delete_entry_group","delete_tag","delete_tag_template","delete_tag_template_field","search_catalog_result"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo search_catalog"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"search_catalog_result","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo search_catalog_result"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"update_entry","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_entry"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo update_entry"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"update_tag","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_tag"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo update_tag"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"update_tag_template","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["delete_tag_template"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo update_tag_template"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"update_tag_template_field","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["rename_tag_template_field"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo update_tag_template_field"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:10.023+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:10.025+0000] {collection.py:85} INFO - Creating ORM DAG for example_complex
[2025-01-09T22:15:10.031+0000] {dag.py:2418} INFO - Setting next_dagrun for example_complex to None, run_after=None
[2025-01-09T22:15:10.046+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_complex
[2025-01-09T22:15:10.050+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_complex
[2025-01-09T22:15:10.054+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_complex
[2025-01-09T22:15:10.057+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_complex
[2025-01-09T22:15:10.060+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_complex
[2025-01-09T22:15:10.063+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_complex
[2025-01-09T22:15:10.066+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_complex
2025-01-09 22:15:10 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_passing_params_via_test_command.py","serialized_dags":[{"data":{"__version":1,"dag":{"dagrun_timeout":240.0,"edge_info":{},"dag_id":"example_passing_params_via_test_command","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_passing_params_via_test_command.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"*/1 * * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"run_this":["operator","run_this"],"also_run_this":["operator","also_run_this"],"env_var_test_task":["operator","env_var_test_task"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"run_this","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n Print out the \"foo\" param passed in via\n `airflow tasks test example_passing_params_via_test_command run_this <date>\n -t '{\"foo\":\"bar\"}'`\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["also_run_this"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_6b3c9cd0e8a6b8220f42904038161b4372bf0455_example_passing_params_via_test_command.my_py_command","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"params":{"miff":"agg"}}},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"also_run_this","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"params":[["miff",{"__class":"airflow.models.param.Param","default":"agg","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"\necho \"'foo' was passed in via Airflow CLI Test command with value '$FOO'\"\necho \"'miff' was passed in via BashOperator with value '$MIFF'\"\n","env":{"FOO":"{{ params.foo }}","MIFF":"{{ params.miff }}"}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"env_var_test_task","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n Print out the \"foo\" param passed in via\n `airflow tasks test example_passing_params_via_test_command env_var_test_task <date>\n --env-vars '{\"foo\":\"bar\"}'`\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_6b3c9cd0e8a6b8220f42904038161b4372bf0455_example_passing_params_via_test_command.print_env_vars","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:10 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_branch_operator_decorator.py [airflow.models.dagbag.DagBag] [task]
[2025-01-09T22:15:10.127+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:10.129+0000] {collection.py:85} INFO - Creating ORM DAG for example_passing_params_via_test_command
[2025-01-09T22:15:10.138+0000] {dag.py:2418} INFO - Setting next_dagrun for example_passing_params_via_test_command to 2025-01-09 22:14:00+00:00, run_after=2025-01-09 22:15:00+00:00
[2025-01-09T22:15:10.153+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_passing_params_via_test_command
[2025-01-09T22:15:10.157+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_passing_params_via_test_command
[2025-01-09T22:15:10.160+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_passing_params_via_test_command
[2025-01-09T22:15:10.163+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_passing_params_via_test_command
[2025-01-09T22:15:10.166+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_passing_params_via_test_command
[2025-01-09T22:15:10.169+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_passing_params_via_test_command
[2025-01-09T22:15:10.171+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_passing_params_via_test_command
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:10 [debug ] Importing /opt/airflow/airflow/example_dags/example_branch_operator_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_branch_python_operator_decorator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_branch_operator_decorator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{"branching":{"branch_a":{"label":"a"},"branch_b":{"label":"b"},"branch_c":{"label":"c"},"branch_d":{"label":"d"}},"branching_ext_python":{"ext_py_a":{"label":"a"},"ext_py_b":{"label":"b"},"ext_py_c":{"label":"c"},"ext_py_d":{"label":"d"}},"branching_virtualenv":{"venv_a":{"label":"a"},"venv_b":{"label":"b"},"venv_c":{"label":"c"},"venv_d":{"label":"d"}}},"dag_id":"example_branch_python_operator_decorator","timezone":"UTC","tags":["example","example2"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_branch_operator_decorator.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"run_this_first":["operator","run_this_first"],"branching":["operator","branching"],"join":["operator","join"],"branch_a":["operator","branch_a"],"follow_a":["operator","follow_a"],"branch_b":["operator","branch_b"],"follow_b":["operator","follow_b"],"branch_c":["operator","branch_c"],"follow_c":["operator","follow_c"],"branch_d":["operator","branch_d"],"follow_d":["operator","follow_d"],"branching_ext_python":["operator","branching_ext_python"],"join_ext_py":["operator","join_ext_py"],"ext_py_a":["operator","ext_py_a"],"ext_py_b":["operator","ext_py_b"],"ext_py_c":["operator","ext_py_c"],"ext_py_d":["operator","ext_py_d"],"branching_virtualenv":["operator","branching_virtualenv"],"join_venv":["operator","join_venv"],"venv_a":["operator","venv_a"],"venv_b":["operator","venv_b"],"venv_c":["operator","venv_c"],"venv_d":["operator","venv_d"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"run_this_first","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["branching"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BranchPythonDecoratedOperator","template_ext":[],"task_id":"branching","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["branch_a","branch_b","branch_c","branch_d"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.branching","_task_module":"airflow.decorators.branch_python","_operator_name":"@task.branch","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"choices":["a","b","c","d"]}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"join","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"none_failed_min_one_success","is_teardown":false,"downstream_task_ids":["branching_ext_python"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"branch_a","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["follow_a"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"follow_a","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"branch_b","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["follow_b"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"follow_b","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"branch_c","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["follow_c"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"follow_c","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"branch_d","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["follow_d"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"follow_d","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BranchExternalPythonDecoratedOperator","template_ext":[],"task_id":"branching_ext_python","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["ext_py_a","ext_py_b","ext_py_c","ext_py_d"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.branching_ext_python","_task_module":"airflow.decorators.branch_external_python","_operator_name":"@task.branch_external_python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{"choices":["a","b","c","d"]}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"join_ext_py","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"none_failed_min_one_success","is_teardown":false,"downstream_task_ids":["branching_virtualenv"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonExternalDecoratedOperator","template_ext":[],"task_id":"ext_py_a","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_ext_py"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_ext_py_task","_task_module":"airflow.decorators.external_python","_operator_name":"@task.external_python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonExternalDecoratedOperator","template_ext":[],"task_id":"ext_py_b","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_ext_py"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_ext_py_task","_task_module":"airflow.decorators.external_python","_operator_name":"@task.external_python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonExternalDecoratedOperator","template_ext":[],"task_id":"ext_py_c","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_ext_py"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_ext_py_task","_task_module":"airflow.decorators.external_python","_operator_name":"@task.external_python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonExternalDecoratedOperator","template_ext":[],"task_id":"ext_py_d","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_ext_py"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_ext_py_task","_task_module":"airflow.decorators.external_python","_operator_name":"@task.external_python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BranchPythonVirtualenvDecoratedOperator","template_ext":[".txt"],"task_id":"branching_virtualenv","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["venv_a","venv_b","venv_c","venv_d"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.branching_virtualenv","_task_module":"airflow.decorators.branch_virtualenv","_operator_name":"@task.branch_virtualenv","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"choices":["a","b","c","d"]},"venv_cache_path":"/tmp","requirements":["numpy~=1.26.0"]},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"join_venv","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"none_failed_min_one_success","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonVirtualenvDecoratedOperator","template_ext":[".txt"],"task_id":"venv_a","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_venv"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_venv_task","_task_module":"airflow.decorators.python_virtualenv","_operator_name":"@task.virtualenv","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"venv_cache_path":"/tmp","requirements":["numpy~=1.26.0"]},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonVirtualenvDecoratedOperator","template_ext":[".txt"],"task_id":"venv_b","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_venv"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_venv_task","_task_module":"airflow.decorators.python_virtualenv","_operator_name":"@task.virtualenv","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"venv_cache_path":"/tmp","requirements":["numpy~=1.26.0"]},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonVirtualenvDecoratedOperator","template_ext":[".txt"],"task_id":"venv_c","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_venv"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_venv_task","_task_module":"airflow.decorators.python_virtualenv","_operator_name":"@task.virtualenv","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"venv_cache_path":"/tmp","requirements":["numpy~=1.26.0"]},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonVirtualenvDecoratedOperator","template_ext":[".txt"],"task_id":"venv_d","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_venv"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4b5eb8bfaf97bf357d84fd6fd451750990e7fd52_example_branch_operator_decorator.some_venv_task","_task_module":"airflow.decorators.python_virtualenv","_operator_name":"@task.virtualenv","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"venv_cache_path":"/tmp","requirements":["numpy~=1.26.0"]},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:10.206+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:10.209+0000] {collection.py:85} INFO - Creating ORM DAG for example_branch_python_operator_decorator
[2025-01-09T22:15:10.218+0000] {dag.py:2418} INFO - Setting next_dagrun for example_branch_python_operator_decorator to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:10.235+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_branch_python_operator_decorator
[2025-01-09T22:15:10.238+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_branch_python_operator_decorator
[2025-01-09T22:15:10.241+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_branch_python_operator_decorator
[2025-01-09T22:15:10.244+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_branch_python_operator_decorator
[2025-01-09T22:15:10.247+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_branch_python_operator_decorator
[2025-01-09T22:15:10.250+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_branch_python_operator_decorator
[2025-01-09T22:15:10.253+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_branch_python_operator_decorator
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:10 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_branch_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Importing /opt/airflow/airflow/example_dags/example_branch_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_branch_operator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_branch_operator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{"branching":{"branch_a":{"label":"a"},"branch_b":{"label":"b"},"branch_c":{"label":"c"},"branch_d":{"label":"d"}},"branching_ext_python":{"ext_py_a":{"label":"a"},"ext_py_b":{"label":"b"},"ext_py_c":{"label":"c"},"ext_py_d":{"label":"d"}},"branching_venv":{"venv_a":{"label":"a"},"venv_b":{"label":"b"},"venv_c":{"label":"c"},"venv_d":{"label":"d"}}},"dag_id":"example_branch_operator","timezone":"UTC","tags":["example","example2"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_branch_operator.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"run_this_first":["operator","run_this_first"],"branching":["operator","branching"],"join":["operator","join"],"branch_a":["operator","branch_a"],"follow_a":["operator","follow_a"],"branch_b":["operator","branch_b"],"follow_b":["operator","follow_b"],"branch_c":["operator","branch_c"],"follow_c":["operator","follow_c"],"branch_d":["operator","branch_d"],"follow_d":["operator","follow_d"],"branching_ext_python":["operator","branching_ext_python"],"join_ext_python":["operator","join_ext_python"],"ext_py_a":["operator","ext_py_a"],"ext_py_b":["operator","ext_py_b"],"ext_py_c":["operator","ext_py_c"],"ext_py_d":["operator","ext_py_d"],"branching_venv":["operator","branching_venv"],"join_venv":["operator","join_venv"],"venv_a":["operator","venv_a"],"venv_b":["operator","venv_b"],"venv_c":["operator","venv_c"],"venv_d":["operator","venv_d"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"run_this_first","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["branching"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BranchPythonOperator","template_ext":[],"task_id":"branching","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["branch_a","branch_b","branch_c","branch_d"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.<lambda>","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"join","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"none_failed_min_one_success","is_teardown":false,"downstream_task_ids":["branching_ext_python"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"branch_a","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["follow_a"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.<lambda>","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"follow_a","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"branch_b","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["follow_b"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.<lambda>","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"follow_b","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"branch_c","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["follow_c"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.<lambda>","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"follow_c","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonOperator","template_ext":[],"task_id":"branch_d","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["follow_d"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.<lambda>","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"follow_d","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BranchExternalPythonOperator","template_ext":[],"task_id":"branching_ext_python","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["ext_py_a","ext_py_b","ext_py_c","ext_py_d"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.branch_with_external_python","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":[["a","b","c","d"]],"python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"join_ext_python","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"none_failed_min_one_success","is_teardown":false,"downstream_task_ids":["branching_venv"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalPythonOperator","template_ext":[],"task_id":"ext_py_a","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_ext_python"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.hello_world_with_external_python","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalPythonOperator","template_ext":[],"task_id":"ext_py_b","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_ext_python"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.hello_world_with_external_python","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalPythonOperator","template_ext":[],"task_id":"ext_py_c","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_ext_python"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.hello_world_with_external_python","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalPythonOperator","template_ext":[],"task_id":"ext_py_d","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","templates_dict","python","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_ext_python"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.hello_world_with_external_python","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","python":"/home/airflow/.local/bin/python","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BranchPythonVirtualenvOperator","template_ext":[".txt"],"task_id":"branching_venv","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["venv_a","venv_b","venv_c","venv_d"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.branch_with_venv","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":[["a","b","c","d"]],"op_kwargs":{},"venv_cache_path":"/tmp","requirements":["numpy~=1.26.0"]},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"join_venv","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"none_failed_min_one_success","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonVirtualenvOperator","template_ext":[".txt"],"task_id":"venv_a","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_venv"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.hello_world_with_venv","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"venv_cache_path":"/tmp","requirements":["numpy~=1.26.0"]},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonVirtualenvOperator","template_ext":[".txt"],"task_id":"venv_b","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_venv"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.hello_world_with_venv","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"venv_cache_path":"/tmp","requirements":["numpy~=1.26.0"]},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonVirtualenvOperator","template_ext":[".txt"],"task_id":"venv_c","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_venv"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.hello_world_with_venv","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"venv_cache_path":"/tmp","requirements":["numpy~=1.26.0"]},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonVirtualenvOperator","template_ext":[".txt"],"task_id":"venv_d","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","venv_cache_path","requirements","templates_dict","index_urls"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_venv"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_c782447e093ff3a33506a2b0c68af0c9bbee743f_example_branch_operator.hello_world_with_venv","_task_module":"airflow.providers.standard.operators.python","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{},"venv_cache_path":"/tmp","requirements":["numpy~=1.26.0"]},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:10.291+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:10.293+0000] {collection.py:85} INFO - Creating ORM DAG for example_branch_operator
[2025-01-09T22:15:10.301+0000] {dag.py:2418} INFO - Setting next_dagrun for example_branch_operator to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:10.319+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_branch_operator
[2025-01-09T22:15:10.323+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_branch_operator
[2025-01-09T22:15:10.327+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_branch_operator
[2025-01-09T22:15:10.330+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_branch_operator
[2025-01-09T22:15:10.333+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_branch_operator
[2025-01-09T22:15:10.364+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_branch_operator
[2025-01-09T22:15:10.395+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_branch_operator
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:10 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_branch_day_of_week_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Importing /opt/airflow/airflow/example_dags/example_branch_day_of_week_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_weekday_branch_operator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_branch_day_of_week_operator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_weekday_branch_operator","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_branch_day_of_week_operator.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"branch_true":["operator","branch_true"],"branch_false":["operator","branch_false"],"branch_weekend":["operator","branch_weekend"],"branch_mid_week":["operator","branch_mid_week"],"make_choice":["operator","make_choice"],"make_weekend_choice":["operator","make_weekend_choice"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"branch_true","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"branch_false","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["make_weekend_choice"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"branch_weekend","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"branch_mid_week","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#fff","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BranchDayOfWeekOperator","template_ext":[],"task_id":"make_choice","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["branch_false","branch_true"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.weekday","_is_empty":false,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#fff","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BranchDayOfWeekOperator","template_ext":[],"task_id":"make_weekend_choice","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["branch_mid_week","branch_weekend"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.weekday","_is_empty":false,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:10.428+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:10.432+0000] {collection.py:85} INFO - Creating ORM DAG for example_weekday_branch_operator
[2025-01-09T22:15:10.439+0000] {dag.py:2418} INFO - Setting next_dagrun for example_weekday_branch_operator to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:10.457+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_weekday_branch_operator
[2025-01-09T22:15:10.462+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_weekday_branch_operator
[2025-01-09T22:15:10.466+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_weekday_branch_operator
[2025-01-09T22:15:10.471+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_weekday_branch_operator
[2025-01-09T22:15:10.474+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_weekday_branch_operator
[2025-01-09T22:15:10.479+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_weekday_branch_operator
[2025-01-09T22:15:10.481+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_weekday_branch_operator
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:10 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_branch_datetime_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Importing /opt/airflow/airflow/example_dags/example_branch_datetime_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_branch_datetime_operator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_branch_datetime_operator_3> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_branch_datetime_operator_2> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_branch_datetime_operator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_branch_datetime_operator","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_branch_datetime_operator.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"date_in_range":["operator","date_in_range"],"date_outside_range":["operator","date_outside_range"],"datetime_branch":["operator","datetime_branch"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"date_in_range","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"date_outside_range","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#fff","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BranchDateTimeOperator","template_ext":[],"task_id":"datetime_branch","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["date_in_range","date_outside_range"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.datetime","_is_empty":false,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_branch_datetime_operator_3","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_branch_datetime_operator.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"date_in_range":["operator","date_in_range"],"date_outside_range":["operator","date_outside_range"],"datetime_branch":["operator","datetime_branch"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"date_in_range","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"date_outside_range","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#fff","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BranchDateTimeOperator","template_ext":[],"task_id":"datetime_branch","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["date_in_range","date_outside_range"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.datetime","_is_empty":false,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_branch_datetime_operator_2","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_branch_datetime_operator.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"date_in_range":["operator","date_in_range"],"date_outside_range":["operator","date_outside_range"],"datetime_branch":["operator","datetime_branch"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"date_in_range","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"date_outside_range","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#fff","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BranchDateTimeOperator","template_ext":[],"task_id":"datetime_branch","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["date_in_range","date_outside_range"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.datetime","_is_empty":false,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:10.516+0000] {dag.py:1861} INFO - Sync 3 DAGs
[2025-01-09T22:15:10.519+0000] {collection.py:85} INFO - Creating ORM DAG for example_branch_datetime_operator
[2025-01-09T22:15:10.519+0000] {collection.py:85} INFO - Creating ORM DAG for example_branch_datetime_operator_3
[2025-01-09T22:15:10.519+0000] {collection.py:85} INFO - Creating ORM DAG for example_branch_datetime_operator_2
[2025-01-09T22:15:10.526+0000] {dag.py:2418} INFO - Setting next_dagrun for example_branch_datetime_operator to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:10.529+0000] {dag.py:2418} INFO - Setting next_dagrun for example_branch_datetime_operator_2 to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:10.531+0000] {dag.py:2418} INFO - Setting next_dagrun for example_branch_datetime_operator_3 to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:10.549+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_branch_datetime_operator
[2025-01-09T22:15:10.553+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_branch_datetime_operator
[2025-01-09T22:15:10.557+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_branch_datetime_operator
[2025-01-09T22:15:10.560+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_branch_datetime_operator
[2025-01-09T22:15:10.564+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_branch_datetime_operator
[2025-01-09T22:15:10.567+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_branch_datetime_operator
[2025-01-09T22:15:10.572+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_branch_datetime_operator
[2025-01-09T22:15:10.579+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_branch_datetime_operator_3
[2025-01-09T22:15:10.583+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_branch_datetime_operator_3
[2025-01-09T22:15:10.587+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_branch_datetime_operator_3
[2025-01-09T22:15:10.590+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_branch_datetime_operator_3
[2025-01-09T22:15:10.593+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_branch_datetime_operator_3
[2025-01-09T22:15:10.596+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_branch_datetime_operator_3
[2025-01-09T22:15:10.601+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_branch_datetime_operator_3
[2025-01-09T22:15:10.610+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_branch_datetime_operator_2
[2025-01-09T22:15:10.614+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_branch_datetime_operator_2
[2025-01-09T22:15:10.617+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_branch_datetime_operator_2
[2025-01-09T22:15:10.621+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_branch_datetime_operator_2
[2025-01-09T22:15:10.626+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_branch_datetime_operator_2
[2025-01-09T22:15:10.630+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_branch_datetime_operator_2
[2025-01-09T22:15:10.634+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_branch_datetime_operator_2
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:10 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_bash_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Importing /opt/airflow/airflow/example_dags/example_bash_operator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_bash_operator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_bash_operator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:10 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:10 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:10 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:10 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:10 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:10 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_bash_operator.py","serialized_dags":[{"data":{"__version":1,"dag":{"dagrun_timeout":3600.0,"edge_info":{},"dag_id":"example_bash_operator","timezone":"UTC","tags":["example","example2"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_bash_operator.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"run_this_last":["operator","run_this_last"],"run_after_loop":["operator","run_after_loop"],"runme_0":["operator","runme_0"],"runme_1":["operator","runme_1"],"runme_2":["operator","runme_2"],"also_run_this":["operator","also_run_this"],"this_will_skip":["operator","this_will_skip"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"run_this_last","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"params":[["example_key",{"__class":"airflow.models.param.Param","default":"example_value","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"run_after_loop","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"params":[["example_key",{"__class":"airflow.models.param.Param","default":"example_value","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":["run_this_last"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo https://airflow.apache.org/"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"runme_0","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"params":[["example_key",{"__class":"airflow.models.param.Param","default":"example_value","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":["run_after_loop"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo \"{{ task_instance_key_str }}\" && sleep 1"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"runme_1","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"params":[["example_key",{"__class":"airflow.models.param.Param","default":"example_value","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":["run_after_loop"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo \"{{ task_instance_key_str }}\" && sleep 1"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"runme_2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"params":[["example_key",{"__class":"airflow.models.param.Param","default":"example_value","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":["run_after_loop"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo \"{{ task_instance_key_str }}\" && sleep 1"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"also_run_this","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"params":[["example_key",{"__class":"airflow.models.param.Param","default":"example_value","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":["run_this_last"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo \"ti_key={{ task_instance_key_str }}\""},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"this_will_skip","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"params":[["example_key",{"__class":"airflow.models.param.Param","default":"example_value","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":["run_this_last"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo \"hello world\"; exit 99;"},"__type":"operator"}],"dag_dependencies":[],"params":[["example_key",{"__class":"airflow.models.param.Param","default":"example_value","description":null,"schema":{"__var":{},"__type":"dict"}}]]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:10.666+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:10.669+0000] {collection.py:85} INFO - Creating ORM DAG for example_bash_operator
[2025-01-09T22:15:10.675+0000] {dag.py:2418} INFO - Setting next_dagrun for example_bash_operator to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:10.690+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_bash_operator
[2025-01-09T22:15:10.694+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_bash_operator
[2025-01-09T22:15:10.697+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_bash_operator
[2025-01-09T22:15:10.700+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_bash_operator
[2025-01-09T22:15:10.704+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_bash_operator
[2025-01-09T22:15:10.707+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_bash_operator
[2025-01-09T22:15:10.710+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_bash_operator
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:10 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/plugins/decreasing_priority_weight_strategy.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Importing /opt/airflow/airflow/example_dags/plugins/decreasing_priority_weight_strategy.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/plugins/decreasing_priority_weight_strategy.py","serialized_dags":[],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:10 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_workday_timetable.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Importing /opt/airflow/airflow/example_dags/example_workday_timetable.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_workday_timetable> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Plugins are already loaded. Skipping. [airflow.plugins_manager] [task]
2025-01-09 22:15:10 [debug ] Initialize extra timetables plugins [airflow.plugins_manager] [task]
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_workday_timetable.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_workday_timetable","timezone":"UTC","tags":["example","timetable"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_workday_timetable.py","timetable":{"__type":"airflow.example_dags.plugins.workday.AfterWorkdayTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"run_this":["operator","run_this"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"run_this","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:10.783+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:10.786+0000] {collection.py:85} INFO - Creating ORM DAG for example_workday_timetable
[2025-01-09T22:15:10.812+0000] {dag.py:2418} INFO - Setting next_dagrun for example_workday_timetable to 2021-01-04 00:00:00+00:00, run_after=2021-01-05 00:00:00+00:00
[2025-01-09T22:15:10.824+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_workday_timetable
[2025-01-09T22:15:10.827+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_workday_timetable
[2025-01-09T22:15:10.830+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_workday_timetable
[2025-01-09T22:15:10.834+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_workday_timetable
[2025-01-09T22:15:10.837+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_workday_timetable
[2025-01-09T22:15:10.839+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_workday_timetable
[2025-01-09T22:15:10.841+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_workday_timetable
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:10 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_task_group_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Importing /opt/airflow/airflow/example_dags/example_task_group_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_task_group_decorator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_task_group_decorator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_task_group_decorator","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_task_group_decorator.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"task_start":["operator","task_start"],"task_end":["operator","task_end"],"task_group_function":["taskgroup",{"_group_id":"task_group_function","group_display_name":"","prefix_group_id":true,"tooltip":"TaskGroup for grouping related Tasks","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"task_group_function.task_1":["operator","task_group_function.task_1"],"task_group_function.task_2":["operator","task_group_function.task_2"],"task_group_function.task_3":["operator","task_group_function.task_3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":["task_start"],"downstream_task_ids":["task_end"]}],"task_group_function__1":["taskgroup",{"_group_id":"task_group_function__1","group_display_name":"","prefix_group_id":true,"tooltip":"TaskGroup for grouping related Tasks","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"task_group_function__1.task_1":["operator","task_group_function__1.task_1"],"task_group_function__1.task_2":["operator","task_group_function__1.task_2"],"task_group_function__1.task_3":["operator","task_group_function__1.task_3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":["task_start"],"downstream_task_ids":["task_end"]}],"task_group_function__2":["taskgroup",{"_group_id":"task_group_function__2","group_display_name":"","prefix_group_id":true,"tooltip":"TaskGroup for grouping related Tasks","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"task_group_function__2.task_1":["operator","task_group_function__2.task_1"],"task_group_function__2.task_2":["operator","task_group_function__2.task_2"],"task_group_function__2.task_3":["operator","task_group_function__2.task_3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":["task_start"],"downstream_task_ids":["task_end"]}],"task_group_function__3":["taskgroup",{"_group_id":"task_group_function__3","group_display_name":"","prefix_group_id":true,"tooltip":"TaskGroup for grouping related Tasks","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"task_group_function__3.task_1":["operator","task_group_function__3.task_1"],"task_group_function__3.task_2":["operator","task_group_function__3.task_2"],"task_group_function__3.task_3":["operator","task_group_function__3.task_3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":["task_start"],"downstream_task_ids":["task_end"]}],"task_group_function__4":["taskgroup",{"_group_id":"task_group_function__4","group_display_name":"","prefix_group_id":true,"tooltip":"TaskGroup for grouping related Tasks","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"task_group_function__4.task_1":["operator","task_group_function__4.task_1"],"task_group_function__4.task_2":["operator","task_group_function__4.task_2"],"task_group_function__4.task_3":["operator","task_group_function__4.task_3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":["task_start"],"downstream_task_ids":["task_end"]}]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_start","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task which is First Task of Dag","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function.task_1","task_group_function__1.task_1","task_group_function__2.task_1","task_group_function__3.task_1","task_group_function__4.task_1"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_start","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_end","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task which is Last Task of Dag","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_end","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function.task_1","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task1","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function.task_2"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_1","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(0,)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function.task_2","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task2","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function.task_3"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_2","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): task_group_function.task_1>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function.task_3","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task3","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_end"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_3","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): task_group_function.task_2>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__1.task_1","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task1","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function__1.task_2"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_1","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(1,)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__1.task_2","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task2","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function__1.task_3"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_2","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): task_group_function__1.task_1>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__1.task_3","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task3","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_end"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_3","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): task_group_function__1.task_2>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__2.task_1","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task1","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function__2.task_2"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_1","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(2,)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__2.task_2","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task2","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function__2.task_3"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_2","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): task_group_function__2.task_1>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__2.task_3","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task3","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_end"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_3","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): task_group_function__2.task_2>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__3.task_1","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task1","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function__3.task_2"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_1","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(3,)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__3.task_2","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task2","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function__3.task_3"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_2","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): task_group_function__3.task_1>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__3.task_3","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task3","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_end"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_3","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): task_group_function__3.task_2>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__4.task_1","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task1","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function__4.task_2"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_1","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(4,)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__4.task_2","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task2","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_group_function__4.task_3"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_2","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): task_group_function__4.task_1>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_group_function__4.task_3","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Empty Task3","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_end"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3268cbcf92b8a81fbb1b4841bded7fce8cce6899_example_task_group_decorator.task_3","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): task_group_function__4.task_2>),)","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:10.876+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:10.879+0000] {collection.py:85} INFO - Creating ORM DAG for example_task_group_decorator
[2025-01-09T22:15:10.884+0000] {dag.py:2418} INFO - Setting next_dagrun for example_task_group_decorator to None, run_after=None
[2025-01-09T22:15:10.899+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_task_group_decorator
[2025-01-09T22:15:10.903+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_task_group_decorator
[2025-01-09T22:15:10.906+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_task_group_decorator
[2025-01-09T22:15:10.908+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_task_group_decorator
[2025-01-09T22:15:10.910+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_task_group_decorator
[2025-01-09T22:15:10.913+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_task_group_decorator
[2025-01-09T22:15:10.916+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_task_group_decorator
2025-01-09 22:15:10 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:10 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_skip_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Importing /opt/airflow/airflow/example_dags/example_skip_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Loaded DAG <DAG: example_skip_dag> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:10 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_skip_dag.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_skip_dag","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_skip_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.DeltaDataIntervalTimetable","__var":{"delta":86400.0}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"skip_operator_1":["operator","skip_operator_1"],"always_true_1":["operator","always_true_1"],"all_success":["operator","all_success"],"final_1":["operator","final_1"],"skip_operator_2":["operator","skip_operator_2"],"always_true_2":["operator","always_true_2"],"one_success":["operator","one_success"],"final_2":["operator","final_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8b7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptySkipOperator","template_ext":[],"task_id":"skip_operator_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["all_success"],"weight_rule":"downstream","_task_module":"unusual_prefix_ce1c0b29c7a787ca304b2d1888cefa75f5bbaff1_example_skip_dag","_is_empty":false,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"always_true_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["all_success"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"all_success","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["final_1"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"final_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8b7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptySkipOperator","template_ext":[],"task_id":"skip_operator_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["one_success"],"weight_rule":"downstream","_task_module":"unusual_prefix_ce1c0b29c7a787ca304b2d1888cefa75f5bbaff1_example_skip_dag","_is_empty":false,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"always_true_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["one_success"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"one_success","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"one_success","is_teardown":false,"downstream_task_ids":["final_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"final_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:10.943+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:10.947+0000] {collection.py:85} INFO - Creating ORM DAG for example_skip_dag
[2025-01-09T22:15:10.954+0000] {dag.py:2418} INFO - Setting next_dagrun for example_skip_dag to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:10.969+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_skip_dag
[2025-01-09T22:15:10.973+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_skip_dag
[2025-01-09T22:15:10.976+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_skip_dag
[2025-01-09T22:15:10.979+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_skip_dag
[2025-01-09T22:15:10.981+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_skip_dag
[2025-01-09T22:15:10.984+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_skip_dag
[2025-01-09T22:15:10.987+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_skip_dag
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_short_circuit_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_short_circuit_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_short_circuit_decorator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_short_circuit_decorator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_short_circuit_decorator","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_short_circuit_decorator.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"true_1":["operator","true_1"],"true_2":["operator","true_2"],"false_1":["operator","false_1"],"false_2":["operator","false_2"],"condition_is_true":["operator","condition_is_true"],"condition_is_false":["operator","condition_is_false"],"task_1":["operator","task_1"],"task_2":["operator","task_2"],"task_3":["operator","task_3"],"task_4":["operator","task_4"],"task_5":["operator","task_5"],"task_6":["operator","task_6"],"task_7":["operator","task_7"],"short_circuit":["operator","short_circuit"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"true_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["true_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"true_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"false_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["false_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"false_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_ShortCircuitDecoratedOperator","template_ext":[],"task_id":"condition_is_true","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["true_1"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_a6430b312222c957913ce4585e60591418edd4c5_example_short_circuit_decorator.check_condition","_task_module":"airflow.decorators.short_circuit","_operator_name":"@task.short_circuit","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"condition":true}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_ShortCircuitDecoratedOperator","template_ext":[],"task_id":"condition_is_false","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["false_1"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_a6430b312222c957913ce4585e60591418edd4c5_example_short_circuit_decorator.check_condition","_task_module":"airflow.decorators.short_circuit","_operator_name":"@task.short_circuit","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"condition":false}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["short_circuit","task_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_3"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_5"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_4","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_6"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_5","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_7"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_6","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_7"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task_7","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"all_done","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_ShortCircuitDecoratedOperator","template_ext":[],"task_id":"short_circuit","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_4"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_a6430b312222c957913ce4585e60591418edd4c5_example_short_circuit_decorator.check_condition","_task_module":"airflow.decorators.short_circuit","_operator_name":"@task.short_circuit","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"condition":false}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:11.019+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.022+0000] {collection.py:85} INFO - Creating ORM DAG for example_short_circuit_decorator
[2025-01-09T22:15:11.026+0000] {dag.py:2418} INFO - Setting next_dagrun for example_short_circuit_decorator to None, run_after=None
[2025-01-09T22:15:11.040+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_short_circuit_decorator
[2025-01-09T22:15:11.044+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_short_circuit_decorator
[2025-01-09T22:15:11.047+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_short_circuit_decorator
[2025-01-09T22:15:11.051+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_short_circuit_decorator
[2025-01-09T22:15:11.053+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_short_circuit_decorator
[2025-01-09T22:15:11.056+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_short_circuit_decorator
[2025-01-09T22:15:11.059+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_short_circuit_decorator
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_setup_teardown_taskflow.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_setup_teardown_taskflow.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_setup_teardown_taskflow> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_setup_teardown_taskflow.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_setup_teardown_taskflow","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_setup_teardown_taskflow.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"my_first_task":["operator","my_first_task"],"my_second_task":["operator","my_second_task"],"my_third_task":["operator","my_third_task"],"outer_setup":["operator","outer_setup"],"outer_teardown":["operator","outer_teardown"],"outer_work":["operator","outer_work"],"section_1":["taskgroup",{"_group_id":"section_1","group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"section_1.inner_setup":["operator","section_1.inner_setup"],"section_1.inner_work":["operator","section_1.inner_work"],"section_1.inner_teardown":["operator","section_1.inner_teardown"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]}]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"my_first_task","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":true,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["my_second_task","my_third_task"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8807bb3d52121b578f0ecc033b3d22f6ac6c7fc2_example_setup_teardown_taskflow.my_first_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"my_second_task","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["my_third_task"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8807bb3d52121b578f0ecc033b3d22f6ac6c7fc2_example_setup_teardown_taskflow.my_second_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"my_third_task","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"trigger_rule":"all_done_setup_success","is_teardown":true,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8807bb3d52121b578f0ecc033b3d22f6ac6c7fc2_example_setup_teardown_taskflow.my_third_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"outer_setup","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":true,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["outer_teardown","outer_work"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8807bb3d52121b578f0ecc033b3d22f6ac6c7fc2_example_setup_teardown_taskflow.outer_setup","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"outer_teardown","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"trigger_rule":"all_done_setup_success","is_teardown":true,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8807bb3d52121b578f0ecc033b3d22f6ac6c7fc2_example_setup_teardown_taskflow.outer_teardown","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): outer_setup>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"outer_work","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["outer_teardown"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8807bb3d52121b578f0ecc033b3d22f6ac6c7fc2_example_setup_teardown_taskflow.outer_work","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"section_1.inner_setup","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":true,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["section_1.inner_teardown","section_1.inner_work"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8807bb3d52121b578f0ecc033b3d22f6ac6c7fc2_example_setup_teardown_taskflow.inner_setup","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"section_1.inner_work","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["section_1.inner_teardown"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8807bb3d52121b578f0ecc033b3d22f6ac6c7fc2_example_setup_teardown_taskflow.inner_work","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): section_1.inner_setup>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"section_1.inner_teardown","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"trigger_rule":"all_done_setup_success","is_teardown":true,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8807bb3d52121b578f0ecc033b3d22f6ac6c7fc2_example_setup_teardown_taskflow.inner_teardown","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): section_1.inner_setup>),)","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:11.090+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.093+0000] {collection.py:85} INFO - Creating ORM DAG for example_setup_teardown_taskflow
[2025-01-09T22:15:11.096+0000] {dag.py:2418} INFO - Setting next_dagrun for example_setup_teardown_taskflow to None, run_after=None
[2025-01-09T22:15:11.108+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_setup_teardown_taskflow
[2025-01-09T22:15:11.112+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_setup_teardown_taskflow
[2025-01-09T22:15:11.116+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_setup_teardown_taskflow
[2025-01-09T22:15:11.121+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_setup_teardown_taskflow
[2025-01-09T22:15:11.125+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_setup_teardown_taskflow
[2025-01-09T22:15:11.129+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_setup_teardown_taskflow
[2025-01-09T22:15:11.132+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_setup_teardown_taskflow
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_params_trigger_ui.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_params_trigger_ui.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_params_trigger_ui> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:11 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:11 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:11 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:11 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:11 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_params_trigger_ui.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_params_trigger_ui","dag_display_name":"Params Trigger UI","timezone":"UTC","tags":["example","params"],"start_date":1646352000.0,"fileloc":"/opt/airflow/airflow/example_dags/example_params_trigger_ui.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"Example DAG demonstrating the usage DAG params to model a trigger UI with a user form.\n\nThis example DAG generates greetings to a list of provided names in selected languages in the logs.\n","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"select_languages":["operator","select_languages"],"get_names":["operator","get_names"],"generate_english_greeting":["operator","generate_english_greeting"],"generate_german_greeting":["operator","generate_german_greeting"],"generate_french_greeting":["operator","generate_french_greeting"],"print_greetings":["operator","print_greetings"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"description":"Example DAG demonstrating the usage DAG params to model a trigger UI with a user form","_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BranchPythonDecoratedOperator","template_ext":[],"task_id":"select_languages","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"_task_display_name":"Select languages","on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"params":[["names",{"__class":"airflow.models.param.Param","default":["Linda","Martha","Thomas"],"description":"Define the list of names for which greetings should be generated in the logs. Please have one name per line.","schema":{"__var":{"type":"array","title":"Names to greet"},"__type":"dict"}}],["english",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"English"},"__type":"dict"}}],["german",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"German (Formal)"},"__type":"dict"}}],["french",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"French"},"__type":"dict"}}]],"downstream_task_ids":["generate_english_greeting","generate_french_greeting","generate_german_greeting"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4bcea25e23d37f9c4ed5f5aacd41ba14d282d79a_example_params_trigger_ui.select_languages","_task_module":"airflow.decorators.branch_python","_operator_name":"@task.branch","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"get_names","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"_task_display_name":"Get names","on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"params":[["names",{"__class":"airflow.models.param.Param","default":["Linda","Martha","Thomas"],"description":"Define the list of names for which greetings should be generated in the logs. Please have one name per line.","schema":{"__var":{"type":"array","title":"Names to greet"},"__type":"dict"}}],["english",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"English"},"__type":"dict"}}],["german",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"German (Formal)"},"__type":"dict"}}],["french",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"French"},"__type":"dict"}}]],"downstream_task_ids":["generate_english_greeting","generate_french_greeting","generate_german_greeting"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4bcea25e23d37f9c4ed5f5aacd41ba14d282d79a_example_params_trigger_ui.get_names","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","_is_empty":false,"start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"generate_english_greeting","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"operator_extra_links":[],"partial_kwargs":{"is_setup":false,"is_teardown":false,"on_failure_fail_dagrun":false,"task_display_name":"Generate English greeting","op_args":[],"op_kwargs":{"__var":{},"__type":"dict"}},"template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":true,"params":[["names",{"__class":"airflow.models.param.Param","default":["Linda","Martha","Thomas"],"description":"Define the list of names for which greetings should be generated in the logs. Please have one name per line.","schema":{"__var":{"type":"array","title":"Names to greet"},"__type":"dict"}}],["english",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"English"},"__type":"dict"}}],["german",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"German (Formal)"},"__type":"dict"}}],["french",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"French"},"__type":"dict"}}]],"_operator_name":"@task","downstream_task_ids":["print_greetings"],"_expand_input_attr":"op_kwargs_expand_input","_disallow_kwargs_override":false,"_task_module":"airflow.decorators.python","python_callable_name":"unusual_prefix_4bcea25e23d37f9c4ed5f5aacd41ba14d282d79a_example_params_trigger_ui.generate_english_greeting","start_trigger_args":null,"op_kwargs_expand_input":{"type":"dict-of-lists","value":{"__var":{"name":{"__var":{"task_id":"get_names","key":"return_value"},"__type":"xcomref"}},"__type":"dict"}},"_is_mapped":true},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","_is_empty":false,"start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"generate_german_greeting","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"operator_extra_links":[],"partial_kwargs":{"is_setup":false,"is_teardown":false,"on_failure_fail_dagrun":false,"task_display_name":"Erzeuge Deutsche Begrüßung","op_args":[],"op_kwargs":{"__var":{},"__type":"dict"}},"template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":true,"params":[["names",{"__class":"airflow.models.param.Param","default":["Linda","Martha","Thomas"],"description":"Define the list of names for which greetings should be generated in the logs. Please have one name per line.","schema":{"__var":{"type":"array","title":"Names to greet"},"__type":"dict"}}],["english",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"English"},"__type":"dict"}}],["german",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"German (Formal)"},"__type":"dict"}}],["french",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"French"},"__type":"dict"}}]],"_operator_name":"@task","downstream_task_ids":["print_greetings"],"_expand_input_attr":"op_kwargs_expand_input","_disallow_kwargs_override":false,"_task_module":"airflow.decorators.python","python_callable_name":"unusual_prefix_4bcea25e23d37f9c4ed5f5aacd41ba14d282d79a_example_params_trigger_ui.generate_german_greeting","start_trigger_args":null,"op_kwargs_expand_input":{"type":"dict-of-lists","value":{"__var":{"name":{"__var":{"task_id":"get_names","key":"return_value"},"__type":"xcomref"}},"__type":"dict"}},"_is_mapped":true},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","_is_empty":false,"start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"generate_french_greeting","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"operator_extra_links":[],"partial_kwargs":{"is_setup":false,"is_teardown":false,"on_failure_fail_dagrun":false,"task_display_name":"Produire un message d'accueil en français","op_args":[],"op_kwargs":{"__var":{},"__type":"dict"}},"template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":true,"params":[["names",{"__class":"airflow.models.param.Param","default":["Linda","Martha","Thomas"],"description":"Define the list of names for which greetings should be generated in the logs. Please have one name per line.","schema":{"__var":{"type":"array","title":"Names to greet"},"__type":"dict"}}],["english",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"English"},"__type":"dict"}}],["german",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"German (Formal)"},"__type":"dict"}}],["french",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"French"},"__type":"dict"}}]],"_operator_name":"@task","downstream_task_ids":["print_greetings"],"_expand_input_attr":"op_kwargs_expand_input","_disallow_kwargs_override":false,"_task_module":"airflow.decorators.python","python_callable_name":"unusual_prefix_4bcea25e23d37f9c4ed5f5aacd41ba14d282d79a_example_params_trigger_ui.generate_french_greeting","start_trigger_args":null,"op_kwargs_expand_input":{"type":"dict-of-lists","value":{"__var":{"name":{"__var":{"task_id":"get_names","key":"return_value"},"__type":"xcomref"}},"__type":"dict"}},"_is_mapped":true},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"print_greetings","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"_task_display_name":"Print greetings","on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"trigger_rule":"all_done","is_teardown":false,"params":[["names",{"__class":"airflow.models.param.Param","default":["Linda","Martha","Thomas"],"description":"Define the list of names for which greetings should be generated in the logs. Please have one name per line.","schema":{"__var":{"type":"array","title":"Names to greet"},"__type":"dict"}}],["english",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"English"},"__type":"dict"}}],["german",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"German (Formal)"},"__type":"dict"}}],["french",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"French"},"__type":"dict"}}]],"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_4bcea25e23d37f9c4ed5f5aacd41ba14d282d79a_example_params_trigger_ui.print_greetings","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Mapped(_PythonDecoratedOperator): generate_english_greeting>), XComArg(<Mapped(_PythonDecoratedOperator): generate_german_greeting>), XComArg(<Mapped(_PythonDecoratedOperator): generate_french_greeting>))","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[["names",{"__class":"airflow.models.param.Param","default":["Linda","Martha","Thomas"],"description":"Define the list of names for which greetings should be generated in the logs. Please have one name per line.","schema":{"__var":{"type":"array","title":"Names to greet"},"__type":"dict"}}],["english",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"English"},"__type":"dict"}}],["german",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"German (Formal)"},"__type":"dict"}}],["french",{"__class":"airflow.models.param.Param","default":true,"description":null,"schema":{"__var":{"type":"boolean","title":"French"},"__type":"dict"}}]]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:11.174+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.176+0000] {collection.py:85} INFO - Creating ORM DAG for example_params_trigger_ui
[2025-01-09T22:15:11.180+0000] {dag.py:2418} INFO - Setting next_dagrun for example_params_trigger_ui to None, run_after=None
[2025-01-09T22:15:11.195+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_params_trigger_ui
[2025-01-09T22:15:11.198+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_params_trigger_ui
[2025-01-09T22:15:11.201+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_params_trigger_ui
[2025-01-09T22:15:11.203+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_params_trigger_ui
[2025-01-09T22:15:11.207+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_params_trigger_ui
[2025-01-09T22:15:11.210+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_params_trigger_ui
[2025-01-09T22:15:11.214+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_params_trigger_ui
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_dynamic_task_mapping_with_no_taskflow_operators.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_dynamic_task_mapping_with_no_taskflow_operators.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_dynamic_task_mapping_with_no_taskflow_operators> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_dynamic_task_mapping_with_no_taskflow_operators.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_dynamic_task_mapping_with_no_taskflow_operators","timezone":"UTC","tags":[],"start_date":1646352000.0,"fileloc":"/opt/airflow/airflow/example_dags/example_dynamic_task_mapping_with_no_taskflow_operators.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"add_one":["operator","add_one"],"sum_it":["operator","sum_it"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#fff","ui_fgcolor":"#000","_is_empty":false,"start_from_trigger":false,"task_type":"AddOneOperator","template_ext":[],"task_id":"add_one","template_fields_renderers":{},"operator_extra_links":[],"partial_kwargs":{},"template_fields":[],"_needs_expansion":true,"downstream_task_ids":["sum_it"],"_expand_input_attr":"expand_input","_disallow_kwargs_override":false,"_task_module":"unusual_prefix_d6d8a2bf998fdedce1444a945cdb44b55d9ff73c_example_dynamic_task_mapping_with_no_taskflow_operators","start_trigger_args":null,"expand_input":{"type":"dict-of-lists","value":{"__var":{"value":[1,2,3]},"__type":"dict"}},"_is_mapped":true},"__type":"operator"},{"__var":{"ui_color":"#fff","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"SumItOperator","template_ext":[],"task_id":"sum_it","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["values"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"unusual_prefix_d6d8a2bf998fdedce1444a945cdb44b55d9ff73c_example_dynamic_task_mapping_with_no_taskflow_operators","_is_empty":false,"start_trigger_args":null,"values":"{{ task_instance.xcom_pull(task_ids='add_one', dag_id='example_dynamic_task_mapping_with_no_taskflow_operators', key='return_value') }}"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:11.234+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.237+0000] {collection.py:85} INFO - Creating ORM DAG for example_dynamic_task_mapping_with_no_taskflow_operators
[2025-01-09T22:15:11.239+0000] {dag.py:2418} INFO - Setting next_dagrun for example_dynamic_task_mapping_with_no_taskflow_operators to None, run_after=None
[2025-01-09T22:15:11.252+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_dynamic_task_mapping_with_no_taskflow_operators
[2025-01-09T22:15:11.256+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_dynamic_task_mapping_with_no_taskflow_operators
[2025-01-09T22:15:11.259+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_dynamic_task_mapping_with_no_taskflow_operators
[2025-01-09T22:15:11.263+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_dynamic_task_mapping_with_no_taskflow_operators
[2025-01-09T22:15:11.267+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_dynamic_task_mapping_with_no_taskflow_operators
[2025-01-09T22:15:11.270+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_dynamic_task_mapping_with_no_taskflow_operators
[2025-01-09T22:15:11.273+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_dynamic_task_mapping_with_no_taskflow_operators
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_dynamic_task_mapping.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_dynamic_task_mapping.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_bash_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_bash_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_dynamic_task_mapping> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_dynamic_task_mapping.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_dynamic_task_mapping","timezone":"UTC","tags":[],"start_date":1646352000.0,"fileloc":"/opt/airflow/airflow/example_dags/example_dynamic_task_mapping.py","timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"add_one":["operator","add_one"],"sum_it":["operator","sum_it"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","_is_empty":false,"start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"add_one","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"operator_extra_links":[],"partial_kwargs":{"is_setup":false,"is_teardown":false,"on_failure_fail_dagrun":false,"op_args":[],"op_kwargs":{"__var":{},"__type":"dict"}},"template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":true,"_operator_name":"@task","downstream_task_ids":["sum_it"],"_expand_input_attr":"op_kwargs_expand_input","_disallow_kwargs_override":false,"_task_module":"airflow.decorators.python","python_callable_name":"unusual_prefix_52c7f6f4583338638801d00edce19070f2d02baa_example_dynamic_task_mapping.add_one","start_trigger_args":null,"op_kwargs_expand_input":{"type":"dict-of-lists","value":{"__var":{"x":[1,2,3]},"__type":"dict"}},"_is_mapped":true},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"sum_it","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_52c7f6f4583338638801d00edce19070f2d02baa_example_dynamic_task_mapping.sum_it","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Mapped(_PythonDecoratedOperator): add_one>),)","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:11.490+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.492+0000] {collection.py:85} INFO - Creating ORM DAG for example_dynamic_task_mapping
[2025-01-09T22:15:11.494+0000] {dag.py:2418} INFO - Setting next_dagrun for example_dynamic_task_mapping to None, run_after=None
[2025-01-09T22:15:11.507+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_dynamic_task_mapping
[2025-01-09T22:15:11.511+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_dynamic_task_mapping
[2025-01-09T22:15:11.514+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_dynamic_task_mapping
[2025-01-09T22:15:11.517+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_dynamic_task_mapping
[2025-01-09T22:15:11.521+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_dynamic_task_mapping
[2025-01-09T22:15:11.524+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_dynamic_task_mapping
[2025-01-09T22:15:11.527+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_dynamic_task_mapping
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_bash_decorator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_bash_decorator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_bash_decorator","timezone":"UTC","tags":[],"start_date":1672531200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_bash_decorator.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"runme_0":["operator","runme_0"],"runme_1":["operator","runme_1"],"runme_2":["operator","runme_2"],"run_after_loop":["operator","run_after_loop"],"also_run_this":["operator","also_run_this"],"also_run_this_again":["operator","also_run_this_again"],"this_will_skip":["operator","this_will_skip"],"run_this_last":["operator","run_this_last"],"sleep_in":["operator","sleep_in"],"make_dynamic_dirs":["operator","make_dynamic_dirs"],"get_file_stats":["operator","get_file_stats"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BashDecoratedOperator","template_ext":[".sh",".bash"],"task_id":"runme_0","template_fields_renderers":{"op_args":"py","op_kwargs":"py","bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["run_after_loop"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3a83442bef1bfe42f9247606fd288166578d3357_example_bash_decorator.run_me","_task_module":"airflow.decorators.bash","_operator_name":"@task.bash","_is_empty":false,"start_trigger_args":null,"op_args":[],"op_kwargs":{"sleep_seconds":0},"bash_command":"NOTSET"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BashDecoratedOperator","template_ext":[".sh",".bash"],"task_id":"runme_1","template_fields_renderers":{"op_args":"py","op_kwargs":"py","bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["run_after_loop"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3a83442bef1bfe42f9247606fd288166578d3357_example_bash_decorator.run_me","_task_module":"airflow.decorators.bash","_operator_name":"@task.bash","_is_empty":false,"start_trigger_args":null,"op_args":[],"op_kwargs":{"sleep_seconds":1},"bash_command":"NOTSET"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BashDecoratedOperator","template_ext":[".sh",".bash"],"task_id":"runme_2","template_fields_renderers":{"op_args":"py","op_kwargs":"py","bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["run_after_loop"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3a83442bef1bfe42f9247606fd288166578d3357_example_bash_decorator.run_me","_task_module":"airflow.decorators.bash","_operator_name":"@task.bash","_is_empty":false,"start_trigger_args":null,"op_args":[],"op_kwargs":{"sleep_seconds":2},"bash_command":"NOTSET"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BashDecoratedOperator","template_ext":[".sh",".bash"],"task_id":"run_after_loop","template_fields_renderers":{"op_args":"py","op_kwargs":"py","bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["run_this_last"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3a83442bef1bfe42f9247606fd288166578d3357_example_bash_decorator.run_after_loop","_task_module":"airflow.decorators.bash","_operator_name":"@task.bash","_is_empty":false,"start_trigger_args":null,"op_args":[],"op_kwargs":{},"bash_command":"NOTSET"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BashDecoratedOperator","template_ext":[".sh",".bash"],"task_id":"also_run_this","template_fields_renderers":{"op_args":"py","op_kwargs":"py","bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["run_this_last"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3a83442bef1bfe42f9247606fd288166578d3357_example_bash_decorator.also_run_this","_task_module":"airflow.decorators.bash","_operator_name":"@task.bash","_is_empty":false,"start_trigger_args":null,"op_args":[],"op_kwargs":{},"bash_command":"NOTSET"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BashDecoratedOperator","template_ext":[".sh",".bash"],"task_id":"also_run_this_again","template_fields_renderers":{"op_args":"py","op_kwargs":"py","bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["run_this_last"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3a83442bef1bfe42f9247606fd288166578d3357_example_bash_decorator.also_run_this_again","_task_module":"airflow.decorators.bash","_operator_name":"@task.bash","_is_empty":false,"start_trigger_args":null,"op_args":[],"op_kwargs":{},"bash_command":"NOTSET"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BashDecoratedOperator","template_ext":[".sh",".bash"],"task_id":"this_will_skip","template_fields_renderers":{"op_args":"py","op_kwargs":"py","bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["run_this_last"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3a83442bef1bfe42f9247606fd288166578d3357_example_bash_decorator.this_will_skip","_task_module":"airflow.decorators.bash","_operator_name":"@task.bash","_is_empty":false,"start_trigger_args":null,"op_args":[],"op_kwargs":{},"bash_command":"NOTSET"},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"run_this_last","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"all_done","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BashDecoratedOperator","template_ext":[".sh",".bash"],"task_id":"sleep_in","template_fields_renderers":{"op_args":"py","op_kwargs":"py","bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3a83442bef1bfe42f9247606fd288166578d3357_example_bash_decorator.sleep_in","_task_module":"airflow.decorators.bash","_operator_name":"@task.bash","_is_empty":false,"start_trigger_args":null,"op_args":[],"op_kwargs":{"day":"{{ dag_run.logical_date.strftime('%A').lower() }}"},"bash_command":"NOTSET"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BashDecoratedOperator","template_ext":[".sh",".bash"],"task_id":"make_dynamic_dirs","template_fields_renderers":{"op_args":"py","op_kwargs":"py","bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3a83442bef1bfe42f9247606fd288166578d3357_example_bash_decorator.make_dynamic_dirs","_task_module":"airflow.decorators.bash","_operator_name":"@task.bash","_is_empty":false,"start_trigger_args":null,"op_args":[],"op_kwargs":{"new_dirs":"foo/bar/baz"},"bash_command":"NOTSET","env":{"BASE_DIR":"{{ dag_run.logical_date.strftime('%Y/%m/%d') }}"}},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BashDecoratedOperator","template_ext":[".sh",".bash"],"task_id":"get_file_stats","template_fields_renderers":{"op_args":"py","op_kwargs":"py","bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs","bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3a83442bef1bfe42f9247606fd288166578d3357_example_bash_decorator.get_file_stats","_task_module":"airflow.decorators.bash","_operator_name":"@task.bash","_is_empty":false,"start_trigger_args":null,"op_args":[],"op_kwargs":{},"bash_command":"NOTSET"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:11.559+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.561+0000] {collection.py:85} INFO - Creating ORM DAG for example_bash_decorator
[2025-01-09T22:15:11.565+0000] {dag.py:2418} INFO - Setting next_dagrun for example_bash_decorator to None, run_after=None
[2025-01-09T22:15:11.579+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_bash_decorator
[2025-01-09T22:15:11.582+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_bash_decorator
[2025-01-09T22:15:11.585+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_bash_decorator
[2025-01-09T22:15:11.587+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_bash_decorator
[2025-01-09T22:15:11.590+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_bash_decorator
[2025-01-09T22:15:11.593+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_bash_decorator
[2025-01-09T22:15:11.595+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_bash_decorator
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/plugins/workday.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/plugins/workday.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/plugins/workday.py","serialized_dags":[],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_nested_branch_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_nested_branch_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_local_kubernetes_executor.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_local_kubernetes_executor.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_nested_branch_dag> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_nested_branch_dag.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_nested_branch_dag","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_nested_branch_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"branch_1":["operator","branch_1"],"join_1":["operator","join_1"],"true_1":["operator","true_1"],"false_1":["operator","false_1"],"branch_2":["operator","branch_2"],"join_2":["operator","join_2"],"true_2":["operator","true_2"],"false_2":["operator","false_2"],"false_3":["operator","false_3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BranchPythonDecoratedOperator","template_ext":[],"task_id":"branch_1","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["false_1","true_1"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_7916eab33338c9950e0bf82d6299c883c8240573_example_nested_branch_dag.branch","_task_module":"airflow.decorators.branch_python","_operator_name":"@task.branch","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"task_id_to_return":"true_1"}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"join_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"none_failed_min_one_success","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"true_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_1"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"false_1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["branch_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BranchPythonDecoratedOperator","template_ext":[],"task_id":"branch_2","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["false_2","true_2"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_7916eab33338c9950e0bf82d6299c883c8240573_example_nested_branch_dag.branch","_task_module":"airflow.decorators.branch_python","_operator_name":"@task.branch","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{"task_id_to_return":"true_2"}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"join_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"none_failed_min_one_success","is_teardown":false,"downstream_task_ids":["false_3"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"true_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"false_2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"false_3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["join_1"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:11.684+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.686+0000] {collection.py:85} INFO - Creating ORM DAG for example_nested_branch_dag
[2025-01-09T22:15:11.693+0000] {dag.py:2418} INFO - Setting next_dagrun for example_nested_branch_dag to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:11.707+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_nested_branch_dag
[2025-01-09T22:15:11.711+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_nested_branch_dag
[2025-01-09T22:15:11.713+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_nested_branch_dag
[2025-01-09T22:15:11.716+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_nested_branch_dag
[2025-01-09T22:15:11.719+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_nested_branch_dag
[2025-01-09T22:15:11.722+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_nested_branch_dag
[2025-01-09T22:15:11.725+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_nested_branch_dag
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_local_kubernetes_executor> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_local_kubernetes_executor.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_local_kubernetes_executor","timezone":"UTC","tags":["example3"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_local_kubernetes_executor.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"task_with_local_executor":["operator","task_with_local_executor"],"task_with_kubernetes_executor":["operator","task_with_kubernetes_executor"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"task_with_local_executor","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"Print the Airflow context and ds variable from the context.","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task_with_kubernetes_executor"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3955d2ed8e9bdd6f18d75c0f50e4702764f0bbad_example_local_kubernetes_executor.task_with_local","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"executor_config":{"__var":{"pod_override":{"__var":{"metadata":{"annotations":{"test":"annotation"}}},"__type":"k8s.V1Pod"}},"__type":"dict"},"queue":"kubernetes","task_id":"task_with_kubernetes_executor","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3955d2ed8e9bdd6f18d75c0f50e4702764f0bbad_example_local_kubernetes_executor.task_with_template","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:11.743+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.747+0000] {collection.py:85} INFO - Creating ORM DAG for example_local_kubernetes_executor
[2025-01-09T22:15:11.753+0000] {dag.py:2418} INFO - Setting next_dagrun for example_local_kubernetes_executor to None, run_after=None
[2025-01-09T22:15:11.766+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_local_kubernetes_executor
[2025-01-09T22:15:11.769+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_local_kubernetes_executor
[2025-01-09T22:15:11.772+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_local_kubernetes_executor
[2025-01-09T22:15:11.774+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_local_kubernetes_executor
[2025-01-09T22:15:11.776+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_local_kubernetes_executor
[2025-01-09T22:15:11.778+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_local_kubernetes_executor
[2025-01-09T22:15:11.782+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_local_kubernetes_executor
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_kubernetes_executor.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_kubernetes_executor.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_kubernetes_executor> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_kubernetes_executor.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_kubernetes_executor","timezone":"UTC","tags":["example3"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_kubernetes_executor.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"test_volume_mount":["operator","test_volume_mount"],"test_sharedvolume_mount":["operator","test_sharedvolume_mount"],"non_root_task":["operator","non_root_task"],"other_namespace_task":["operator","other_namespace_task"],"base_image_override_task":["operator","base_image_override_task"],"task_with_resource_limits":["operator","task_with_resource_limits"],"start_task":["operator","start_task"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"executor_config":{"__var":{"pod_override":{"__var":{"spec":{"containers":[{"name":"base","volumeMounts":[{"mountPath":"/foo/","name":"example-kubernetes-test-volume"}]}],"volumes":[{"hostPath":{"path":"/tmp/"},"name":"example-kubernetes-test-volume"}]}},"__type":"k8s.V1Pod"}},"__type":"dict"},"task_id":"test_volume_mount","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n Tests whether the volume has been mounted.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["non_root_task"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_a226c4f756ccd88fbb6152508f09284f700312f1_example_kubernetes_executor.test_volume_mount","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"executor_config":{"__var":{"pod_override":{"__var":{"spec":{"containers":[{"name":"base","volumeMounts":[{"mountPath":"/shared/","name":"shared-empty-dir"}]},{"args":["echo \"retrieved from mount\" > /shared/test.txt"],"command":["bash","-cx"],"image":"ubuntu","name":"sidecar","volumeMounts":[{"mountPath":"/shared/","name":"shared-empty-dir"}]}],"volumes":[{"emptyDir":{},"name":"shared-empty-dir"}]}},"__type":"k8s.V1Pod"}},"__type":"dict"},"task_id":"test_sharedvolume_mount","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n Tests whether the volume has been mounted.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["non_root_task"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_a226c4f756ccd88fbb6152508f09284f700312f1_example_kubernetes_executor.test_sharedvolume_mount","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"executor_config":{"__var":{"pod_override":{"__var":{"metadata":{"labels":{"release":"stable"}}},"__type":"k8s.V1Pod"}},"__type":"dict"},"task_id":"non_root_task","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["base_image_override_task","task_with_resource_limits"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_a226c4f756ccd88fbb6152508f09284f700312f1_example_kubernetes_executor.non_root_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"executor_config":{"__var":{"pod_override":{"__var":{"metadata":{"labels":{"release":"stable"},"namespace":"test-namespace"}},"__type":"k8s.V1Pod"}},"__type":"dict"},"task_id":"other_namespace_task","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["non_root_task"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_a226c4f756ccd88fbb6152508f09284f700312f1_example_kubernetes_executor.other_namespace_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"executor_config":{"__var":{"pod_override":{"__var":{"spec":{"containers":[{"image":":","name":"base"}]}},"__type":"k8s.V1Pod"}},"__type":"dict"},"task_id":"base_image_override_task","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_a226c4f756ccd88fbb6152508f09284f700312f1_example_kubernetes_executor.base_image_override_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"executor_config":{"__var":{"pod_override":{"__var":{"spec":{"affinity":{"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["airflow"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"containers":[{"name":"base","resources":{"limits":{"memory":"512Mi"},"requests":{"memory":"512Mi"}}}],"tolerations":[{"key":"dedicated","operator":"Equal","value":"airflow"}]}},"__type":"k8s.V1Pod"}},"__type":"dict"},"task_id":"task_with_resource_limits","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_a226c4f756ccd88fbb6152508f09284f700312f1_example_kubernetes_executor.task_with_resource_limits","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"executor_config":{"__var":{"pod_override":{"__var":{"metadata":{"annotations":{"test":"annotation"}}},"__type":"k8s.V1Pod"}},"__type":"dict"},"task_id":"start_task","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["other_namespace_task","test_sharedvolume_mount","test_volume_mount"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_a226c4f756ccd88fbb6152508f09284f700312f1_example_kubernetes_executor.start_task","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:11.824+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.827+0000] {collection.py:85} INFO - Creating ORM DAG for example_kubernetes_executor
[2025-01-09T22:15:11.837+0000] {dag.py:2418} INFO - Setting next_dagrun for example_kubernetes_executor to None, run_after=None
[2025-01-09T22:15:11.852+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_kubernetes_executor
[2025-01-09T22:15:11.856+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_kubernetes_executor
[2025-01-09T22:15:11.860+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_kubernetes_executor
[2025-01-09T22:15:11.863+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_kubernetes_executor
[2025-01-09T22:15:11.867+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_kubernetes_executor
[2025-01-09T22:15:11.869+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_kubernetes_executor
[2025-01-09T22:15:11.872+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_kubernetes_executor
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_display_name.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_display_name.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_display_name> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_display_name.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_display_name","dag_display_name":"Sample DAG with Display Name","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_display_name.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"sample_task_1":["operator","sample_task_1"],"sample_task_2":["operator","sample_task_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"sample_task_1","template_fields_renderers":{},"is_setup":false,"_task_display_name":"Sample Task 1","on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["sample_task_2"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"sample_task_2","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"_task_display_name":"Sample Task 2","on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3fc51d48401e90a9213bfeca058fd97cf559993c_example_display_name.sample_task_2","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:11.898+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.901+0000] {collection.py:85} INFO - Creating ORM DAG for example_display_name
[2025-01-09T22:15:11.904+0000] {dag.py:2418} INFO - Setting next_dagrun for example_display_name to None, run_after=None
[2025-01-09T22:15:11.919+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_display_name
[2025-01-09T22:15:11.922+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_display_name
[2025-01-09T22:15:11.926+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_display_name
[2025-01-09T22:15:11.930+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_display_name
[2025-01-09T22:15:11.933+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_display_name
[2025-01-09T22:15:11.936+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_display_name
[2025-01-09T22:15:11.939+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_display_name
2025-01-09 22:15:11 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:11 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_branch_labels.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Importing /opt/airflow/airflow/example_dags/example_branch_labels.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Loaded DAG <DAG: example_branch_labels> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:11 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_branch_labels.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{"check_integrity":{"save":{"label":"No errors"},"describe_integrity":{"label":"Errors found"}}},"dag_id":"example_branch_labels","timezone":"UTC","tags":[],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_branch_labels.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"ingest":["operator","ingest"],"analyze":["operator","analyze"],"check_integrity":["operator","check_integrity"],"describe_integrity":["operator","describe_integrity"],"email_error":["operator","email_error"],"save":["operator","save"],"report":["operator","report"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"ingest","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["analyze"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"analyze","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["check_integrity"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"check_integrity","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["describe_integrity","save"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"describe_integrity","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["email_error"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"email_error","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["report"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"save","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["report"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"report","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:11.967+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:11.969+0000] {collection.py:85} INFO - Creating ORM DAG for example_branch_labels
[2025-01-09T22:15:11.976+0000] {dag.py:2418} INFO - Setting next_dagrun for example_branch_labels to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:11.989+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_branch_labels
[2025-01-09T22:15:11.992+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_branch_labels
[2025-01-09T22:15:11.995+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_branch_labels
[2025-01-09T22:15:11.999+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_branch_labels
[2025-01-09T22:15:12.001+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_branch_labels
[2025-01-09T22:15:12.004+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_branch_labels
[2025-01-09T22:15:12.007+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_branch_labels
2025-01-09 22:15:12 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:12 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/plugins/listener_plugin.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [debug ] Importing /opt/airflow/airflow/example_dags/plugins/listener_plugin.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/plugins/listener_plugin.py","serialized_dags":[],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:12 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_sensor_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [debug ] Importing /opt/airflow/airflow/example_dags/example_sensor_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_dag_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [debug ] Importing /opt/airflow/airflow/example_dags/example_dag_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [debug ] Loaded DAG <DAG: example_dag_decorator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:12 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:12 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:12 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_dag_decorator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_dag_decorator","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_dag_decorator.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"\n DAG to send server IP to email.\n\n :param email: Email to send IP to. Defaults to [email protected].\n ","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"get_ip":["operator","get_ip"],"prepare_email":["operator","prepare_email"],"send_email":["operator","send_email"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#fff","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"GetRequestOperator","template_ext":[],"task_id":"get_ip","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"params":[["email",{"__class":"airflow.models.param.Param","default":"[email protected]","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":["prepare_email"],"weight_rule":"downstream","_task_module":"unusual_prefix_3c946fce5d83a3f4a80dace30960cae878ec28d3_example_dag_decorator","_is_empty":false,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"multiple_outputs":true,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"prepare_email","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"params":[["email",{"__class":"airflow.models.param.Param","default":"[email protected]","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":["send_email"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_3c946fce5d83a3f4a80dace30960cae878ec28d3_example_dag_decorator.prepare_email","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(GetRequestOperator): get_ip>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e6faf9","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmailOperator","template_ext":[".html"],"task_id":"send_email","template_fields_renderers":{"html_content":"html"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["to","subject","html_content","files"],"_needs_expansion":false,"is_teardown":false,"params":[["email",{"__class":"airflow.models.param.Param","default":"[email protected]","description":null,"schema":{"__var":{},"__type":"dict"}}]],"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.email","_is_empty":false,"start_trigger_args":null,"to":{"dag_id":"example_dag_decorator","name":"email","default":"[email protected]"},"subject":"{{ task_instance.xcom_pull(task_ids='prepare_email', dag_id='example_dag_decorator', key='subject') }}","html_content":"{{ task_instance.xcom_pull(task_ids='prepare_email', dag_id='example_dag_decorator', key='body') }}","files":[]},"__type":"operator"}],"dag_dependencies":[],"params":[["email",{"__class":"airflow.models.param.Param","default":"[email protected]","description":null,"schema":{"__var":{},"__type":"dict"}}]]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:12 [debug ] Loaded DAG <DAG: example_sensor_decorator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_sensor_decorator.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_sensor_decorator","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_sensor_decorator.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"wait_for_upstream":["operator","wait_for_upstream"],"dummy_operator":["operator","dummy_operator"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"DecoratedSensorOperator","template_ext":[],"task_id":"wait_for_upstream","template_fields_renderers":{"op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"reschedule":true,"downstream_task_ids":["dummy_operator"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_f35a11f8d7a14aa49074dc754781912345b35f4d_example_sensor_decorator.wait_for_upstream","_task_module":"airflow.decorators.sensor","_operator_name":"@task.sensor","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"op_args":[],"op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"dummy_operator","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_f35a11f8d7a14aa49074dc754781912345b35f4d_example_sensor_decorator.dummy_operator","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:12 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:12.320+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:12.322+0000] {collection.py:85} INFO - Creating ORM DAG for example_dag_decorator
[2025-01-09T22:15:12.325+0000] {dag.py:2418} INFO - Setting next_dagrun for example_dag_decorator to None, run_after=None
[2025-01-09T22:15:12.338+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_dag_decorator
[2025-01-09T22:15:12.341+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_dag_decorator
[2025-01-09T22:15:12.344+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_dag_decorator
[2025-01-09T22:15:12.346+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_dag_decorator
[2025-01-09T22:15:12.349+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_dag_decorator
[2025-01-09T22:15:12.351+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_dag_decorator
[2025-01-09T22:15:12.353+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_dag_decorator
2025-01-09 22:15:12 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:12.366+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:12.370+0000] {collection.py:85} INFO - Creating ORM DAG for example_sensor_decorator
[2025-01-09T22:15:12.373+0000] {dag.py:2418} INFO - Setting next_dagrun for example_sensor_decorator to None, run_after=None
[2025-01-09T22:15:12.388+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:example_sensor_decorator
[2025-01-09T22:15:12.392+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:example_sensor_decorator
[2025-01-09T22:15:12.395+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:example_sensor_decorator
[2025-01-09T22:15:12.398+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:example_sensor_decorator
[2025-01-09T22:15:12.401+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:example_sensor_decorator
[2025-01-09T22:15:12.404+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:example_sensor_decorator
[2025-01-09T22:15:12.406+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:example_sensor_decorator
2025-01-09 22:15:12 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/tutorial_taskflow_api.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [debug ] Importing /opt/airflow/airflow/example_dags/tutorial_taskflow_api.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [debug ] Loaded DAG <DAG: tutorial_taskflow_api> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:12 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/tutorial_taskflow_api.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"tutorial_taskflow_api","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/tutorial_taskflow_api.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"\n ### TaskFlow API Tutorial Documentation\n This is a simple data pipeline example which demonstrates the use of\n the TaskFlow API using three simple tasks for Extract, Transform, and Load.\n Documentation that goes along with the Airflow TaskFlow API tutorial is\n located\n [here](https://airflow.apache.org/docs/apache-airflow/stable/tutorial_taskflow_api.html)\n ","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"extract":["operator","extract"],"transform":["operator","transform"],"load":["operator","load"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"extract","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Extract task\n A simple Extract task to get data ready for the rest of the data\n pipeline. In this case, getting data is simulated by reading from a\n hardcoded JSON string.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["transform"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_80be3d67c04d66196bdc1c84ece3edeff0f256bd_tutorial_taskflow_api.extract","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"multiple_outputs":true,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"transform","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Transform task\n A simple Transform task which takes in the collection of order data and\n computes the total order value.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["load"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_80be3d67c04d66196bdc1c84ece3edeff0f256bd_tutorial_taskflow_api.transform","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): extract>),)","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"load","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Load task\n A simple Load task which takes in the result of the Transform task and\n instead of saving it to end user review, just prints it out.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_80be3d67c04d66196bdc1c84ece3edeff0f256bd_tutorial_taskflow_api.load","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): transform>, 'total_order_value'),)","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:12 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:12.611+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:12.612+0000] {collection.py:85} INFO - Creating ORM DAG for tutorial_taskflow_api
[2025-01-09T22:15:12.613+0000] {dag.py:2418} INFO - Setting next_dagrun for tutorial_taskflow_api to None, run_after=None
[2025-01-09T22:15:12.623+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG:tutorial_taskflow_api
[2025-01-09T22:15:12.627+0000] {override.py:1807} INFO - Created Permission View: can read on DAG:tutorial_taskflow_api
[2025-01-09T22:15:12.629+0000] {override.py:1807} INFO - Created Permission View: can edit on DAG:tutorial_taskflow_api
[2025-01-09T22:15:12.632+0000] {override.py:1807} INFO - Created Permission View: menu access on DAG Run:tutorial_taskflow_api
[2025-01-09T22:15:12.635+0000] {override.py:1807} INFO - Created Permission View: can delete on DAG Run:tutorial_taskflow_api
[2025-01-09T22:15:12.638+0000] {override.py:1807} INFO - Created Permission View: can read on DAG Run:tutorial_taskflow_api
[2025-01-09T22:15:12.641+0000] {override.py:1807} INFO - Created Permission View: can create on DAG Run:tutorial_taskflow_api
127.0.0.1 - - [09/Jan/2025 22:15:37] "GET /health HTTP/1.1" 200 -
2025-01-09 22:15:37 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/tutorial_objectstorage.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:37 [debug ] Importing /opt/airflow/airflow/example_dags/tutorial_objectstorage.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:37 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_trigger_controller_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:37 [debug ] Importing /opt/airflow/airflow/example_dags/example_trigger_controller_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:37 [debug ] Loaded DAG <DAG: example_trigger_controller_dag> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:37 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_trigger_controller_dag.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_trigger_controller_dag","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_trigger_controller_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.OnceTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"test_trigger_dagrun":["operator","test_trigger_dagrun"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TriggerDagRunOperator","template_ext":[],"task_id":"test_trigger_dagrun","template_fields_renderers":{"conf":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["trigger_dag_id","trigger_run_id","logical_date","conf","wait_for_completion","skip_when_already_exists"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.trigger_dagrun","_is_empty":false,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.operators.trigger_dagrun.TriggerDagRunLink":{}}],"trigger_dag_id":"example_trigger_target_dag","conf":{"message":"Hello World"},"wait_for_completion":false,"skip_when_already_exists":false},"__type":"operator"}],"dag_dependencies":[{"source":"example_trigger_controller_dag","target":"example_trigger_target_dag","dependency_type":"trigger","dependency_id":"test_trigger_dagrun"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:37 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:37.996+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:38.002+0000] {dag.py:2418} INFO - Setting next_dagrun for example_trigger_controller_dag to 2021-01-01 00:00:00+00:00, run_after=2021-01-01 00:00:00+00:00
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: tutorial_objectstorage> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/tutorial_objectstorage.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"tutorial_objectstorage","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/tutorial_objectstorage.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"\n ### Object Storage Tutorial Documentation\n This is a tutorial DAG to showcase the usage of the Object Storage API.\n Documentation that goes along with the Airflow Object Storage tutorial is\n located\n [here](https://airflow.apache.org/docs/apache-airflow/stable/tutorial/objectstorage.html)\n ","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"get_air_quality_data":["operator","get_air_quality_data"],"analyze":["operator","analyze"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"get_air_quality_data","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Get Air Quality Data\n This task gets air quality data from the Finnish Meteorological Institute's\n open data API. The data is saved as parquet.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["analyze"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_2602cd38116f80be795f2eb2d2b89bbea48b4b39_tutorial_objectstorage.get_air_quality_data","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"analyze","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Analyze\n This task analyzes the air quality data, prints the results\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_2602cd38116f80be795f2eb2d2b89bbea48b4b39_tutorial_objectstorage.analyze","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): get_air_quality_data>),)","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:38 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:38.033+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:38.037+0000] {dag.py:2418} INFO - Setting next_dagrun for tutorial_objectstorage to None, run_after=None
2025-01-09 22:15:38 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_sensors.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Importing /opt/airflow/airflow/example_dags/example_sensors.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: example_sensors> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:38 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:38 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:38 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:38 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:38 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_params_ui_tutorial.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_sensors.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_sensors","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_sensors.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"wait_some_seconds":["operator","wait_some_seconds"],"wait_some_seconds_async":["operator","wait_some_seconds_async"],"fire_immediately":["operator","fire_immediately"],"timeout_after_second_date_in_the_future":["operator","timeout_after_second_date_in_the_future"],"fire_immediately_async":["operator","fire_immediately_async"],"timeout_after_second_date_in_the_future_async":["operator","timeout_after_second_date_in_the_future_async"],"Sensor_succeeds":["operator","Sensor_succeeds"],"Sensor_fails_after_3_seconds":["operator","Sensor_fails_after_3_seconds"],"remove_file":["operator","remove_file"],"wait_for_file":["operator","wait_for_file"],"wait_for_file_async":["operator","wait_for_file_async"],"create_file_after_3_seconds":["operator","create_file_after_3_seconds"],"success_sensor_python":["operator","success_sensor_python"],"failure_timeout_sensor_python":["operator","failure_timeout_sensor_python"],"week_day_sensor_failing_on_timeout":["operator","week_day_sensor_failing_on_timeout"],"print_date_in_bash":["operator","print_date_in_bash"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeDeltaSensor","template_ext":[],"task_id":"wait_some_seconds","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time_delta","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeDeltaSensorAsync","template_ext":[],"task_id":"wait_some_seconds_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time_delta","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensor","template_ext":[],"task_id":"fire_immediately","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensor","template_ext":[],"task_id":"timeout_after_second_date_in_the_future","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensorAsync","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.temporal.DateTimeTrigger","trigger_kwargs":{"__var":{"moment":"","end_from_trigger":false},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"fire_immediately_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensorAsync","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.temporal.DateTimeTrigger","trigger_kwargs":{"__var":{"moment":"","end_from_trigger":false},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"timeout_after_second_date_in_the_future_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashSensor","template_ext":[],"task_id":"Sensor_succeeds","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.bash","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"bash_command":"exit 0"},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashSensor","template_ext":[],"task_id":"Sensor_fails_after_3_seconds","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.bash","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"bash_command":"exit 1"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"remove_file","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["wait_for_file"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"rm -rf /tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#91818a","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"FileSensor","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.file.FileTrigger","trigger_kwargs":{"__var":{},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"wait_for_file","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["filepath"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["wait_for_file_async"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.filesystem","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"filepath":"/tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#91818a","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"FileSensor","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.file.FileTrigger","trigger_kwargs":{"__var":{},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"wait_for_file_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["filepath"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.filesystem","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"filepath":"/tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_file_after_3_seconds","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 3; touch /tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonSensor","template_ext":[],"task_id":"success_sensor_python","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8157bb0bc39931d610b49002036b0a741f6799bf_example_sensors.success_callable","_task_module":"airflow.providers.standard.sensors.python","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"op_args":[],"op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonSensor","template_ext":[],"task_id":"failure_timeout_sensor_python","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8157bb0bc39931d610b49002036b0a741f6799bf_example_sensors.failure_callable","_task_module":"airflow.providers.standard.sensors.python","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"op_args":[],"op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"DayOfWeekSensor","template_ext":[],"task_id":"week_day_sensor_failing_on_timeout","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.weekday","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"print_date_in_bash","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"trigger_rule":"none_failed","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"date"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:38 [debug ] Importing /opt/airflow/airflow/example_dags/example_params_ui_tutorial.py [airflow.models.dagbag.DagBag] [task]
[2025-01-09T22:15:38.104+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:38.111+0000] {dag.py:2418} INFO - Setting next_dagrun for example_sensors to None, run_after=None
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: example_params_ui_tutorial> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:15:38 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:38 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_params_ui_tutorial.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_params_ui_tutorial","dag_display_name":"Params UI tutorial","timezone":"UTC","tags":["example","params","ui"],"start_date":1646352000.0,"fileloc":"/opt/airflow/airflow/example_dags/example_params_ui_tutorial.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"DAG demonstrating various options for a trigger form generated by DAG params.\n\nThe DAG attribute `params` is used to define a default dictionary of parameters which are usually passed\nto the DAG and which are used to render a trigger form.\n","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"show_params":["operator","show_params"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"description":"DAG demonstrating various options for a trigger form generated by DAG params","_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"show_params","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"_task_display_name":"Show used parameters","on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"params":[["x",{"__class":"airflow.models.param.Param","default":3,"description":null,"schema":{"__var":{},"__type":"dict"}}],["text",{"__class":"airflow.models.param.Param","default":"Hello World!","description":null,"schema":{"__var":{},"__type":"dict"}}],["flag",{"__class":"airflow.models.param.Param","default":false,"description":null,"schema":{"__var":{},"__type":"dict"}}],["a_simple_list",{"__class":"airflow.models.param.Param","default":["one","two","three","actually one value is made per line"],"description":null,"schema":{"__var":{},"__type":"dict"}}],["most_loved_number",{"__class":"airflow.models.param.Param","default":42,"description":null,"schema":{"__var":{"type":"integer","title":"Your favorite number","description_md":"Everybody should have a **favorite** number. Not only _math teachers_. If you can not think of any at the moment please think of the 42 which is very famous becauseof the book [The Hitchhiker's Guide to the Galaxy](https://en.wikipedia.org/wiki/Phrases_from_The_Hitchhiker%27s_Guide_to_the_Galaxy#The_Answer_to_the_Ultimate_Question_of_Life,_the_Universe,_and_Everything_is_42)."},"__type":"dict"}}],["pick_one",{"__class":"airflow.models.param.Param","default":"value 42","description":"You can use JSON schema enum's to generate drop down selection boxes.","schema":{"__var":{"type":"string","title":"Select one Value","enum":["value 16","value 17","value 18","value 19","value 20","value 21","value 22","value 23","value 24","value 25","value 26","value 27","value 28","value 29","value 30","value 31","value 32","value 33","value 34","value 35","value 36","value 37","value 38","value 39","value 40","value 41","value 42","value 43","value 44","value 45","value 46","value 47","value 48","value 49","value 50","value 51","value 52","value 53","value 54","value 55","value 56","value 57","value 58","value 59","value 60","value 61","value 62","value 63"]},"__type":"dict"}}],["pick_with_label",{"__class":"airflow.models.param.Param","default":3,"description":"With drop down selections you can also have nice display labels for the values.","schema":{"__var":{"type":"number","title":"Select one Number","enum":[1,2,3,4,5,6,7,8,9],"values_display":{"__var":{"1":"One","2":"Two","3":"Three","4":"Four - is like you take three and get one for free!","5":"Five","6":"Six","7":"Seven","8":"Eight","9":"Nine"},"__type":"dict"}},"__type":"dict"}}],["proposals",{"__class":"airflow.models.param.Param","default":"some value","description":"You can use JSON schema examples's to generate drop down selection boxes but allow also to enter custom values. Try typing an 'a' and see options.","schema":{"__var":{"type":"string","title":"Field with proposals","examples":["Alpha","Bravo","Charlie","Delta","Echo","Foxtrot","Golf","Hotel","India","Juliett","Kilo","Lima","Mike","November","Oscar","Papa","Quebec","Romeo","Sierra","Tango","Uniform","Victor","Whiskey","X-ray","Yankee","Zulu"]},"__type":"dict"}}],["multi_select",{"__class":"airflow.models.param.Param","default":["two","three"],"description":"Select from the list of options.","schema":{"__var":{"type":"array","title":"Multi Select","examples":["one","two","three","four","five"]},"__type":"dict"}}],["multi_select_with_label",{"__class":"airflow.models.param.Param","default":["2","3"],"description":"Select from the list of options. See that options can have nicer text and still technical valuesare propagated as values during trigger to the DAG.","schema":{"__var":{"type":"array","title":"Multi Select with Labels","examples":["1","2","3","4","5"],"values_display":{"__var":{"1":"One box of choccolate","2":"Two bananas","3":"Three apples"},"__type":"dict"}},"__type":"dict"}}],["array_of_numbers",{"__class":"airflow.models.param.Param","default":[1,2,3],"description":"Only integers are accepted in this array","schema":{"__var":{"type":"array","title":"Array of numbers","items":{"__var":{"type":"number"},"__type":"dict"}},"__type":"dict"}}],["bool",{"__class":"airflow.models.param.Param","default":true,"description":"A On/Off selection with a proper description.","schema":{"__var":{"type":"boolean","title":"Please confirm"},"__type":"dict"}}],["date_time",{"__class":"airflow.models.param.Param","default":"2025-01-09T12:17:00+00:00","description":"Please select a date and time, use the button on the left for a pop-up calendar.","schema":{"__var":{"type":"string","format":"date-time","title":"Date-Time Picker"},"__type":"dict"}}],["date",{"__class":"airflow.models.param.Param","default":"2025-01-09","description":"Please select a date, use the button on the left for a pop-up calendar. See that here are no times!","schema":{"__var":{"type":"string","format":"date","title":"Date Picker"},"__type":"dict"}}],["time",{"__class":"airflow.models.param.Param","default":"12:13:14","description":"Please select a time, use the button on the left for a pop-up tool.","schema":{"__var":{"type":["string","null"],"format":"time","title":"Time Picker"},"__type":"dict"}}],["multiline_text",{"__class":"airflow.models.param.Param","default":"A multiline text Param\nthat will keep the newline\ncharacters in its value.","description":"This field allows for multiline text input. The returned value will be a single with newline (\\n) characters kept intact.","schema":{"__var":{"type":["string","null"],"format":"multiline"},"__type":"dict"}}],["required_field",{"__class":"airflow.models.param.Param","default":{"__var":null,"__type":"arg_not_set"},"description":"This field is required. You can not submit without having text in here.","schema":{"__var":{"type":"string","title":"Required text field"},"__type":"dict"}}],["optional_field",{"__class":"airflow.models.param.Param","default":"optional text, you can trigger also w/o text","description":null,"schema":{"__var":{"type":["null","string"],"title":"Optional text field","description_md":"This field is optional. As field content is JSON schema validated you must allow the `null` type."},"__type":"dict"}}],["checked_text",{"__class":"airflow.models.param.Param","default":"length-checked-field","description":null,"schema":{"__var":{"type":"string","title":"Text field with length check","description_md":"This field is required. And you need to provide something between 10 and 30\n characters. See the JSON\n [schema description (string)](https://json-schema.org/understanding-json-schema/reference/string.html)\n for more details","minLength":10,"maxLength":20,"section":"JSON Schema validation options"},"__type":"dict"}}],["checked_number",{"__class":"airflow.models.param.Param","default":100,"description":null,"schema":{"__var":{"type":"number","title":"Number field with value check","description_md":"This field is required. You need to provide any number between 64 and 128.\n See the JSON\n [schema description (numbers)](https://json-schema.org/understanding-json-schema/reference/numeric.html)\n for more details","minimum":64,"maximum":128,"section":"JSON Schema validation options"},"__type":"dict"}}],["object",{"__class":"airflow.models.param.Param","default":{"__var":{"key":"value"},"__type":"dict"},"description":null,"schema":{"__var":{"type":["object","null"],"title":"JSON entry field","section":"Special advanced stuff with form fields"},"__type":"dict"}}],["array_of_objects",{"__class":"airflow.models.param.Param","default":[{"__var":{"name":"account_name","country":"country_name"},"__type":"dict"}],"description":null,"schema":{"__var":{"description_md":"Array with complex objects and validation rules. See [JSON Schema validation options in specs](https://json-schema.org/understanding-json-schema/reference/array.html#items).","type":"array","title":"JSON array field","items":{"__var":{"type":"object","properties":{"__var":{"name":{"__var":{"type":"string"},"__type":"dict"},"country_name":{"__var":{"type":"string"},"__type":"dict"}},"__type":"dict"},"required":["name"]},"__type":"dict"},"section":"Special advanced stuff with form fields"},"__type":"dict"}}],["hidden_secret_field",{"__class":"airflow.models.param.Param","default":"constant value","description":null,"schema":{"__var":{"const":"constant value"},"__type":"dict"}}]],"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_44cb27f57d5b198d3a3990eb68b78ee8a1565228_example_params_ui_tutorial.show_params","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[["x",{"__class":"airflow.models.param.Param","default":3,"description":null,"schema":{"__var":{},"__type":"dict"}}],["text",{"__class":"airflow.models.param.Param","default":"Hello World!","description":null,"schema":{"__var":{},"__type":"dict"}}],["flag",{"__class":"airflow.models.param.Param","default":false,"description":null,"schema":{"__var":{},"__type":"dict"}}],["a_simple_list",{"__class":"airflow.models.param.Param","default":["one","two","three","actually one value is made per line"],"description":null,"schema":{"__var":{},"__type":"dict"}}],["most_loved_number",{"__class":"airflow.models.param.Param","default":42,"description":null,"schema":{"__var":{"type":"integer","title":"Your favorite number","description_md":"Everybody should have a **favorite** number. Not only _math teachers_. If you can not think of any at the moment please think of the 42 which is very famous becauseof the book [The Hitchhiker's Guide to the Galaxy](https://en.wikipedia.org/wiki/Phrases_from_The_Hitchhiker%27s_Guide_to_the_Galaxy#The_Answer_to_the_Ultimate_Question_of_Life,_the_Universe,_and_Everything_is_42)."},"__type":"dict"}}],["pick_one",{"__class":"airflow.models.param.Param","default":"value 42","description":"You can use JSON schema enum's to generate drop down selection boxes.","schema":{"__var":{"type":"string","title":"Select one Value","enum":["value 16","value 17","value 18","value 19","value 20","value 21","value 22","value 23","value 24","value 25","value 26","value 27","value 28","value 29","value 30","value 31","value 32","value 33","value 34","value 35","value 36","value 37","value 38","value 39","value 40","value 41","value 42","value 43","value 44","value 45","value 46","value 47","value 48","value 49","value 50","value 51","value 52","value 53","value 54","value 55","value 56","value 57","value 58","value 59","value 60","value 61","value 62","value 63"]},"__type":"dict"}}],["pick_with_label",{"__class":"airflow.models.param.Param","default":3,"description":"With drop down selections you can also have nice display labels for the values.","schema":{"__var":{"type":"number","title":"Select one Number","enum":[1,2,3,4,5,6,7,8,9],"values_display":{"__var":{"1":"One","2":"Two","3":"Three","4":"Four - is like you take three and get one for free!","5":"Five","6":"Six","7":"Seven","8":"Eight","9":"Nine"},"__type":"dict"}},"__type":"dict"}}],["proposals",{"__class":"airflow.models.param.Param","default":"some value","description":"You can use JSON schema examples's to generate drop down selection boxes but allow also to enter custom values. Try typing an 'a' and see options.","schema":{"__var":{"type":"string","title":"Field with proposals","examples":["Alpha","Bravo","Charlie","Delta","Echo","Foxtrot","Golf","Hotel","India","Juliett","Kilo","Lima","Mike","November","Oscar","Papa","Quebec","Romeo","Sierra","Tango","Uniform","Victor","Whiskey","X-ray","Yankee","Zulu"]},"__type":"dict"}}],["multi_select",{"__class":"airflow.models.param.Param","default":["two","three"],"description":"Select from the list of options.","schema":{"__var":{"type":"array","title":"Multi Select","examples":["one","two","three","four","five"]},"__type":"dict"}}],["multi_select_with_label",{"__class":"airflow.models.param.Param","default":["2","3"],"description":"Select from the list of options. See that options can have nicer text and still technical valuesare propagated as values during trigger to the DAG.","schema":{"__var":{"type":"array","title":"Multi Select with Labels","examples":["1","2","3","4","5"],"values_display":{"__var":{"1":"One box of choccolate","2":"Two bananas","3":"Three apples"},"__type":"dict"}},"__type":"dict"}}],["array_of_numbers",{"__class":"airflow.models.param.Param","default":[1,2,3],"description":"Only integers are accepted in this array","schema":{"__var":{"type":"array","title":"Array of numbers","items":{"__var":{"type":"number"},"__type":"dict"}},"__type":"dict"}}],["bool",{"__class":"airflow.models.param.Param","default":true,"description":"A On/Off selection with a proper description.","schema":{"__var":{"type":"boolean","title":"Please confirm"},"__type":"dict"}}],["date_time",{"__class":"airflow.models.param.Param","default":"2025-01-09T12:17:00+00:00","description":"Please select a date and time, use the button on the left for a pop-up calendar.","schema":{"__var":{"type":"string","format":"date-time","title":"Date-Time Picker"},"__type":"dict"}}],["date",{"__class":"airflow.models.param.Param","default":"2025-01-09","description":"Please select a date, use the button on the left for a pop-up calendar. See that here are no times!","schema":{"__var":{"type":"string","format":"date","title":"Date Picker"},"__type":"dict"}}],["time",{"__class":"airflow.models.param.Param","default":"12:13:14","description":"Please select a time, use the button on the left for a pop-up tool.","schema":{"__var":{"type":["string","null"],"format":"time","title":"Time Picker"},"__type":"dict"}}],["multiline_text",{"__class":"airflow.models.param.Param","default":"A multiline text Param\nthat will keep the newline\ncharacters in its value.","description":"This field allows for multiline text input. The returned value will be a single with newline (\\n) characters kept intact.","schema":{"__var":{"type":["string","null"],"format":"multiline"},"__type":"dict"}}],["required_field",{"__class":"airflow.models.param.Param","default":{"__var":null,"__type":"arg_not_set"},"description":"This field is required. You can not submit without having text in here.","schema":{"__var":{"type":"string","title":"Required text field"},"__type":"dict"}}],["optional_field",{"__class":"airflow.models.param.Param","default":"optional text, you can trigger also w/o text","description":null,"schema":{"__var":{"type":["null","string"],"title":"Optional text field","description_md":"This field is optional. As field content is JSON schema validated you must allow the `null` type."},"__type":"dict"}}],["checked_text",{"__class":"airflow.models.param.Param","default":"length-checked-field","description":null,"schema":{"__var":{"type":"string","title":"Text field with length check","description_md":"This field is required. And you need to provide something between 10 and 30\n characters. See the JSON\n [schema description (string)](https://json-schema.org/understanding-json-schema/reference/string.html)\n for more details","minLength":10,"maxLength":20,"section":"JSON Schema validation options"},"__type":"dict"}}],["checked_number",{"__class":"airflow.models.param.Param","default":100,"description":null,"schema":{"__var":{"type":"number","title":"Number field with value check","description_md":"This field is required. You need to provide any number between 64 and 128.\n See the JSON\n [schema description (numbers)](https://json-schema.org/understanding-json-schema/reference/numeric.html)\n for more details","minimum":64,"maximum":128,"section":"JSON Schema validation options"},"__type":"dict"}}],["object",{"__class":"airflow.models.param.Param","default":{"__var":{"key":"value"},"__type":"dict"},"description":null,"schema":{"__var":{"type":["object","null"],"title":"JSON entry field","section":"Special advanced stuff with form fields"},"__type":"dict"}}],["array_of_objects",{"__class":"airflow.models.param.Param","default":[{"__var":{"name":"account_name","country":"country_name"},"__type":"dict"}],"description":null,"schema":{"__var":{"description_md":"Array with complex objects and validation rules. See [JSON Schema validation options in specs](https://json-schema.org/understanding-json-schema/reference/array.html#items).","type":"array","title":"JSON array field","items":{"__var":{"type":"object","properties":{"__var":{"name":{"__var":{"type":"string"},"__type":"dict"},"country_name":{"__var":{"type":"string"},"__type":"dict"}},"__type":"dict"},"required":["name"]},"__type":"dict"},"section":"Special advanced stuff with form fields"},"__type":"dict"}}],["hidden_secret_field",{"__class":"airflow.models.param.Param","default":"constant value","description":null,"schema":{"__var":{"const":"constant value"},"__type":"dict"}}]]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:38.162+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:38.168+0000] {dag.py:2418} INFO - Setting next_dagrun for example_params_ui_tutorial to None, run_after=None
2025-01-09 22:15:38 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Importing /opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: latest_only_with_trigger> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:38 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"latest_only_with_trigger","timezone":"UTC","tags":["example3"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.DeltaDataIntervalTimetable","__var":{"delta":14400.0}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"latest_only":["operator","latest_only"],"task1":["operator","task1"],"task2":["operator","task2"],"task3":["operator","task3"],"task4":["operator","task4"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e9ffdb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"LatestOnlyOperator","template_ext":[],"task_id":"latest_only","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task1"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.latest_only","_is_empty":false,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task3","task4"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task3","task4"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task4","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"all_done","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:38.200+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:38.206+0000] {dag.py:2418} INFO - Setting next_dagrun for latest_only_with_trigger to 2025-01-09 16:00:00+00:00, run_after=2025-01-09 20:00:00+00:00
2025-01-09 22:15:38 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_outlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Importing /opt/airflow/airflow/example_dags/example_outlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_latest_only.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Importing /opt/airflow/airflow/example_dags/example_latest_only.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: asset_with_extra_by_yield> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: asset_with_extra_by_context> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: asset_with_extra_from_classic_operator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_with_extra_by_yield","timezone":"UTC","tags":["produces"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"asset_with_extra_by_yield":["operator","asset_with_extra_by_yield"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"asset_with_extra_by_yield","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"test-asset","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_f06f1ad2457a51bd0234f46fd69f068d5815c10b_example_outlet_event_extra.asset_with_extra_by_yield","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset_with_extra_by_yield","target":"asset","dependency_type":"asset","dependency_id":"test-asset"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_with_extra_by_context","timezone":"UTC","tags":["produces"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"asset_with_extra_by_context":["operator","asset_with_extra_by_context"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"asset_with_extra_by_context","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"test-asset","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_f06f1ad2457a51bd0234f46fd69f068d5815c10b_example_outlet_event_extra.asset_with_extra_by_context","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset_with_extra_by_context","target":"asset","dependency_type":"asset","dependency_id":"test-asset"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_with_extra_from_classic_operator","timezone":"UTC","tags":["produces"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"asset_with_extra_from_classic_operator":["operator","asset_with_extra_from_classic_operator"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"asset_with_extra_from_classic_operator","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"test-asset","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":":"},"__type":"operator"}],"dag_dependencies":[{"source":"asset_with_extra_from_classic_operator","target":"asset","dependency_type":"asset","dependency_id":"test-asset"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:38 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:38.454+0000] {dag.py:1861} INFO - Sync 3 DAGs
[2025-01-09T22:15:38.464+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_with_extra_by_context to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:38.467+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_with_extra_by_yield to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:38.471+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_with_extra_from_classic_operator to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
2025-01-09 22:15:38 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: latest_only> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"latest_only","timezone":"UTC","tags":["example2","example3"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.DeltaDataIntervalTimetable","__var":{"delta":14400.0}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"latest_only":["operator","latest_only"],"task1":["operator","task1"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e9ffdb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"LatestOnlyOperator","template_ext":[],"task_id":"latest_only","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task1"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.latest_only","_is_empty":false,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:38.509+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:38.516+0000] {dag.py:2418} INFO - Setting next_dagrun for latest_only to 2025-01-09 16:00:00+00:00, run_after=2025-01-09 20:00:00+00:00
2025-01-09 22:15:38 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_inlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Importing /opt/airflow/airflow/example_dags/example_inlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: read_asset_event_from_classic> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: read_asset_event> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_inlet_event_extra.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"read_asset_event_from_classic","timezone":"UTC","tags":["consumes"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_inlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"read_asset_event_from_classic":["operator","read_asset_event_from_classic"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"read_asset_event_from_classic","template_fields_renderers":{"bash_command":"bash","env":"json"},"inlets":[{"__var":{"name":"s3://output/1.txt","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo '{{ inlet_events['s3://output/1.txt'][-1].extra | tojson }}'"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"read_asset_event","timezone":"UTC","tags":["consumes"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_inlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"read_asset_event":["operator","read_asset_event"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"read_asset_event","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"inlets":[{"__var":{"name":"s3://output/1.txt","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_97c8ee958e8f6968fd91b9366ca9be7043a80f60_example_inlet_event_extra.read_asset_event","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:38 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_external_task_marker_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Importing /opt/airflow/airflow/example_dags/example_external_task_marker_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: example_external_task_marker_child> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: example_external_task_marker_parent> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:38.766+0000] {dag.py:1861} INFO - Sync 2 DAGs
[2025-01-09T22:15:38.775+0000] {dag.py:2418} INFO - Setting next_dagrun for read_asset_event to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:38.778+0000] {dag.py:2418} INFO - Setting next_dagrun for read_asset_event_from_classic to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
2025-01-09 22:15:38 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:38 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_external_task_marker_dag.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_external_task_marker_child","timezone":"UTC","tags":["example2"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_external_task_marker_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"child_task1":["operator","child_task1"],"child_task2":["operator","child_task2"],"child_task3":["operator","child_task3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#4db7db","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalTaskSensor","template_ext":[],"task_id":"child_task1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["external_dag_id","external_task_id","external_task_ids","external_task_group_id"],"_needs_expansion":false,"is_teardown":false,"reschedule":true,"downstream_task_ids":["child_task2"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.external_task","_is_empty":false,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.sensors.external_task.ExternalDagLink":{}}],"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"external_dag_id":"example_external_task_marker_parent","external_task_id":"parent_task","external_task_ids":["parent_task"]},"__type":"operator"},{"__var":{"ui_color":"#4db7db","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalTaskSensor","template_ext":[],"task_id":"child_task2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["external_dag_id","external_task_id","external_task_ids","external_task_group_id"],"_needs_expansion":false,"is_teardown":false,"reschedule":true,"downstream_task_ids":["child_task3"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.external_task","_is_empty":false,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.sensors.external_task.ExternalDagLink":{}}],"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"external_dag_id":"example_external_task_marker_parent","external_task_group_id":"parent_dag_task_group_id"},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"child_task3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[{"source":"example_external_task_marker_parent","target":"example_external_task_marker_child","dependency_type":"sensor","dependency_id":"child_task1"},{"source":"example_external_task_marker_parent","target":"example_external_task_marker_child","dependency_type":"sensor","dependency_id":"child_task2"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_external_task_marker_parent","timezone":"UTC","tags":["example2"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_external_task_marker_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"parent_task":["operator","parent_task"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#4db7db","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalTaskMarker","template_ext":[],"recursion_depth":10,"task_id":"parent_task","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["external_dag_id","external_task_id","logical_date"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.external_task","_is_empty":true,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.sensors.external_task.ExternalDagLink":{}}],"external_dag_id":"example_external_task_marker_child","external_task_id":"child_task1","logical_date":"{{ logical_date.isoformat() }}"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:38.810+0000] {dag.py:1861} INFO - Sync 2 DAGs
[2025-01-09T22:15:38.816+0000] {dag.py:2418} INFO - Setting next_dagrun for example_external_task_marker_child to None, run_after=None
[2025-01-09T22:15:38.818+0000] {dag.py:2418} INFO - Setting next_dagrun for example_external_task_marker_parent to None, run_after=None
2025-01-09 22:15:38 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_assets.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Importing /opt/airflow/airflow/example_dags/example_assets.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: asset_consumes_1_never_scheduled> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: consume_1_or_both_2_and_3_with_asset_expressions> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: conditional_asset_and_time_based_timetable> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: consume_1_and_2_with_asset_expressions> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: asset_consumes_unknown_never_scheduled> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: asset_consumes_1> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: asset_produces_2> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: consume_1_or_2_with_asset_expressions> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: asset_produces_1> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Loaded DAG <DAG: asset_consumes_1_and_2> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:38 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:15:38 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_1_never_scheduled","timezone":"UTC","tags":["asset-scheduled","consumes"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://unrelated/this-asset-doesnt-get-triggered","uri":"s3://unrelated/this-asset-doesnt-get-triggered","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consuming_3":["operator","consuming_3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consuming_3","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_1_never_scheduled","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"asset_consumes_1_never_scheduled","dependency_type":"asset","dependency_id":"s3://unrelated/this-asset-doesnt-get-triggered"},{"source":"asset_consumes_1_never_scheduled","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"consume_1_or_both_2_and_3_with_asset_expressions","timezone":"UTC","tags":[],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_any","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag3/output_3.txt","uri":"s3://dag3/output_3.txt","group":"asset","extra":{"hi":"bye"}}]}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_1_or_both_2_and_3_with_asset_expressions":["operator","consume_1_or_both_2_and_3_with_asset_expressions"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consume_1_or_both_2_and_3_with_asset_expressions","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"consume_1_or_both_2_and_3_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"consume_1_or_both_2_and_3_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"asset","target":"consume_1_or_both_2_and_3_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag3/output_3.txt"},{"source":"consume_1_or_both_2_and_3_with_asset_expressions","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"conditional_asset_and_time_based_timetable","timezone":"UTC","tags":["asset-time-based-timetable"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.assets.AssetOrTimeSchedule","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]},"timetable":{"__type":"airflow.timetables.trigger.CronTriggerTimetable","__var":{"expression":"0 1 * * 3","timezone":"UTC","interval":0.0,"run_immediately":false}}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"conditional_asset_and_time_based_timetable":["operator","conditional_asset_and_time_based_timetable"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"conditional_asset_and_time_based_timetable","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://asset_time_based/asset_other_unknown.txt","uri":"s3://asset_time_based/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"conditional_asset_and_time_based_timetable","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"conditional_asset_and_time_based_timetable","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"conditional_asset_and_time_based_timetable","target":"asset","dependency_type":"asset","dependency_id":"s3://asset_time_based/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"consume_1_and_2_with_asset_expressions","timezone":"UTC","tags":[],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_1_and_2_with_asset_expressions":["operator","consume_1_and_2_with_asset_expressions"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consume_1_and_2_with_asset_expressions","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"consume_1_and_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"consume_1_and_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"consume_1_and_2_with_asset_expressions","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_unknown_never_scheduled","timezone":"UTC","tags":["asset-scheduled"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://unrelated/asset3.txt","uri":"s3://unrelated/asset3.txt","group":"asset","extra":{}},{"__type":"asset","name":"s3://unrelated/asset_other_unknown.txt","uri":"s3://unrelated/asset_other_unknown.txt","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"unrelated_task":["operator","unrelated_task"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"unrelated_task","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://unrelated_task/asset_other_unknown.txt","uri":"s3://unrelated_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_unknown_never_scheduled","dependency_type":"asset","dependency_id":"s3://unrelated/asset3.txt"},{"source":"asset","target":"asset_consumes_unknown_never_scheduled","dependency_type":"asset","dependency_id":"s3://unrelated/asset_other_unknown.txt"},{"source":"asset_consumes_unknown_never_scheduled","target":"asset","dependency_type":"asset","dependency_id":"s3://unrelated_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_1","timezone":"UTC","tags":["asset-scheduled","consumes"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consuming_1":["operator","consuming_1"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consuming_1","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_1_task/asset_other.txt","uri":"s3://consuming_1_task/asset_other.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_1","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset_consumes_1","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_1_task/asset_other.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_produces_2","timezone":"UTC","tags":["asset-scheduled","produces"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"producing_task_2":["operator","producing_task_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"producing_task_2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset_produces_2","target":"asset","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"consume_1_or_2_with_asset_expressions","timezone":"UTC","tags":[],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_any","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_1_or_2_with_asset_expressions":["operator","consume_1_or_2_with_asset_expressions"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consume_1_or_2_with_asset_expressions","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"consume_1_or_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"consume_1_or_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"consume_1_or_2_with_asset_expressions","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_produces_1","timezone":"UTC","tags":["asset-scheduled","produces"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"producing_task_1":["operator","producing_task_1"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"producing_task_1","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset_produces_1","target":"asset","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_1_and_2","timezone":"UTC","tags":["asset-scheduled","consumes"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consuming_2":["operator","consuming_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consuming_2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_1_and_2","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"asset_consumes_1_and_2","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"asset_consumes_1_and_2","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:15:38.930+0000] {dag.py:1861} INFO - Sync 10 DAGs
[2025-01-09T22:15:38.939+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_1 to None, run_after=None
[2025-01-09T22:15:38.941+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_1_and_2 to None, run_after=None
[2025-01-09T22:15:38.942+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_1_never_scheduled to None, run_after=None
[2025-01-09T22:15:38.944+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_unknown_never_scheduled to None, run_after=None
[2025-01-09T22:15:38.946+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_produces_1 to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:15:38.948+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_produces_2 to None, run_after=None
[2025-01-09T22:15:38.950+0000] {dag.py:2418} INFO - Setting next_dagrun for conditional_asset_and_time_based_timetable to 2025-01-08 01:00:00+00:00, run_after=2025-01-08 01:00:00+00:00
[2025-01-09T22:15:38.953+0000] {dag.py:2418} INFO - Setting next_dagrun for consume_1_and_2_with_asset_expressions to None, run_after=None
[2025-01-09T22:15:38.954+0000] {dag.py:2418} INFO - Setting next_dagrun for consume_1_or_2_with_asset_expressions to None, run_after=None
[2025-01-09T22:15:38.956+0000] {dag.py:2418} INFO - Setting next_dagrun for consume_1_or_both_2_and_3_with_asset_expressions to None, run_after=None
2025-01-09 22:15:39 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Importing /opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Loaded DAG <DAG: example_branch_dop_operator_v3> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_branch_dop_operator_v3","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"*/1 * * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"should_run":["operator","should_run"],"empty_task_1":["operator","empty_task_1"],"empty_task_2":["operator","empty_task_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"default_args":{"__var":{"depends_on_past":true},"__type":"dict"},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BranchPythonDecoratedOperator","template_ext":[],"task_id":"should_run","depends_on_past":true,"template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n Determine which empty_task should be run based on if the logical date minute is even or odd.\n\n :param dict kwargs: Context\n :return: Id of the task to run\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["empty_task_1","empty_task_2"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_fd80fe6ebb99ee119311efc72db973227162960a_example_branch_python_dop_operator_3.should_run","_task_module":"airflow.decorators.branch_python","_operator_name":"@task.branch","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"empty_task_1","depends_on_past":true,"template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"empty_task_2","depends_on_past":true,"template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:39 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_asset_with_watchers.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Importing /opt/airflow/airflow/example_dags/example_asset_with_watchers.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:39.059+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:15:39.071+0000] {dag.py:2418} INFO - Setting next_dagrun for example_branch_dop_operator_v3 to 2025-01-09 22:14:00+00:00, run_after=2025-01-09 22:15:00+00:00
2025-01-09 22:15:39 [debug ] Loaded DAG <DAG: example_asset_with_watchers> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Loaded DAG <DAG: example_create_file> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_asset_with_watchers.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_asset_with_watchers","timezone":"UTC","tags":[],"fileloc":"/opt/airflow/airflow/example_dags/example_asset_with_watchers.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"example_asset","uri":"example_asset","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"delete_file":["operator","delete_file"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"delete_file","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_7b99e56f49be0452f4f9715d58326bb6ec761a8a_example_asset_with_watchers.delete_file","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"example_asset_with_watchers","dependency_type":"asset","dependency_id":"example_asset"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_create_file","timezone":"UTC","tags":[],"fileloc":"/opt/airflow/airflow/example_dags/example_asset_with_watchers.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"create_file":["operator","create_file"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"create_file","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_7b99e56f49be0452f4f9715d58326bb6ec761a8a_example_asset_with_watchers.create_file","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:15:39 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:15:39.104+0000] {dag.py:1861} INFO - Sync 2 DAGs
[2025-01-09T22:15:39.110+0000] {dag.py:2418} INFO - Setting next_dagrun for example_asset_with_watchers to None, run_after=None
[2025-01-09T22:15:39.111+0000] {dag.py:2418} INFO - Setting next_dagrun for example_create_file to None, run_after=None
2025-01-09 22:15:39 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_asset_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Importing /opt/airflow/airflow/example_dags/example_asset_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Loaded DAG <DAG: asset1_producer> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Loaded DAG <DAG: consumes_asset_decorator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Loaded DAG <DAG: asset2_producer> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Importing /opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Loaded DAG <DAG: asset_alias_example_alias_consumer_with_no_taskflow> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:15:39 [debug ] Loaded DAG <DAG: asset_s3_bucket_producer_with_no_taskflow> [airflow.models.dagbag.DagBag] [task]
Process ForkProcess-3:
Traceback (most recent call last):
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1094, in _commit_impl
self.engine.dialect.do_commit(self.connection)
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 686, in do_commit
dbapi_connection.commit()
psycopg2.DatabaseError: error with status PGRES_TUPLES_OK and no message from the libpq
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
self.run()
File "/usr/local/lib/python3.9/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "/opt/airflow/airflow/dag_processing/manager.py", line 195, in _run_processor_manager
processor_manager.run()
File "/opt/airflow/airflow/dag_processing/manager.py", line 411, in run
return self._run_parsing_loop()
File "/opt/airflow/airflow/dag_processing/manager.py", line 486, in _run_parsing_loop
self._refresh_dag_bundles()
File "/opt/airflow/airflow/dag_processing/manager.py", line 667, in _refresh_dag_bundles
continue
File "/usr/local/lib/python3.9/contextlib.py", line 126, in __exit__
next(self.gen)
File "/opt/airflow/airflow/utils/session.py", line 43, in create_session
session.commit()
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 1454, in commit
self._transaction.commit(_to_root=self.future)
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 839, in commit
trans.commit()
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2469, in commit
self._do_commit()
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2659, in _do_commit
self._connection_commit_impl()
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2630, in _connection_commit_impl
self.connection._commit_impl()
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1096, in _commit_impl
self._handle_dbapi_exception(e, None, None, None, None)
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 2134, in _handle_dbapi_exception
util.raise_(
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/util/compat.py", line 211, in raise_
raise exception
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/base.py", line 1094, in _commit_impl
self.engine.dialect.do_commit(self.connection)
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/default.py", line 686, in do_commit
dbapi_connection.commit()
sqlalchemy.exc.DatabaseError: (psycopg2.DatabaseError) error with status PGRES_TUPLES_OK and no message from the libpq
(Background on this error at: https://sqlalche.me/e/14/4xp6)
[2025-01-09T22:15:39.785+0000] {manager.py:224} WARNING - DagFileProcessorManager (PID=71) exited with exit code 1 - re-launching
[2025-01-09T22:15:39.788+0000] {manager.py:169} INFO - Launched DagFileProcessorManager with pid: 230
[2025-01-09T22:15:39.799+0000] {settings.py:63} INFO - Configured default timezone UTC
127.0.0.1 - - [09/Jan/2025 22:16:07] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:16:37] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:17:07] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:17:37] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:18:08] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:18:38] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:19:08] "GET /health HTTP/1.1" 200 -
127.0.0.1 - - [09/Jan/2025 22:19:38] "GET /health HTTP/1.1" 200 -
[2025-01-09T22:20:06.267+0000] {scheduler_job_runner.py:1942} INFO - Adopting or resetting orphaned tasks for active dag runs
2025-01-09 22:20:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/tutorial_objectstorage.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Importing /opt/airflow/airflow/example_dags/tutorial_objectstorage.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_trigger_controller_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_trigger_controller_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Loaded DAG <DAG: example_trigger_controller_dag> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_trigger_controller_dag.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_trigger_controller_dag","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_trigger_controller_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.OnceTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"test_trigger_dagrun":["operator","test_trigger_dagrun"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TriggerDagRunOperator","template_ext":[],"task_id":"test_trigger_dagrun","template_fields_renderers":{"conf":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["trigger_dag_id","trigger_run_id","logical_date","conf","wait_for_completion","skip_when_already_exists"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.trigger_dagrun","_is_empty":false,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.operators.trigger_dagrun.TriggerDagRunLink":{}}],"trigger_dag_id":"example_trigger_target_dag","conf":{"message":"Hello World"},"wait_for_completion":false,"skip_when_already_exists":false},"__type":"operator"}],"dag_dependencies":[{"source":"example_trigger_controller_dag","target":"example_trigger_target_dag","dependency_type":"trigger","dependency_id":"test_trigger_dagrun"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:20:08 [debug ] Loaded DAG <DAG: tutorial_objectstorage> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:20:08.112+0000] {dag.py:1861} INFO - Sync 1 DAGs
127.0.0.1 - - [09/Jan/2025 22:20:08] "GET /health HTTP/1.1" 200 -
[2025-01-09T22:20:08.759+0000] {dag.py:2418} INFO - Setting next_dagrun for example_trigger_controller_dag to 2021-01-01 00:00:00+00:00, run_after=2021-01-01 00:00:00+00:00
2025-01-09 22:20:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/tutorial_objectstorage.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"tutorial_objectstorage","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/tutorial_objectstorage.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"\n ### Object Storage Tutorial Documentation\n This is a tutorial DAG to showcase the usage of the Object Storage API.\n Documentation that goes along with the Airflow Object Storage tutorial is\n located\n [here](https://airflow.apache.org/docs/apache-airflow/stable/tutorial/objectstorage.html)\n ","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"get_air_quality_data":["operator","get_air_quality_data"],"analyze":["operator","analyze"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"get_air_quality_data","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Get Air Quality Data\n This task gets air quality data from the Finnish Meteorological Institute's\n open data API. The data is saved as parquet.\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["analyze"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_2602cd38116f80be795f2eb2d2b89bbea48b4b39_tutorial_objectstorage.get_air_quality_data","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"analyze","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n #### Analyze\n This task analyzes the air quality data, prints the results\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_2602cd38116f80be795f2eb2d2b89bbea48b4b39_tutorial_objectstorage.analyze","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"(XComArg(<Task(_PythonDecoratedOperator): get_air_quality_data>),)","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:20:08 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:20:08.797+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:20:08.802+0000] {dag.py:2418} INFO - Setting next_dagrun for tutorial_objectstorage to None, run_after=None
2025-01-09 22:20:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_sensors.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_sensors.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Loaded DAG <DAG: example_sensors> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Plugins are already loaded. Skipping. [airflow.plugins_manager] [task]
2025-01-09 22:20:08 [debug ] Initialize custom taskinstance deps plugins [airflow.plugins_manager] [task]
2025-01-09 22:20:08 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:20:08 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:20:08 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:20:08 [debug ] Cast type <class 'airflow.triggers.base.StartTriggerArgs'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:20:08 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:20:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_sensors.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_sensors","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_sensors.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"wait_some_seconds":["operator","wait_some_seconds"],"wait_some_seconds_async":["operator","wait_some_seconds_async"],"fire_immediately":["operator","fire_immediately"],"timeout_after_second_date_in_the_future":["operator","timeout_after_second_date_in_the_future"],"fire_immediately_async":["operator","fire_immediately_async"],"timeout_after_second_date_in_the_future_async":["operator","timeout_after_second_date_in_the_future_async"],"Sensor_succeeds":["operator","Sensor_succeeds"],"Sensor_fails_after_3_seconds":["operator","Sensor_fails_after_3_seconds"],"remove_file":["operator","remove_file"],"wait_for_file":["operator","wait_for_file"],"wait_for_file_async":["operator","wait_for_file_async"],"create_file_after_3_seconds":["operator","create_file_after_3_seconds"],"success_sensor_python":["operator","success_sensor_python"],"failure_timeout_sensor_python":["operator","failure_timeout_sensor_python"],"week_day_sensor_failing_on_timeout":["operator","week_day_sensor_failing_on_timeout"],"print_date_in_bash":["operator","print_date_in_bash"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeDeltaSensor","template_ext":[],"task_id":"wait_some_seconds","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time_delta","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeDeltaSensorAsync","template_ext":[],"task_id":"wait_some_seconds_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time_delta","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensor","template_ext":[],"task_id":"fire_immediately","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensor","template_ext":[],"task_id":"timeout_after_second_date_in_the_future","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensorAsync","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.temporal.DateTimeTrigger","trigger_kwargs":{"__var":{"moment":"","end_from_trigger":false},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"fire_immediately_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"TimeSensorAsync","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.temporal.DateTimeTrigger","trigger_kwargs":{"__var":{"moment":"","end_from_trigger":false},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"timeout_after_second_date_in_the_future_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.time","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashSensor","template_ext":[],"task_id":"Sensor_succeeds","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.bash","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"bash_command":"exit 0"},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashSensor","template_ext":[],"task_id":"Sensor_fails_after_3_seconds","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.bash","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"bash_command":"exit 1"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"remove_file","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["wait_for_file"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"rm -rf /tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#91818a","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"FileSensor","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.file.FileTrigger","trigger_kwargs":{"__var":{},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"wait_for_file","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["filepath"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["wait_for_file_async"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.filesystem","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"filepath":"/tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#91818a","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"FileSensor","start_trigger_args":{"__type":"START_TRIGGER_ARGS","trigger_cls":"airflow.providers.standard.triggers.file.FileTrigger","trigger_kwargs":{"__var":{},"__type":"dict"},"next_method":"execute_complete","next_kwargs":null,"timeout":null},"template_ext":[],"task_id":"wait_for_file_async","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["filepath"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.filesystem","_is_empty":false,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"filepath":"/tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"create_file_after_3_seconds","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 3; touch /tmp/temporary_file_for_testing"},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonSensor","template_ext":[],"task_id":"success_sensor_python","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8157bb0bc39931d610b49002036b0a741f6799bf_example_sensors.success_callable","_task_module":"airflow.providers.standard.sensors.python","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"op_args":[],"op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"PythonSensor","template_ext":[],"task_id":"failure_timeout_sensor_python","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_8157bb0bc39931d610b49002036b0a741f6799bf_example_sensors.failure_callable","_task_module":"airflow.providers.standard.sensors.python","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"op_args":[],"op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e6f1f2","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"DayOfWeekSensor","template_ext":[],"task_id":"week_day_sensor_failing_on_timeout","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"reschedule":false,"downstream_task_ids":["print_date_in_bash"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.weekday","_is_empty":false,"start_trigger_args":null,"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"]},"__type":"operator"},{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"print_date_in_bash","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"trigger_rule":"none_failed","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"date"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:20:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_params_ui_tutorial.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_params_ui_tutorial.py [airflow.models.dagbag.DagBag] [task]
[2025-01-09T22:20:08.875+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:20:08.883+0000] {dag.py:2418} INFO - Setting next_dagrun for example_sensors to None, run_after=None
2025-01-09 22:20:08 [debug ] Loaded DAG <DAG: example_params_ui_tutorial> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Cast type <class 'airflow.models.param.ParamsDict'> to str in serialization. [airflow.serialization.serialized_objects] [task]
2025-01-09 22:20:08 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:20:08 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_params_ui_tutorial.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_params_ui_tutorial","dag_display_name":"Params UI tutorial","timezone":"UTC","tags":["example","params","ui"],"start_date":1646352000.0,"fileloc":"/opt/airflow/airflow/example_dags/example_params_ui_tutorial.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"doc_md":"DAG demonstrating various options for a trigger form generated by DAG params.\n\nThe DAG attribute `params` is used to define a default dictionary of parameters which are usually passed\nto the DAG and which are used to render a trigger form.\n","task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"show_params":["operator","show_params"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"description":"DAG demonstrating various options for a trigger form generated by DAG params","_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"show_params","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"_task_display_name":"Show used parameters","on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"params":[["x",{"__class":"airflow.models.param.Param","default":3,"description":null,"schema":{"__var":{},"__type":"dict"}}],["text",{"__class":"airflow.models.param.Param","default":"Hello World!","description":null,"schema":{"__var":{},"__type":"dict"}}],["flag",{"__class":"airflow.models.param.Param","default":false,"description":null,"schema":{"__var":{},"__type":"dict"}}],["a_simple_list",{"__class":"airflow.models.param.Param","default":["one","two","three","actually one value is made per line"],"description":null,"schema":{"__var":{},"__type":"dict"}}],["most_loved_number",{"__class":"airflow.models.param.Param","default":42,"description":null,"schema":{"__var":{"type":"integer","title":"Your favorite number","description_md":"Everybody should have a **favorite** number. Not only _math teachers_. If you can not think of any at the moment please think of the 42 which is very famous becauseof the book [The Hitchhiker's Guide to the Galaxy](https://en.wikipedia.org/wiki/Phrases_from_The_Hitchhiker%27s_Guide_to_the_Galaxy#The_Answer_to_the_Ultimate_Question_of_Life,_the_Universe,_and_Everything_is_42)."},"__type":"dict"}}],["pick_one",{"__class":"airflow.models.param.Param","default":"value 42","description":"You can use JSON schema enum's to generate drop down selection boxes.","schema":{"__var":{"type":"string","title":"Select one Value","enum":["value 16","value 17","value 18","value 19","value 20","value 21","value 22","value 23","value 24","value 25","value 26","value 27","value 28","value 29","value 30","value 31","value 32","value 33","value 34","value 35","value 36","value 37","value 38","value 39","value 40","value 41","value 42","value 43","value 44","value 45","value 46","value 47","value 48","value 49","value 50","value 51","value 52","value 53","value 54","value 55","value 56","value 57","value 58","value 59","value 60","value 61","value 62","value 63"]},"__type":"dict"}}],["pick_with_label",{"__class":"airflow.models.param.Param","default":3,"description":"With drop down selections you can also have nice display labels for the values.","schema":{"__var":{"type":"number","title":"Select one Number","enum":[1,2,3,4,5,6,7,8,9],"values_display":{"__var":{"1":"One","2":"Two","3":"Three","4":"Four - is like you take three and get one for free!","5":"Five","6":"Six","7":"Seven","8":"Eight","9":"Nine"},"__type":"dict"}},"__type":"dict"}}],["proposals",{"__class":"airflow.models.param.Param","default":"some value","description":"You can use JSON schema examples's to generate drop down selection boxes but allow also to enter custom values. Try typing an 'a' and see options.","schema":{"__var":{"type":"string","title":"Field with proposals","examples":["Alpha","Bravo","Charlie","Delta","Echo","Foxtrot","Golf","Hotel","India","Juliett","Kilo","Lima","Mike","November","Oscar","Papa","Quebec","Romeo","Sierra","Tango","Uniform","Victor","Whiskey","X-ray","Yankee","Zulu"]},"__type":"dict"}}],["multi_select",{"__class":"airflow.models.param.Param","default":["two","three"],"description":"Select from the list of options.","schema":{"__var":{"type":"array","title":"Multi Select","examples":["one","two","three","four","five"]},"__type":"dict"}}],["multi_select_with_label",{"__class":"airflow.models.param.Param","default":["2","3"],"description":"Select from the list of options. See that options can have nicer text and still technical valuesare propagated as values during trigger to the DAG.","schema":{"__var":{"type":"array","title":"Multi Select with Labels","examples":["1","2","3","4","5"],"values_display":{"__var":{"1":"One box of choccolate","2":"Two bananas","3":"Three apples"},"__type":"dict"}},"__type":"dict"}}],["array_of_numbers",{"__class":"airflow.models.param.Param","default":[1,2,3],"description":"Only integers are accepted in this array","schema":{"__var":{"type":"array","title":"Array of numbers","items":{"__var":{"type":"number"},"__type":"dict"}},"__type":"dict"}}],["bool",{"__class":"airflow.models.param.Param","default":true,"description":"A On/Off selection with a proper description.","schema":{"__var":{"type":"boolean","title":"Please confirm"},"__type":"dict"}}],["date_time",{"__class":"airflow.models.param.Param","default":"2025-01-09T12:17:00+00:00","description":"Please select a date and time, use the button on the left for a pop-up calendar.","schema":{"__var":{"type":"string","format":"date-time","title":"Date-Time Picker"},"__type":"dict"}}],["date",{"__class":"airflow.models.param.Param","default":"2025-01-09","description":"Please select a date, use the button on the left for a pop-up calendar. See that here are no times!","schema":{"__var":{"type":"string","format":"date","title":"Date Picker"},"__type":"dict"}}],["time",{"__class":"airflow.models.param.Param","default":"12:13:14","description":"Please select a time, use the button on the left for a pop-up tool.","schema":{"__var":{"type":["string","null"],"format":"time","title":"Time Picker"},"__type":"dict"}}],["multiline_text",{"__class":"airflow.models.param.Param","default":"A multiline text Param\nthat will keep the newline\ncharacters in its value.","description":"This field allows for multiline text input. The returned value will be a single with newline (\\n) characters kept intact.","schema":{"__var":{"type":["string","null"],"format":"multiline"},"__type":"dict"}}],["required_field",{"__class":"airflow.models.param.Param","default":{"__var":null,"__type":"arg_not_set"},"description":"This field is required. You can not submit without having text in here.","schema":{"__var":{"type":"string","title":"Required text field"},"__type":"dict"}}],["optional_field",{"__class":"airflow.models.param.Param","default":"optional text, you can trigger also w/o text","description":null,"schema":{"__var":{"type":["null","string"],"title":"Optional text field","description_md":"This field is optional. As field content is JSON schema validated you must allow the `null` type."},"__type":"dict"}}],["checked_text",{"__class":"airflow.models.param.Param","default":"length-checked-field","description":null,"schema":{"__var":{"type":"string","title":"Text field with length check","description_md":"This field is required. And you need to provide something between 10 and 30\n characters. See the JSON\n [schema description (string)](https://json-schema.org/understanding-json-schema/reference/string.html)\n for more details","minLength":10,"maxLength":20,"section":"JSON Schema validation options"},"__type":"dict"}}],["checked_number",{"__class":"airflow.models.param.Param","default":100,"description":null,"schema":{"__var":{"type":"number","title":"Number field with value check","description_md":"This field is required. You need to provide any number between 64 and 128.\n See the JSON\n [schema description (numbers)](https://json-schema.org/understanding-json-schema/reference/numeric.html)\n for more details","minimum":64,"maximum":128,"section":"JSON Schema validation options"},"__type":"dict"}}],["object",{"__class":"airflow.models.param.Param","default":{"__var":{"key":"value"},"__type":"dict"},"description":null,"schema":{"__var":{"type":["object","null"],"title":"JSON entry field","section":"Special advanced stuff with form fields"},"__type":"dict"}}],["array_of_objects",{"__class":"airflow.models.param.Param","default":[{"__var":{"name":"account_name","country":"country_name"},"__type":"dict"}],"description":null,"schema":{"__var":{"description_md":"Array with complex objects and validation rules. See [JSON Schema validation options in specs](https://json-schema.org/understanding-json-schema/reference/array.html#items).","type":"array","title":"JSON array field","items":{"__var":{"type":"object","properties":{"__var":{"name":{"__var":{"type":"string"},"__type":"dict"},"country_name":{"__var":{"type":"string"},"__type":"dict"}},"__type":"dict"},"required":["name"]},"__type":"dict"},"section":"Special advanced stuff with form fields"},"__type":"dict"}}],["hidden_secret_field",{"__class":"airflow.models.param.Param","default":"constant value","description":null,"schema":{"__var":{"const":"constant value"},"__type":"dict"}}]],"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_44cb27f57d5b198d3a3990eb68b78ee8a1565228_example_params_ui_tutorial.show_params","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[["x",{"__class":"airflow.models.param.Param","default":3,"description":null,"schema":{"__var":{},"__type":"dict"}}],["text",{"__class":"airflow.models.param.Param","default":"Hello World!","description":null,"schema":{"__var":{},"__type":"dict"}}],["flag",{"__class":"airflow.models.param.Param","default":false,"description":null,"schema":{"__var":{},"__type":"dict"}}],["a_simple_list",{"__class":"airflow.models.param.Param","default":["one","two","three","actually one value is made per line"],"description":null,"schema":{"__var":{},"__type":"dict"}}],["most_loved_number",{"__class":"airflow.models.param.Param","default":42,"description":null,"schema":{"__var":{"type":"integer","title":"Your favorite number","description_md":"Everybody should have a **favorite** number. Not only _math teachers_. If you can not think of any at the moment please think of the 42 which is very famous becauseof the book [The Hitchhiker's Guide to the Galaxy](https://en.wikipedia.org/wiki/Phrases_from_The_Hitchhiker%27s_Guide_to_the_Galaxy#The_Answer_to_the_Ultimate_Question_of_Life,_the_Universe,_and_Everything_is_42)."},"__type":"dict"}}],["pick_one",{"__class":"airflow.models.param.Param","default":"value 42","description":"You can use JSON schema enum's to generate drop down selection boxes.","schema":{"__var":{"type":"string","title":"Select one Value","enum":["value 16","value 17","value 18","value 19","value 20","value 21","value 22","value 23","value 24","value 25","value 26","value 27","value 28","value 29","value 30","value 31","value 32","value 33","value 34","value 35","value 36","value 37","value 38","value 39","value 40","value 41","value 42","value 43","value 44","value 45","value 46","value 47","value 48","value 49","value 50","value 51","value 52","value 53","value 54","value 55","value 56","value 57","value 58","value 59","value 60","value 61","value 62","value 63"]},"__type":"dict"}}],["pick_with_label",{"__class":"airflow.models.param.Param","default":3,"description":"With drop down selections you can also have nice display labels for the values.","schema":{"__var":{"type":"number","title":"Select one Number","enum":[1,2,3,4,5,6,7,8,9],"values_display":{"__var":{"1":"One","2":"Two","3":"Three","4":"Four - is like you take three and get one for free!","5":"Five","6":"Six","7":"Seven","8":"Eight","9":"Nine"},"__type":"dict"}},"__type":"dict"}}],["proposals",{"__class":"airflow.models.param.Param","default":"some value","description":"You can use JSON schema examples's to generate drop down selection boxes but allow also to enter custom values. Try typing an 'a' and see options.","schema":{"__var":{"type":"string","title":"Field with proposals","examples":["Alpha","Bravo","Charlie","Delta","Echo","Foxtrot","Golf","Hotel","India","Juliett","Kilo","Lima","Mike","November","Oscar","Papa","Quebec","Romeo","Sierra","Tango","Uniform","Victor","Whiskey","X-ray","Yankee","Zulu"]},"__type":"dict"}}],["multi_select",{"__class":"airflow.models.param.Param","default":["two","three"],"description":"Select from the list of options.","schema":{"__var":{"type":"array","title":"Multi Select","examples":["one","two","three","four","five"]},"__type":"dict"}}],["multi_select_with_label",{"__class":"airflow.models.param.Param","default":["2","3"],"description":"Select from the list of options. See that options can have nicer text and still technical valuesare propagated as values during trigger to the DAG.","schema":{"__var":{"type":"array","title":"Multi Select with Labels","examples":["1","2","3","4","5"],"values_display":{"__var":{"1":"One box of choccolate","2":"Two bananas","3":"Three apples"},"__type":"dict"}},"__type":"dict"}}],["array_of_numbers",{"__class":"airflow.models.param.Param","default":[1,2,3],"description":"Only integers are accepted in this array","schema":{"__var":{"type":"array","title":"Array of numbers","items":{"__var":{"type":"number"},"__type":"dict"}},"__type":"dict"}}],["bool",{"__class":"airflow.models.param.Param","default":true,"description":"A On/Off selection with a proper description.","schema":{"__var":{"type":"boolean","title":"Please confirm"},"__type":"dict"}}],["date_time",{"__class":"airflow.models.param.Param","default":"2025-01-09T12:17:00+00:00","description":"Please select a date and time, use the button on the left for a pop-up calendar.","schema":{"__var":{"type":"string","format":"date-time","title":"Date-Time Picker"},"__type":"dict"}}],["date",{"__class":"airflow.models.param.Param","default":"2025-01-09","description":"Please select a date, use the button on the left for a pop-up calendar. See that here are no times!","schema":{"__var":{"type":"string","format":"date","title":"Date Picker"},"__type":"dict"}}],["time",{"__class":"airflow.models.param.Param","default":"12:13:14","description":"Please select a time, use the button on the left for a pop-up tool.","schema":{"__var":{"type":["string","null"],"format":"time","title":"Time Picker"},"__type":"dict"}}],["multiline_text",{"__class":"airflow.models.param.Param","default":"A multiline text Param\nthat will keep the newline\ncharacters in its value.","description":"This field allows for multiline text input. The returned value will be a single with newline (\\n) characters kept intact.","schema":{"__var":{"type":["string","null"],"format":"multiline"},"__type":"dict"}}],["required_field",{"__class":"airflow.models.param.Param","default":{"__var":null,"__type":"arg_not_set"},"description":"This field is required. You can not submit without having text in here.","schema":{"__var":{"type":"string","title":"Required text field"},"__type":"dict"}}],["optional_field",{"__class":"airflow.models.param.Param","default":"optional text, you can trigger also w/o text","description":null,"schema":{"__var":{"type":["null","string"],"title":"Optional text field","description_md":"This field is optional. As field content is JSON schema validated you must allow the `null` type."},"__type":"dict"}}],["checked_text",{"__class":"airflow.models.param.Param","default":"length-checked-field","description":null,"schema":{"__var":{"type":"string","title":"Text field with length check","description_md":"This field is required. And you need to provide something between 10 and 30\n characters. See the JSON\n [schema description (string)](https://json-schema.org/understanding-json-schema/reference/string.html)\n for more details","minLength":10,"maxLength":20,"section":"JSON Schema validation options"},"__type":"dict"}}],["checked_number",{"__class":"airflow.models.param.Param","default":100,"description":null,"schema":{"__var":{"type":"number","title":"Number field with value check","description_md":"This field is required. You need to provide any number between 64 and 128.\n See the JSON\n [schema description (numbers)](https://json-schema.org/understanding-json-schema/reference/numeric.html)\n for more details","minimum":64,"maximum":128,"section":"JSON Schema validation options"},"__type":"dict"}}],["object",{"__class":"airflow.models.param.Param","default":{"__var":{"key":"value"},"__type":"dict"},"description":null,"schema":{"__var":{"type":["object","null"],"title":"JSON entry field","section":"Special advanced stuff with form fields"},"__type":"dict"}}],["array_of_objects",{"__class":"airflow.models.param.Param","default":[{"__var":{"name":"account_name","country":"country_name"},"__type":"dict"}],"description":null,"schema":{"__var":{"description_md":"Array with complex objects and validation rules. See [JSON Schema validation options in specs](https://json-schema.org/understanding-json-schema/reference/array.html#items).","type":"array","title":"JSON array field","items":{"__var":{"type":"object","properties":{"__var":{"name":{"__var":{"type":"string"},"__type":"dict"},"country_name":{"__var":{"type":"string"},"__type":"dict"}},"__type":"dict"},"required":["name"]},"__type":"dict"},"section":"Special advanced stuff with form fields"},"__type":"dict"}}],["hidden_secret_field",{"__class":"airflow.models.param.Param","default":"constant value","description":null,"schema":{"__var":{"const":"constant value"},"__type":"dict"}}]]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:20:08.936+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:20:08.940+0000] {dag.py:2418} INFO - Setting next_dagrun for example_params_ui_tutorial to None, run_after=None
2025-01-09 22:20:08 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_outlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Importing /opt/airflow/airflow/example_dags/example_outlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:08 [debug ] Initializing Providers Manager[asset_uris] [airflow.providers_manager] [task]
2025-01-09 22:20:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: latest_only_with_trigger> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Initialization of Providers Manager[asset_uris] took 0.05 seconds [airflow.providers_manager] [task]
2025-01-09 22:20:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"latest_only_with_trigger","timezone":"UTC","tags":["example3"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only_with_trigger.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.DeltaDataIntervalTimetable","__var":{"delta":14400.0}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"latest_only":["operator","latest_only"],"task1":["operator","task1"],"task2":["operator","task2"],"task3":["operator","task3"],"task4":["operator","task4"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e9ffdb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"LatestOnlyOperator","template_ext":[],"task_id":"latest_only","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task1"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.latest_only","_is_empty":false,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task3","task4"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task3","task4"],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task4","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"trigger_rule":"all_done","is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_with_extra_from_classic_operator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_with_extra_by_yield> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_with_extra_by_context> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:20:09.020+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:20:09.027+0000] {dag.py:2418} INFO - Setting next_dagrun for latest_only_with_trigger to 2025-01-09 16:00:00+00:00, run_after=2025-01-09 20:00:00+00:00
2025-01-09 22:20:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_with_extra_from_classic_operator","timezone":"UTC","tags":["produces"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"asset_with_extra_from_classic_operator":["operator","asset_with_extra_from_classic_operator"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"asset_with_extra_from_classic_operator","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"test-asset","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":":"},"__type":"operator"}],"dag_dependencies":[{"source":"asset_with_extra_from_classic_operator","target":"asset","dependency_type":"asset","dependency_id":"test-asset"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_with_extra_by_yield","timezone":"UTC","tags":["produces"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"asset_with_extra_by_yield":["operator","asset_with_extra_by_yield"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"asset_with_extra_by_yield","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"test-asset","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_f06f1ad2457a51bd0234f46fd69f068d5815c10b_example_outlet_event_extra.asset_with_extra_by_yield","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset_with_extra_by_yield","target":"asset","dependency_type":"asset","dependency_id":"test-asset"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_with_extra_by_context","timezone":"UTC","tags":["produces"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_outlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"asset_with_extra_by_context":["operator","asset_with_extra_by_context"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"asset_with_extra_by_context","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"test-asset","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","python_callable_name":"unusual_prefix_f06f1ad2457a51bd0234f46fd69f068d5815c10b_example_outlet_event_extra.asset_with_extra_by_context","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset_with_extra_by_context","target":"asset","dependency_type":"asset","dependency_id":"test-asset"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:20:09 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:20:09.054+0000] {dag.py:1861} INFO - Sync 3 DAGs
[2025-01-09T22:20:09.112+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_with_extra_by_context to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:20:09.116+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_with_extra_by_yield to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:20:09.119+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_with_extra_from_classic_operator to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
2025-01-09 22:20:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:20:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_latest_only.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_latest_only.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: latest_only> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"latest_only","timezone":"UTC","tags":["example2","example3"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_latest_only.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.DeltaDataIntervalTimetable","__var":{"delta":14400.0}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"latest_only":["operator","latest_only"],"task1":["operator","task1"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#e9ffdb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"LatestOnlyOperator","template_ext":[],"task_id":"latest_only","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["task1"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.latest_only","_is_empty":false,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"task1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:20:09.160+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:20:09.166+0000] {dag.py:2418} INFO - Setting next_dagrun for latest_only to 2025-01-09 16:00:00+00:00, run_after=2025-01-09 20:00:00+00:00
2025-01-09 22:20:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_inlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_inlet_event_extra.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: read_asset_event> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: read_asset_event_from_classic> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_inlet_event_extra.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"read_asset_event","timezone":"UTC","tags":["consumes"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_inlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"read_asset_event":["operator","read_asset_event"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"read_asset_event","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"inlets":[{"__var":{"name":"s3://output/1.txt","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_97c8ee958e8f6968fd91b9366ca9be7043a80f60_example_inlet_event_extra.read_asset_event","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"read_asset_event_from_classic","timezone":"UTC","tags":["consumes"],"start_date":-62135596800.0,"fileloc":"/opt/airflow/airflow/example_dags/example_inlet_event_extra.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"read_asset_event_from_classic":["operator","read_asset_event_from_classic"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"read_asset_event_from_classic","template_fields_renderers":{"bash_command":"bash","env":"json"},"inlets":[{"__var":{"name":"s3://output/1.txt","uri":"s3://output/1.txt","group":"asset","extra":{}},"__type":"asset"}],"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"echo '{{ inlet_events['s3://output/1.txt'][-1].extra | tojson }}'"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:20:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_external_task_marker_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_external_task_marker_dag.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:20:09.230+0000] {dag.py:1861} INFO - Sync 2 DAGs
[2025-01-09T22:20:09.239+0000] {dag.py:2418} INFO - Setting next_dagrun for read_asset_event to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:20:09.242+0000] {dag.py:2418} INFO - Setting next_dagrun for read_asset_event_from_classic to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
2025-01-09 22:20:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: example_external_task_marker_parent> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: example_external_task_marker_child> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_external_task_marker_dag.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_external_task_marker_parent","timezone":"UTC","tags":["example2"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_external_task_marker_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"parent_task":["operator","parent_task"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#4db7db","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalTaskMarker","template_ext":[],"recursion_depth":10,"task_id":"parent_task","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["external_dag_id","external_task_id","logical_date"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.external_task","_is_empty":true,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.sensors.external_task.ExternalDagLink":{}}],"external_dag_id":"example_external_task_marker_child","external_task_id":"child_task1","logical_date":"{{ logical_date.isoformat() }}"},"__type":"operator"}],"dag_dependencies":[],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_external_task_marker_child","timezone":"UTC","tags":["example2"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_external_task_marker_dag.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"child_task1":["operator","child_task1"],"child_task2":["operator","child_task2"],"child_task3":["operator","child_task3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#4db7db","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalTaskSensor","template_ext":[],"task_id":"child_task1","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["external_dag_id","external_task_id","external_task_ids","external_task_group_id"],"_needs_expansion":false,"is_teardown":false,"reschedule":true,"downstream_task_ids":["child_task2"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.external_task","_is_empty":false,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.sensors.external_task.ExternalDagLink":{}}],"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"external_dag_id":"example_external_task_marker_parent","external_task_id":"parent_task","external_task_ids":["parent_task"]},"__type":"operator"},{"__var":{"ui_color":"#4db7db","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"ExternalTaskSensor","template_ext":[],"task_id":"child_task2","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["external_dag_id","external_task_id","external_task_ids","external_task_group_id"],"_needs_expansion":false,"is_teardown":false,"reschedule":true,"downstream_task_ids":["child_task3"],"weight_rule":"downstream","_task_module":"airflow.providers.standard.sensors.external_task","_is_empty":false,"start_trigger_args":null,"_operator_extra_links":[{"airflow.providers.standard.sensors.external_task.ExternalDagLink":{}}],"deps":["airflow.ti_deps.deps.mapped_task_upstream_dep.MappedTaskUpstreamDep","airflow.ti_deps.deps.not_in_retry_period_dep.NotInRetryPeriodDep","airflow.ti_deps.deps.not_previously_skipped_dep.NotPreviouslySkippedDep","airflow.ti_deps.deps.prev_dagrun_dep.PrevDagrunDep","airflow.ti_deps.deps.ready_to_reschedule.ReadyToRescheduleDep","airflow.ti_deps.deps.trigger_rule_dep.TriggerRuleDep"],"external_dag_id":"example_external_task_marker_parent","external_task_group_id":"parent_dag_task_group_id"},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"child_task3","template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[{"source":"example_external_task_marker_parent","target":"example_external_task_marker_child","dependency_type":"sensor","dependency_id":"child_task1"},{"source":"example_external_task_marker_parent","target":"example_external_task_marker_child","dependency_type":"sensor","dependency_id":"child_task2"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:20:09.283+0000] {dag.py:1861} INFO - Sync 2 DAGs
[2025-01-09T22:20:09.293+0000] {dag.py:2418} INFO - Setting next_dagrun for example_external_task_marker_child to None, run_after=None
[2025-01-09T22:20:09.295+0000] {dag.py:2418} INFO - Setting next_dagrun for example_external_task_marker_parent to None, run_after=None
2025-01-09 22:20:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: example_branch_dop_operator_v3> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_branch_dop_operator_v3","timezone":"UTC","tags":["example"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_branch_python_dop_operator_3.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"*/1 * * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"should_run":["operator","should_run"],"empty_task_1":["operator","empty_task_1"],"empty_task_2":["operator","empty_task_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"default_args":{"__var":{"depends_on_past":true},"__type":"dict"},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_BranchPythonDecoratedOperator","template_ext":[],"task_id":"should_run","depends_on_past":true,"template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"doc_md":"\n Determine which empty_task should be run based on if the logical date minute is even or odd.\n\n :param dict kwargs: Context\n :return: Id of the task to run\n ","is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":["empty_task_1","empty_task_2"],"weight_rule":"downstream","python_callable_name":"unusual_prefix_fd80fe6ebb99ee119311efc72db973227162960a_example_branch_python_dop_operator_3.should_run","_task_module":"airflow.decorators.branch_python","_operator_name":"@task.branch","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"empty_task_1","depends_on_past":true,"template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"},{"__var":{"ui_color":"#e8f7e4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"EmptyOperator","template_ext":[],"task_id":"empty_task_2","depends_on_past":true,"template_fields_renderers":{},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":[],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","_task_module":"airflow.operators.empty","_is_empty":true,"start_trigger_args":null},"__type":"operator"}],"dag_dependencies":[],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
2025-01-09 22:20:09 [debug ] Workload process exited [supervisor] exit_code=0
[2025-01-09T22:20:09.349+0000] {dag.py:1861} INFO - Sync 1 DAGs
[2025-01-09T22:20:09.361+0000] {dag.py:2418} INFO - Setting next_dagrun for example_branch_dop_operator_v3 to 2025-01-09 22:19:00+00:00, run_after=2025-01-09 22:20:00+00:00
2025-01-09 22:20:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_assets.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_assets.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_produces_2> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: consume_1_and_2_with_asset_expressions> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: consume_1_or_both_2_and_3_with_asset_expressions> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_consumes_unknown_never_scheduled> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: consume_1_or_2_with_asset_expressions> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_consumes_1_never_scheduled> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_produces_1> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: conditional_asset_and_time_based_timetable> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_consumes_1> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_consumes_1_and_2> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:20:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_produces_2","timezone":"UTC","tags":["asset-scheduled","produces"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"producing_task_2":["operator","producing_task_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"producing_task_2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset_produces_2","target":"asset","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"consume_1_and_2_with_asset_expressions","timezone":"UTC","tags":[],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_1_and_2_with_asset_expressions":["operator","consume_1_and_2_with_asset_expressions"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consume_1_and_2_with_asset_expressions","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"consume_1_and_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"consume_1_and_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"consume_1_and_2_with_asset_expressions","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"consume_1_or_both_2_and_3_with_asset_expressions","timezone":"UTC","tags":[],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_any","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag3/output_3.txt","uri":"s3://dag3/output_3.txt","group":"asset","extra":{"hi":"bye"}}]}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_1_or_both_2_and_3_with_asset_expressions":["operator","consume_1_or_both_2_and_3_with_asset_expressions"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consume_1_or_both_2_and_3_with_asset_expressions","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"consume_1_or_both_2_and_3_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"consume_1_or_both_2_and_3_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"asset","target":"consume_1_or_both_2_and_3_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag3/output_3.txt"},{"source":"consume_1_or_both_2_and_3_with_asset_expressions","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_unknown_never_scheduled","timezone":"UTC","tags":["asset-scheduled"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://unrelated/asset3.txt","uri":"s3://unrelated/asset3.txt","group":"asset","extra":{}},{"__type":"asset","name":"s3://unrelated/asset_other_unknown.txt","uri":"s3://unrelated/asset_other_unknown.txt","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"unrelated_task":["operator","unrelated_task"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"unrelated_task","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://unrelated_task/asset_other_unknown.txt","uri":"s3://unrelated_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_unknown_never_scheduled","dependency_type":"asset","dependency_id":"s3://unrelated/asset3.txt"},{"source":"asset","target":"asset_consumes_unknown_never_scheduled","dependency_type":"asset","dependency_id":"s3://unrelated/asset_other_unknown.txt"},{"source":"asset_consumes_unknown_never_scheduled","target":"asset","dependency_type":"asset","dependency_id":"s3://unrelated_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"consume_1_or_2_with_asset_expressions","timezone":"UTC","tags":[],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_any","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consume_1_or_2_with_asset_expressions":["operator","consume_1_or_2_with_asset_expressions"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consume_1_or_2_with_asset_expressions","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"consume_1_or_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"consume_1_or_2_with_asset_expressions","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"consume_1_or_2_with_asset_expressions","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_1_never_scheduled","timezone":"UTC","tags":["asset-scheduled","consumes"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://unrelated/this-asset-doesnt-get-triggered","uri":"s3://unrelated/this-asset-doesnt-get-triggered","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consuming_3":["operator","consuming_3"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consuming_3","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_1_never_scheduled","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"asset_consumes_1_never_scheduled","dependency_type":"asset","dependency_id":"s3://unrelated/this-asset-doesnt-get-triggered"},{"source":"asset_consumes_1_never_scheduled","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_produces_1","timezone":"UTC","tags":["asset-scheduled","produces"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.interval.CronDataIntervalTimetable","__var":{"expression":"0 0 * * *","timezone":"UTC"}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"producing_task_1":["operator","producing_task_1"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"producing_task_1","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset_produces_1","target":"asset","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"conditional_asset_and_time_based_timetable","timezone":"UTC","tags":["asset-time-based-timetable"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.assets.AssetOrTimeSchedule","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]},"timetable":{"__type":"airflow.timetables.trigger.CronTriggerTimetable","__var":{"expression":"0 1 * * 3","timezone":"UTC","interval":0.0,"run_immediately":false}}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"conditional_asset_and_time_based_timetable":["operator","conditional_asset_and_time_based_timetable"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"conditional_asset_and_time_based_timetable","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://asset_time_based/asset_other_unknown.txt","uri":"s3://asset_time_based/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"conditional_asset_and_time_based_timetable","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"conditional_asset_and_time_based_timetable","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"conditional_asset_and_time_based_timetable","target":"asset","dependency_type":"asset","dependency_id":"s3://asset_time_based/asset_other_unknown.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_1","timezone":"UTC","tags":["asset-scheduled","consumes"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consuming_1":["operator","consuming_1"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consuming_1","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_1_task/asset_other.txt","uri":"s3://consuming_1_task/asset_other.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_1","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset_consumes_1","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_1_task/asset_other.txt"}],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"asset_consumes_1_and_2","timezone":"UTC","tags":["asset-scheduled","consumes"],"start_date":1609459200.0,"fileloc":"/opt/airflow/airflow/example_dags/example_assets.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"s3://dag1/output_1.txt","uri":"s3://dag1/output_1.txt","group":"asset","extra":{"hi":"bye"}},{"__type":"asset","name":"s3://dag2/output_1.txt","uri":"s3://dag2/output_1.txt","group":"asset","extra":{"hi":"bye"}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"consuming_2":["operator","consuming_2"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#f0ede4","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"BashOperator","template_ext":[".sh",".bash"],"task_id":"consuming_2","template_fields_renderers":{"bash_command":"bash","env":"json"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["bash_command","env","cwd"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"outlets":[{"__var":{"name":"s3://consuming_2_task/asset_other_unknown.txt","uri":"s3://consuming_2_task/asset_other_unknown.txt","group":"asset","extra":{}},"__type":"asset"}],"weight_rule":"downstream","_task_module":"airflow.providers.standard.operators.bash","_is_empty":false,"start_trigger_args":null,"bash_command":"sleep 5"},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"asset_consumes_1_and_2","dependency_type":"asset","dependency_id":"s3://dag1/output_1.txt"},{"source":"asset","target":"asset_consumes_1_and_2","dependency_type":"asset","dependency_id":"s3://dag2/output_1.txt"},{"source":"asset_consumes_1_and_2","target":"asset","dependency_type":"asset","dependency_id":"s3://consuming_2_task/asset_other_unknown.txt"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:20:09.418+0000] {dag.py:1861} INFO - Sync 10 DAGs
[2025-01-09T22:20:09.426+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_1 to None, run_after=None
[2025-01-09T22:20:09.428+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_1_and_2 to None, run_after=None
[2025-01-09T22:20:09.430+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_1_never_scheduled to None, run_after=None
[2025-01-09T22:20:09.432+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_consumes_unknown_never_scheduled to None, run_after=None
[2025-01-09T22:20:09.435+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_produces_1 to 2025-01-08 00:00:00+00:00, run_after=2025-01-09 00:00:00+00:00
[2025-01-09T22:20:09.437+0000] {dag.py:2418} INFO - Setting next_dagrun for asset_produces_2 to None, run_after=None
[2025-01-09T22:20:09.442+0000] {dag.py:2418} INFO - Setting next_dagrun for conditional_asset_and_time_based_timetable to 2025-01-08 01:00:00+00:00, run_after=2025-01-08 01:00:00+00:00
[2025-01-09T22:20:09.443+0000] {dag.py:2418} INFO - Setting next_dagrun for consume_1_and_2_with_asset_expressions to None, run_after=None
[2025-01-09T22:20:09.445+0000] {dag.py:2418} INFO - Setting next_dagrun for consume_1_or_2_with_asset_expressions to None, run_after=None
[2025-01-09T22:20:09.447+0000] {dag.py:2418} INFO - Setting next_dagrun for consume_1_or_both_2_and_3_with_asset_expressions to None, run_after=None
2025-01-09 22:20:09 [debug ] Workload process exited [supervisor] exit_code=0
2025-01-09 22:20:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_asset_with_watchers.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_asset_with_watchers.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: example_create_file> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: example_asset_with_watchers> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Sending request [task] [task] json={"fileloc":"/opt/airflow/airflow/example_dags/example_asset_with_watchers.py","serialized_dags":[{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_create_file","timezone":"UTC","tags":[],"fileloc":"/opt/airflow/airflow/example_dags/example_asset_with_watchers.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.NullTimetable","__var":{}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"create_file":["operator","create_file"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"create_file","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_7b99e56f49be0452f4f9715d58326bb6ec761a8a_example_asset_with_watchers.create_file","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[],"params":[]}}},{"data":{"__version":1,"dag":{"edge_info":{},"dag_id":"example_asset_with_watchers","timezone":"UTC","tags":[],"fileloc":"/opt/airflow/airflow/example_dags/example_asset_with_watchers.py","catchup":false,"timetable":{"__type":"airflow.timetables.simple.AssetTriggeredTimetable","__var":{"asset_condition":{"__type":"asset_all","objects":[{"__type":"asset","name":"example_asset","uri":"example_asset","group":"asset","extra":{}}]}}},"task_group":{"_group_id":null,"group_display_name":"","prefix_group_id":true,"tooltip":"","ui_color":"CornflowerBlue","ui_fgcolor":"#000","children":{"delete_file":["operator","delete_file"]},"upstream_group_ids":[],"downstream_group_ids":[],"upstream_task_ids":[],"downstream_task_ids":[]},"_processor_dags_folder":"/opt/airflow/dags","tasks":[{"__var":{"ui_color":"#ffefeb","ui_fgcolor":"#000","start_from_trigger":false,"task_type":"_PythonDecoratedOperator","template_ext":[],"task_id":"delete_file","template_fields_renderers":{"templates_dict":"json","op_args":"py","op_kwargs":"py"},"is_setup":false,"on_failure_fail_dagrun":false,"pool":"default_pool","template_fields":["templates_dict","op_args","op_kwargs"],"_needs_expansion":false,"is_teardown":false,"downstream_task_ids":[],"weight_rule":"downstream","python_callable_name":"unusual_prefix_7b99e56f49be0452f4f9715d58326bb6ec761a8a_example_asset_with_watchers.delete_file","_task_module":"airflow.decorators.python","_operator_name":"@task","_is_empty":false,"start_trigger_args":null,"op_args":"()","op_kwargs":{}},"__type":"operator"}],"dag_dependencies":[{"source":"asset","target":"example_asset_with_watchers","dependency_type":"asset","dependency_id":"example_asset"}],"params":[]}}}],"warnings":[],"import_errors":{},"type":"DagFileParsingResult"}
[2025-01-09T22:20:09.508+0000] {dag.py:1861} INFO - Sync 2 DAGs
[2025-01-09T22:20:09.514+0000] {dag.py:2418} INFO - Setting next_dagrun for example_asset_with_watchers to None, run_after=None
[2025-01-09T22:20:09.515+0000] {dag.py:2418} INFO - Setting next_dagrun for example_create_file to None, run_after=None
2025-01-09 22:20:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_asset_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_asset_decorator.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: consumes_asset_decorator> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset2_producer> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset1_producer> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [info ] Filling up the DagBag from /opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Importing /opt/airflow/airflow/example_dags/example_asset_alias_with_no_taskflow.py [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_alias_example_alias_consumer_with_no_taskflow> [airflow.models.dagbag.DagBag] [task]
2025-01-09 22:20:09 [debug ] Loaded DAG <DAG: asset_alias_example_alias_producer_with_no_taskflow> [airflow.models.dagbag.DagBag] [task]
Process ForkProcess-4:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap
self.run()
File "/usr/local/lib/python3.9/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "/opt/airflow/airflow/dag_processing/manager.py", line 195, in _run_processor_manager
processor_manager.run()
File "/opt/airflow/airflow/dag_processing/manager.py", line 411, in run
return self._run_parsing_loop()
File "/opt/airflow/airflow/dag_processing/manager.py", line 486, in _run_parsing_loop
self._refresh_dag_bundles()
File "/opt/airflow/airflow/dag_processing/manager.py", line 658, in _refresh_dag_bundles
bundle_model = session.get(DagBundleModel, bundle.name)
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 2853, in get
return self._get_impl(
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/orm/session.py", line 2975, in _get_impl
return db_load_fn(
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/orm/loading.py", line 541, in load_on_pk_identity
return result.one()
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/result.py", line 1522, in one
return self._only_one_row(
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/result.py", line 559, in _only_one_row
row = onerow(hard_close=True)
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/result.py", line 1386, in _fetchone_impl
return self._real_result._fetchone_impl(hard_close=hard_close)
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/result.py", line 1801, in _fetchone_impl
row = next(self.iterator, _NO_ROW)
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/orm/loading.py", line 147, in chunks
fetch = cursor._raw_all_rows()
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/result.py", line 393, in _raw_all_rows
return [make_row(row) for row in rows]
File "/home/airflow/.local/lib/python3.9/site-packages/sqlalchemy/engine/result.py", line 393, in <listcomp>
return [make_row(row) for row in rows]
RuntimeError: number of values in row (1) differ from number of column processors (4)
[2025-01-09T22:20:10.599+0000] {manager.py:224} WARNING - DagFileProcessorManager (PID=230) exited with exit code 1 - re-launching
[2025-01-09T22:20:10.602+0000] {manager.py:169} INFO - Launched DagFileProcessorManager with pid: 299
[2025-01-09T22:20:10.609+0000] {settings.py:63} INFO - Configured default timezone UTC
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment