DAG on_failure_callback execution not logging

### Apache Airflow version 3.1.6 ### If "Other Airflow 3 version" selected, which one? _No response_ ### What happened? When logging or printing out from DAG on_failure_callback executed code, nothing get logged either in the task log or in the scheduler logs. ### What you think should happen instead? The DAG on_failure_callback execution should get logs written at least in the scheduler logs. ### How to reproduce Could run this example DAG that does the on_failure_callback. The file is written, but no logs seen. ``` from airflow.sdk import DAG from airflow.providers.standard.operators.python import PythonOperator from datetime import datetime, timedelta import os import logging logger = logging.getLogger(__name__) name='TEST_PYTHON' def on_fail(context): print(f'on_failure_callback called. Context: {context}') logger.info(f'logger: on_failure_callback called. Context: {context}') logger.warning(f'logger: on_failure_callback called. Context: {context}') logger.error(f'logger: on_failure_callback called. Context: {context}') with open("/tmp/on_fail_output.txt", "w") as f: f.write("failed") default_args = { 'owner': 'airflow', 'depends_on_past': False, 'start_date': datetime(2015, 6, 1), 'email_on_failure': False, 'email_on_retry': False, 'retries': 0, 'retry_delay': timedelta(minutes=1), 'type': 'utf-8' } dag = DAG(name, default_args=default_args, schedule='* * * * *', on_failure_callback=on_fail ) previous_task = None def run_in_task(): raise Exception('The task failed') for x in range(1, 2): task = PythonOperator( task_id = name + '_task' + str(x), python_callable = run_in_task, dag = dag) if previous_task: task.set_upstream(previous_task) previous_task = task ``` ### Operating System Debian GNU/Linux 12 (bookworm) ### Versions of Apache Airflow Providers _No response_ ### Deployment Docker-Compose ### Deployment details ai…