Repository navigation
Downgrade DagBundlesManager 'DAG bundles loaded' log from INFO to DEBUG - #69960
nagasrisai wants to merge 5 commits into
Conversation
|
@nagasrisai This PR has a few issues that need to be addressed before it can be reviewed — please see our Pull Request quality criteria. Issues found:
What to do next:
There is no rush — take your time and work at your own pace. We appreciate your contribution and are happy to wait for updates. If you have questions, feel free to ask on the Airflow Slack. Note: This comment was drafted by an AI-assisted triage tool and may contain mistakes. Once you have addressed the points above, an Apache Airflow maintainer — a real person — will take the next look at your PR. We use this two-stage triage process so that our maintainers' limited time is spent where it matters most: the conversation with you. |
|
I don't think this is the right approach, we should try to work out why the dag bundle manager is producing duplicate logs instead of suppressing them altogether. |
|
Hey @stephen-bracken, that's a fair point — lowering the log level is a surface-level fix rather than addressing the root cause. I was seeing the 'DAG bundles loaded' message repeat on every scheduler heartbeat in my setup and went for the quick win, but you're right that we should understand why it's firing repeatedly before just hiding it. Do you have any pointers on where to look? My suspicion is that the bundle refresh check isn't short-circuiting when nothing has changed, but I haven't tracked down where the repeated call originates yet. Happy to dig into it properly if you can point me in the right direction. |
|
@nagasrisai sorry I don't, its just something I noticed in my logs and raised it as an issue. |
…o DEBUG The 'DAG bundles loaded' message was emitted at INFO level on every call to load_bundles_from_config(), which gets called on each scheduler heartbeat. Downgrade to DEBUG so it doesn't flood the task/worker logs during normal operation.
d1fc5d9 to
3609eaa
Compare
Closes #69934
Summary
Every time the
DagBundlesManageris initialised (which happens at task startup for each task run) it emits an INFO-level log line listing every configured bundle:For deployments with many bundles this generates tens or hundreds of redundant lines in every task log. The message is useful for debugging configuration but has no operational value during normal task execution.
This commit downgrades the log call from
self.log.infotoself.log.debug. The message is still available when debug logging is enabled.Changes
airflow-core/src/airflow/dag_processing/bundles/manager.py:log.info→log.debugfor the bundle-loaded message.Important
🛠️ Maintainer triage note for @nagasrisai · by
@potiuk· 2026-07-28 16:21 UTCHelpful heads-up from the maintainers — please address before this PR can be reviewed:
The ball is in your court — you've been assigned to this PR. Fix the above, then mark it Ready for review.
See the Pull Request quality criteria for how to fix each item. There is no rush.
Note: your branch is 2835 commits behind
main— please rebase and push again to get up-to-date CI results.Automated triage — may be imperfect; a maintainer takes the next look. We use this two-stage triage process so maintainers' limited time goes to the conversation with you.