Repository navigation
DAG Run triggered ignoring one missing dataset event #56541
Description
Apache Airflow version
Other Airflow 2/3 version (please specify below)
If "Other Airflow 2/3 version" selected, which one?
2.10.4
What happened?
We created a DAG, scheduled with 16 different datasets. It ran properly for a couple of days, waiting for all 16 datasets to be produced. But suddenly, it was triggerred ignoring one dataset (triggered taking into account 15/16 datasets).
What you think should happen instead?
The DAG should not be triggered, since only 15 out of 16 datasets were produced at that time.
How to reproduce
We cannot reproduce it, it did not happen earlier and we haven't faced it again some days later.
Operating System
Debian 12
Versions of Apache Airflow Providers
No relevant providers used
Deployment
Other Docker-based deployment
Deployment details
We use an AKS cluster in combination with customized docker image, built from the official docker image.
Anything else?
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
Activity
boring-cyborg commentedon Oct 10, 2025
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
Lee-W commentedon Nov 19, 2025
This was expected and we're now tracking this kind of issue with #56750
Fix dataset-triggered DAGs firing without all upstream events (backpo…
Fix dataset-triggered DAGs firing without all upstream events (backpo…