You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
GlueJobOperator in verbose mode do not pull logs correctly #56535
apache-airflow-providers-amazon==9.10.0 up to newest at current time 9.15.0
Apache Airflow version
2.11.0
Operating System
Debian GNU/Linux 12
Deployment
Official Apache Airflow Helm Chart
Deployment details
official helm chart
What happened
GlueJobOperator in dereferable mode, wait_for_completion=true, verbose=true mode is not pulling logs
newly introduced
waiter_with_logging is not working correctly
[2025-10-09, 22:25:23 UTC] {waiter_with_logging.py:158} INFO - Status of AWS Glue job is: RUNNING
What you think should happen instead
I should see glue logs in airflow UI i task details log section
How to reproduce
run GlueJobOperator in dereferable mode,
wait_for_completion=true, verbose=true
changed the title [-]GlueJobOperatorin verbose mode do not pull logs correctly[/-][+]GlueJobOperator in verbose mode do not pull logs correctly[/+]on Oct 10, 2025
Activity
[-]GlueJobOperatorin verbose mode do not pull logs correctly[/-][+]GlueJobOperator in verbose mode do not pull logs correctly[/+]felixpitterling commentedon Mar 2, 2026
Facing the same issue. Are there any updates?
justinpakzad commentedon Mar 8, 2026
I'm going to take a look into this.
shivaam commentedon Mar 8, 2026
@justinpakzad Heads up. I am almost done with the fix for this. Was able to replicate the issue on my side and testing the fix right now.
justinpakzad commentedon Mar 8, 2026
@shivaam Thanks for letting me know!
fix(glue): Add verbose CloudWatch log streaming for deferrable GlueJo…
shivaam commentedon Mar 8, 2026
Created a draft PR for initial review. Gonna publish in a couple of hours.
fix(glue): Add verbose CloudWatch log streaming for deferrable GlueJo…
fix(glue): Add verbose CloudWatch log streaming for deferrable GlueJo…
fix(glue): Add verbose CloudWatch log streaming for deferrable GlueJo…
fix(glue): Add verbose CloudWatch log streaming for deferrable GlueJo…
fix(glue): Add verbose CloudWatch log streaming for deferrable GlueJo…
fix(glue): Fix GlueJobOperator verbose logs not showing in deferrable…
fix(glue): Fix verbose CloudWatch log streaming for deferrable GlueJo…
fix(glue): Fix GlueJobOperator verbose logs not showing in deferrable…
fix(glue): Fix verbose CloudWatch log streaming for deferrable GlueJo…
fix(glue): Fix verbose CloudWatch log streaming for deferrable GlueJo…
fix(glue): Fix GlueJobOperator verbose logs not showing in deferrable…
fix(glue): Fix verbose CloudWatch log streaming for deferrable GlueJo…
fix(glue): Fix GlueJobOperator verbose logs not showing in deferrable…