Skip to content

GlueJobOperator in verbose mode do not pull logs correctly #56535

Description

@adamgorkaextbi

Apache Airflow Provider(s)

amazon

Versions of Apache Airflow Providers

apache-airflow-providers-amazon==9.10.0 up to newest at current time 9.15.0

Apache Airflow version

2.11.0

Operating System

Debian GNU/Linux 12

Deployment

Official Apache Airflow Helm Chart

Deployment details

official helm chart

What happened

GlueJobOperator in dereferable mode, wait_for_completion=true, verbose=true mode is not pulling logs
newly introduced
waiter_with_logging is not working correctly
[2025-10-09, 22:25:23 UTC] {waiter_with_logging.py:158} INFO - Status of AWS Glue job is: RUNNING

What you think should happen instead

I should see glue logs in airflow UI i task details log section

How to reproduce

run GlueJobOperator in dereferable mode,
wait_for_completion=true, verbose=true

Anything else

all the time

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

  1. changed the title [-]GlueJobOperatorin verbose mode do not pull logs correctly[/-] [+]GlueJobOperator in verbose mode do not pull logs correctly[/+] on Oct 10, 2025
  2. felixpitterling commented on Mar 2, 2026

    @felixpitterling

    Facing the same issue. Are there any updates?

  3. justinpakzad commented on Mar 8, 2026

    @justinpakzad
    Contributor

    I'm going to take a look into this.

  4. shivaam commented on Mar 8, 2026

    @shivaam
    Contributor

    @justinpakzad Heads up. I am almost done with the fix for this. Was able to replicate the issue on my side and testing the fix right now.

  5. justinpakzad commented on Mar 8, 2026

    @justinpakzad
    Contributor

    @shivaam Thanks for letting me know!

  6. added a commit that references this issue on Mar 8, 2026
    1ece990
  7. shivaam commented on Mar 8, 2026

    @shivaam
    Contributor

    Created a draft PR for initial review. Gonna publish in a couple of hours.

  8. added 3 commits that reference this issue on Mar 8, 2026
    ed4abf2
    3d66e21
    03dce1c
  9. added 2 commits that reference this issue on Mar 19, 2026
    0e3ef14
    e451a5e
  10. added and removed
    needs-triagelabel for new issues that we didn't triage yet
    on Mar 23, 2026
  11. added a commit that references this issue on Mar 27, 2026
    b086a22
  12. added a commit that references this issue on Mar 28, 2026
    945c8a3
  13. added a commit that references this issue on Mar 30, 2026
    4a8d0ab
  14. added 2 commits that reference this issue on Apr 1, 2026
    763a0f0
    20e1f7d
  15. added a commit that references this issue on Apr 7, 2026
    22ce912
  16. added a commit that references this issue on Apr 8, 2026
    152e7bf
  17. added a commit that references this issue on Apr 10, 2026
    e55d90f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions