Logs no longer show the call site file and line number

[dstandish]

Body

Since Airflow 3.0, logs are missing the source code filename and line number from the log output.

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[yaming-github]

Hi @dstandish I could reproduce this. I also see there's a source="...ClassName" after each log. If this is a bug but not an intended feature, I'm insterested in fixing this. Can you assign this to me?

[ashb]

@yaming-github How do you propose fixing this?

[yaming-github]

@yaming-github How do you propose fixing this?

Hi @ashb thanks for replying. Several things in my mind:

1. We switched to use structlog as logging engine from this pr Start building the replacement task runner for Task Execution SDK #43893, but structlog.processors.CallsiteParameterAdder was not added as part of the processor chains. So I think we could start with adding that processor and test first.
2. log_format in the config file was not respected anymore since 3+, so I think that could be a problem. If we add those call site parameters in the event disctionary, I think we will be able to fix that.
3. Based on 1 and 2, we might also need to change how we render the log at frontend side. I haven't looked into that, but I guess should not be a bug issue.

What do you think?