Skip to content

OpenLineage: Add AirflowRunFacet to DAG run events #40798

Closed

Description

@dolfinus

Description

Add AirflowDagRunFacet facet for DAG run events.

Use case/motivation

Currently AirflowRunFacet is present only RunEvents produces by Airflow tasks (containing fields dag, dag_run, task, task_instance). But DAG can be started too, and it currently contains only AirflowJobFacet (fields like taskTree, taskGroups and so on).

Having dag_run field allows custom OpenLineage backend implementations to have URL for Airflow UI page of a particular DagRun, as well as have custom logic based on run_type field value.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

  1. changed the title [-]Add AirflowRunFacet to DAG run events[/-] [+]OpenLineage: Add AirflowRunFacet to DAG run events[/+] on Jul 15, 2024
  2. removed
    needs-triagelabel for new issues that we didn't triage yet
    on Jul 15, 2024
  3. dolfinus commented on Jul 18, 2024

    @dolfinus
    ContributorAuthor

    Implementation: #40854

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions