Skip to content

Airflow 2.7 is incompatible with SodaCore versions 3.0.24 and beyond #33577

Closed
#33579
Closed
Airflow 2.7 is incompatible with SodaCore versions 3.0.24 and beyond#33577
#33579
Assignees
potiuk
Labels
area:corekind:bugThis is a clearly a bug
Milestone
Airflow 2.7.1

Description

@nathadfield
nathadfield
opened on Aug 21, 2023

Apache Airflow version

2.7.0

What happened

When trying to install SodaCore on Airflow 2.7, the following error is received due to a conflict with opentelemetry-api.

ERROR: Cannot install apache-airflow==2.7.0 and soda-core==3.0.48 because these package versions have conflicting dependencies.

The conflict is caused by:
    apache-airflow 2.7.0 depends on opentelemetry-api==1.15.0
    soda-core 3.0.48 depends on opentelemetry-api~=1.16.0

SodaCore has depended on opentelemetry-api~=1.16.0 ever since v3.0.24.

What you think should happen instead

Airflow needs to support versions of opentelemetry-api 1.16.x.

How to reproduce

Simply running the following commands to install the two packages should reproduce the error.

$ python3 -m venv /tmp/soda                                                                                         
$ /tmp/soda/bin/pip install apache-airflow==2.7.0 soda-core-bigquery==3.0.48

Operating System

n/a

Versions of Apache Airflow Providers

No response

Deployment

Virtualenv installation

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

  1. nathadfield
    added
    kind:bugThis is a clearly a bug
    area:core
    needs-triagelabel for new issues that we didn't triage yet
    on Aug 21, 2023

  2. potiuk commented on Aug 21, 2023

    @potiuk
    potiuk
    on Aug 21, 2023
    Member

    Yeah. We need to relax our requirements there. Agree they are too strict now. Let me take a look.

  3. potiuk
    added this to the Airflow 2.7.1 milestone on Aug 21, 2023
  4. potiuk
    self-assigned this
    on Aug 21, 2023
  5. potiuk
    removed
    needs-triagelabel for new issues that we didn't triage yet
    on Aug 21, 2023
  6. potiuk
    closed this as completedin #33579on Aug 21, 2023
  7. potiuk
    added a commit that references this issue on Aug 21, 2023

    Fix dependencies for celery and opentelemetry for Python 3.8 (#33579)

    ae25a52

  8. potiuk commented on Aug 21, 2023

    @potiuk
    potiuk
    on Aug 21, 2023
    Member

    Fixed. We will have otel 1.15+ supported for 2.7.1. That was a bit tricky and required celery bump :)

  9. potiuk commented on Aug 21, 2023

    @potiuk
    potiuk
    on Aug 21, 2023
    Member

    Thanks for raising it @nathadfield -> I completely forgot about this one when @ferruzzi added opentelmetry I left it as unsolved issue. Now we got it solved.

  10. nathadfield commented on Aug 21, 2023

    @nathadfield
    nathadfield
    on Aug 21, 2023
    ContributorAuthor

    @potiuk Awesome! I'll look forward to 2.7.1 then. :)

  11. potiuk commented on Aug 21, 2023

    @potiuk
    potiuk
    on Aug 21, 2023
    Member

    It's gonna be sooner rather than later :)

  12. ferruzzi commented on Aug 21, 2023

    @ferruzzi
    ferruzzi
    on Aug 21, 2023
    Contributor

    Thanks for sorting this out! When I added OTel, I wasn't able to get pip to resolve any version other than that one very specific version so I had to pin it. I just saw Jarek's other thread where he explained the fix. That's great.

  13. potiuk
    added a commit that references this issue on Aug 25, 2023

    Fix dependencies for celery and opentelemetry for Python 3.8 (#33579)

    3fad890
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

area:corekind:bugThis is a clearly a bug

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions