Skip to content

Bugfix/fix latest pypi version check - #51039

Merged
jscheffl merged 2 commits into
apache:mainfrom
jscheffl:bugfix/fix-latest-pypi-version-check
May 25, 2025
Merged

jscheffl merged 2 commits into
apache:mainfrom
jscheffl:bugfix/fix-latest-pypi-version-check

Conversation

@jscheffl

Copy link
Copy Markdown
Contributor

As of failed canary in https://github.com/apache/airflow/actions/runs/15233855670 and https://github.com/apache/airflow/actions/runs/15235553931 it seems Pypi.org is blocking requests w/o proper user agent.

This PR adds a user agent to all Python script calls. With this you get HTTP 200, else if this is missing HTTP 406.

@jscheffl
jscheffl requested a review from potiuk as a code owner May 25, 2025 08:35
@jscheffl jscheffl added the full tests needed We need to run full set of tests for this PR to merge label May 25, 2025
@jscheffl jscheffl added the all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs label May 25, 2025
@boring-cyborg boring-cyborg Bot added area:dev-tools area:docker-tests area:production-image Production image improvements and fixes labels May 25, 2025
@jscheffl jscheffl added backport-to-v3-0-test _eol_backport-to-v2-11-test Mark PR with this label to backport to v2-11-test branch labels May 25, 2025

@gopidesupavan gopidesupavan left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks..

@jscheffl jscheffl mentioned this pull request May 25, 2025
@jscheffl
jscheffl merged commit eb7c346 into apache:main May 25, 2025
@github-actions

Copy link
Copy Markdown
Contributor

Backport failed to create: v3-0-test. View the failure log Run details

Status Branch Result
❌ v3-0-test Commit Link

You can attempt to backport this manually by running:

cherry_picker eb7c346 v3-0-test

This should apply the commit to the v3-0-test branch and leave the commit in conflict state marking
the files that need manual conflict resolution.

After you have resolved the conflicts, you can continue the backport process by running:

cherry_picker --continue

@github-actions

Copy link
Copy Markdown
Contributor

Backport failed to create: v2-11-test. View the failure log Run details

Status Branch Result
❌ v2-11-test Commit Link

You can attempt to backport this manually by running:

cherry_picker eb7c346 v2-11-test

This should apply the commit to the v2-11-test branch and leave the commit in conflict state marking
the files that need manual conflict resolution.

After you have resolved the conflicts, you can continue the backport process by running:

cherry_picker --continue

jscheffl added a commit to jscheffl/airflow that referenced this pull request May 25, 2025
* Fix version check from Pypi, requires user agent else raises HTTP 406

* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase
(cherry picked from commit eb7c346)

Co-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>
jscheffl added a commit to jscheffl/airflow that referenced this pull request May 25, 2025
… Fix version check from Pypi, requires user agent else raises HTTP 406\n\n* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase\n(cherry picked from commit eb7c346)\n\nCo-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>
jscheffl added a commit that referenced this pull request May 25, 2025
* Fix version check from Pypi, requires user agent else raises HTTP 406

* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase
(cherry picked from commit eb7c346)
jscheffl added a commit that referenced this pull request May 25, 2025
…ersion check from Pypi, requires user agent else raises HTTP 406\n\n* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase\n(cherry picked from commit eb7c346)\n\nCo-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com> (#51045)
dadonnelly316 pushed a commit to dadonnelly316/airflow that referenced this pull request May 26, 2025
* Fix version check from Pypi, requires user agent else raises HTTP 406

* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase
kaxil pushed a commit that referenced this pull request Jun 3, 2025
* Fix version check from Pypi, requires user agent else raises HTTP 406

* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase
(cherry picked from commit eb7c346)
sanederchik pushed a commit to sanederchik/airflow that referenced this pull request Jun 7, 2025
* Fix version check from Pypi, requires user agent else raises HTTP 406

* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase
@jscheffl
jscheffl deleted the bugfix/fix-latest-pypi-version-check branch October 5, 2025 07:44
potiuk pushed a commit that referenced this pull request Feb 16, 2026
…ersion check from Pypi, requires user agent else raises HTTP 406\n\n* Fix version check from Pypi, requires user agent else raises HTTP 406, also other cases in codebase\n(cherry picked from commit eb7c346)\n\nCo-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com> (#51045)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

all versions If set, the CI build will be forced to use all versions of Python/K8S/DBs area:dev-tools area:docker-tests area:production-image Production image improvements and fixes _eol_backport-to-v2-11-test Mark PR with this label to backport to v2-11-test branch full tests needed We need to run full set of tests for this PR to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants