Skip to content

Add hatch_build.py to k8s test venv cache calculation - #39473

Merged
potiuk merged 1 commit into
apache:mainfrom
potiuk:fix-caching-hash-for-k8s-tests
May 7, 2024
Merged

potiuk merged 1 commit into
apache:mainfrom
potiuk:fix-caching-hash-for-k8s-tests

Conversation

@potiuk

@potiuk potiuk commented May 7, 2024

Copy link
Copy Markdown
Member

With dynamic project depdencies, the requirements for airlfow are calculated dymamically from hatch_build.py, however cache invalidation key for k8s tests only included pyproject.toml so when colorlog has been bumped in @39453, main build continued to use cache from old colorlog.

This PR adds also hatch_build.py to cache id calculation


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@potiuk
potiuk requested review from ashb and kaxil as code owners May 7, 2024 20:36
@potiuk potiuk added the full tests needed We need to run full set of tests for this PR to merge label May 7, 2024
@potiuk
potiuk force-pushed the fix-caching-hash-for-k8s-tests branch from 85ae01a to b56d323 Compare May 7, 2024 20:59
@potiuk
potiuk requested a review from jedcunningham as a code owner May 7, 2024 20:59
@potiuk

potiuk commented May 7, 2024

Copy link
Copy Markdown
Member Author

Also added it to breeze check whether to recreate the env or not (it has only consideded k8s_requirements.txt so far).

@potiuk
potiuk force-pushed the fix-caching-hash-for-k8s-tests branch from b56d323 to 5c0b058 Compare May 7, 2024 21:15
@potiuk

potiuk commented May 7, 2024

Copy link
Copy Markdown
Member Author

Actuallly ... we can safely remove pyproject.toml since all our dependencies and extras are dynamic and coming from hatch_build.py

@potiuk

potiuk commented May 7, 2024

Copy link
Copy Markdown
Member Author

(will avoid unnecessary recreation of envs when only some tool options chane - like ruff rules)

With dynamic project depdencies, the requirements for airlfow are
calculated dymamically from hatch_build.py, however cache invalidation
key for k8s tests only included pyproject.toml so when colorlog has
been bumped in @39453, main build continued to use cache from old
colorlog.

This PR adds also hatch_build.py to cache id calculation
@potiuk
potiuk force-pushed the fix-caching-hash-for-k8s-tests branch from 5c0b058 to e5272c2 Compare May 7, 2024 21:20
@potiuk
potiuk merged commit f5c86ed into apache:main May 7, 2024
@potiuk
potiuk deleted the fix-caching-hash-for-k8s-tests branch May 7, 2024 22:09
pateash pushed a commit to pateash/airflow that referenced this pull request May 13, 2024
With dynamic project depdencies, the requirements for airlfow are
calculated dymamically from hatch_build.py, however cache invalidation
key for k8s tests only included pyproject.toml so when colorlog has
been bumped in @39453, main build continued to use cache from old
colorlog.

This PR adds also hatch_build.py to cache id calculation
ephraimbuddy pushed a commit that referenced this pull request Jun 5, 2024
With dynamic project depdencies, the requirements for airlfow are
calculated dymamically from hatch_build.py, however cache invalidation
key for k8s tests only included pyproject.toml so when colorlog has
been bumped in @39453, main build continued to use cache from old
colorlog.

This PR adds also hatch_build.py to cache id calculation

(cherry picked from commit f5c86ed)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-tools full tests needed We need to run full set of tests for this PR to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants