Skip to content

CI: serialize a2a3 onboard steps through task-submit #1356

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ChaoWao merged 1 commit into from
Jul 14, 2026
Merged

CI: serialize a2a3 onboard steps through task-submit #1356

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
38 changes: 23 additions & 15 deletions .github/workflows/ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -484,7 +484,8 @@ jobs:
run: |
source /usr/local/Ascend/cann/set_env.sh
source .venv/bin/activate
python -m pytest tests -m requires_hardware --platform a2a3 --device ${DEVICE_RANGE} -v
DEVICE_LIST=$(python -c "p='${DEVICE_RANGE}'.split('-'); s,e=p[0],p[-1]; print(','.join(str(i) for i in range(int(s),int(e)+1)))")
task-submit --timeout 1800 --max-time 1800 --device "$DEVICE_LIST" --run "python -m pytest tests -m requires_hardware --platform a2a3 --device ${DEVICE_RANGE} -v"

- name: Build and run C++ hardware unit tests
run: |
Expand All @@ -500,10 +501,8 @@ jobs:
json.dump({'version': {'major': 1, 'minor': 0}, 'local': [{'npus': npus}]},
open('tests/ut/cpp/build/resources.json', 'w'))
"
ctest --test-dir tests/ut/cpp/build \
-L "^requires_hardware(_a2a3)?$" \
--resource-spec-file $PWD/tests/ut/cpp/build/resources.json \
-j$(nproc) --output-on-failure
DEVICE_LIST=$(python -c "p='${DEVICE_RANGE}'.split('-'); s,e=p[0],p[-1]; print(','.join(str(i) for i in range(int(s),int(e)+1)))")
task-submit --timeout 1800 --max-time 1800 --device "$DEVICE_LIST" --run "ctest --test-dir tests/ut/cpp/build -L '^requires_hardware(_a2a3)?\$' --resource-spec-file $PWD/tests/ut/cpp/build/resources.json -j$(nproc) --output-on-failure"

- name: Build cann-examples/query (CANN host-API smoke)
run: |
Expand Down Expand Up @@ -570,8 +569,9 @@ jobs:
run: |
source /usr/local/Ascend/cann/set_env.sh
source .venv/bin/activate
python -m pytest examples tests/st --platform a2a3 --device ${DEVICE_RANGE} -v \
--pto-session-timeout 600 --require-pto-isa
DEVICE_LIST=$(python -c "p='${DEVICE_RANGE}'.split('-'); s,e=p[0],p[-1]; print(','.join(str(i) for i in range(int(s),int(e)+1)))")
PYTEST="python -m pytest examples tests/st --platform a2a3 --device ${DEVICE_RANGE} -v --require-pto-isa"
task-submit --timeout 1800 --max-time 1800 --device "$DEVICE_LIST" --run "$PYTEST --pto-session-timeout 600"

# DFX per-feature smokes — hardware mirror of the st-sim-a2a3 set. The
# race window in dep_gen only fires on real timing, so this row is
Expand All @@ -581,33 +581,41 @@ jobs:
run: |
source /usr/local/Ascend/cann/set_env.sh
source .venv/bin/activate
python -m pytest tests/st/a2a3/tensormap_and_ringbuffer/dfx/dep_gen/test_dep_gen.py \
DEVICE_LIST=$(python -c "p='${DEVICE_RANGE}'.split('-'); s,e=p[0],p[-1]; print(','.join(str(i) for i in range(int(s),int(e)+1)))")
PYTEST="python -m pytest tests/st/a2a3/tensormap_and_ringbuffer/dfx/dep_gen/test_dep_gen.py \
--platform a2a3 --device ${DEVICE_RANGE} -p no:xdist --pto-session-timeout 600 \
--require-pto-isa --enable-dep-gen
--require-pto-isa --enable-dep-gen"
task-submit --timeout 1800 --max-time 1800 --device "$DEVICE_LIST" --run "$PYTEST"

- name: l2_swimlane smoke
run: |
source /usr/local/Ascend/cann/set_env.sh
source .venv/bin/activate
python -m pytest tests/st/a2a3/tensormap_and_ringbuffer/dfx/l2_swimlane/ \
DEVICE_LIST=$(python -c "p='${DEVICE_RANGE}'.split('-'); s,e=p[0],p[-1]; print(','.join(str(i) for i in range(int(s),int(e)+1)))")
PYTEST="python -m pytest tests/st/a2a3/tensormap_and_ringbuffer/dfx/l2_swimlane/ \
--platform a2a3 --device ${DEVICE_RANGE} -p no:xdist --pto-session-timeout 600 \
--require-pto-isa --enable-l2-swimlane --enable-dep-gen
--require-pto-isa --enable-l2-swimlane --enable-dep-gen"
task-submit --timeout 1800 --max-time 1800 --device "$DEVICE_LIST" --run "$PYTEST"

- name: PMU smoke
run: |
source /usr/local/Ascend/cann/set_env.sh
source .venv/bin/activate
python -m pytest tests/st/a2a3/tensormap_and_ringbuffer/dfx/pmu/test_pmu.py \
DEVICE_LIST=$(python -c "p='${DEVICE_RANGE}'.split('-'); s,e=p[0],p[-1]; print(','.join(str(i) for i in range(int(s),int(e)+1)))")
PYTEST="python -m pytest tests/st/a2a3/tensormap_and_ringbuffer/dfx/pmu/test_pmu.py \
--platform a2a3 --device ${DEVICE_RANGE} -p no:xdist --pto-session-timeout 600 \
--require-pto-isa --enable-pmu 2
--require-pto-isa --enable-pmu 2"
task-submit --timeout 1800 --max-time 1800 --device "$DEVICE_LIST" --run "$PYTEST"

- name: args_dump smoke
run: |
source /usr/local/Ascend/cann/set_env.sh
source .venv/bin/activate
python -m pytest tests/st/a2a3/tensormap_and_ringbuffer/dfx/args_dump/test_args_dump.py \
DEVICE_LIST=$(python -c "p='${DEVICE_RANGE}'.split('-'); s,e=p[0],p[-1]; print(','.join(str(i) for i in range(int(s),int(e)+1)))")
PYTEST="python -m pytest tests/st/a2a3/tensormap_and_ringbuffer/dfx/args_dump/test_args_dump.py \
--platform a2a3 --device ${DEVICE_RANGE} -p no:xdist --pto-session-timeout 600 \
--require-pto-isa --dump-args
--require-pto-isa --dump-args"
task-submit --timeout 1800 --max-time 1800 --device "$DEVICE_LIST" --run "$PYTEST"


# ---------- Detect platform-specific changes (runs on GitHub server) ----------
Expand Down
9 changes: 9 additions & 0 deletions docs/ci.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -141,6 +141,15 @@ Three hardware tiers, applied to all test categories. See [testing.md](testing.m
| Platform-specific (a2a3) | `[self-hosted, a2a3]` | `ut-a2a3`, `st-onboard-a2a3` |
| Platform-specific (a5) | `[self-hosted, a5]` | `ut-a5`, `st-onboard-a5` |

Every step on a self-hosted runner that touches an NPU — pytest and ctest
alike, on both arches — runs through
`task-submit --device <list> --run "..."`. The runners are shared with
interactive users, so the device lock is what keeps a CI job from colliding
with someone's local run (and vice versa). Steps that only build (cmake,
`RuntimeBuilder`, the `cann-examples` smokes) take no lock. The same rule
applies to local onboard work — see
[.claude/rules/running-onboard.md](../.claude/rules/running-onboard.md).

## Test Sources

### `tests/ut/` — Python unit tests (ut-py)
Expand Down
Loading