Skip to content

Run the Zephyr tests in more parallel jobs #11666

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
mikeysklar wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Run the Zephyr tests in more parallel jobs #11666

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 18 additions & 6 deletions .github/workflows/run-zephyr-tests.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,19 +13,31 @@ jobs:
name: ${{ matrix.shard }}
strategy:
fail-fast: ${{ github.event_name == 'merge_group' }}
# One job per board family, so the bsim suites, which take the longest, run
# side by side instead of after each other.
# One job per board, so each job builds one firmware. Each bsim suite is also split
# by the zephyr_sample marker, so the tests that build Zephyr samples get their own job.
matrix:
include:
- shard: native_sim
boards: native_native_sim native_native_sim_asan native_native_sim_lfs
pytest_args: tests/ --ignore=tests/bsim -n $(nproc) --dist loadfile
boards: native_native_sim
pytest_args: tests/ --ignore=tests/bsim -k 'not native_native_sim_asan and not native_native_sim_lfs' -n $(nproc) --dist loadfile
- shard: native_sim_asan
boards: native_native_sim_asan
pytest_args: tests/ --ignore=tests/bsim -k native_native_sim_asan -n $(nproc) --dist loadfile
- shard: native_sim_lfs
boards: native_native_sim_lfs
pytest_args: tests/ --ignore=tests/bsim -k native_native_sim_lfs -n $(nproc) --dist loadfile
- shard: nrf5340bsim
boards: native_nrf5340bsim
pytest_args: tests/bsim -k native_nrf5340bsim -n $(nproc) --dist loadfile
pytest_args: tests/bsim -k native_nrf5340bsim -m 'not zephyr_sample' -n $(nproc) --dist loadfile
- shard: nrf5340bsim-samples
boards: native_nrf5340bsim
pytest_args: tests/bsim -k native_nrf5340bsim -m zephyr_sample -n $(nproc) --dist loadfile
- shard: nrf54lm20bsim
boards: native_nrf54lm20bsim
pytest_args: tests/bsim -k native_nrf54lm20bsim -n $(nproc) --dist loadfile
pytest_args: tests/bsim -k native_nrf54lm20bsim -m 'not zephyr_sample' -n $(nproc) --dist loadfile
- shard: nrf54lm20bsim-samples
boards: native_nrf54lm20bsim
pytest_args: tests/bsim -k native_nrf54lm20bsim -m zephyr_sample -n $(nproc) --dist loadfile
env:
CP_VERSION: ${{ inputs.cp-version }}
steps:
Expand Down
2 changes: 1 addition & 1 deletion ports/zephyr-cp/Makefile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -257,7 +257,7 @@ test-build-$(1):
endef
$(foreach board,$(TEST_BOARDS),$(eval $(call test_board_rule,$(board))))

# CI runs this as three jobs, one per board family, narrowing TEST_BOARDS and
# CI splits this into several jobs, one board each, narrowing TEST_BOARDS and
# PYTEST_ARGS; see .github/workflows/run-zephyr-tests.yml.
PYTEST_ARGS ?= tests/

Expand Down
Loading