Skip to content

fix: batch the CNCF project matrix to stay under the 256-job limit - #32

Merged
mfahlandt merged 1 commit into
cncf:mainfrom
mfahlandt:fix/batch-cncf-matrix
Oct 5, 2026
Merged

mfahlandt merged 1 commit into
cncf:mainfrom
mfahlandt:fix/batch-cncf-matrix

Conversation

@mfahlandt

Copy link
Copy Markdown
Member

Problem

The scheduled run https://github.com/cncf/sbom/actions/runs/37172336090 failed with:

Strategy for job 'generate-sbom-cncf' produced 263 configurations which exceeds the maximum of 256 configurations

cncf-projects.yaml (229 repos) + the manually maintained repositories.yaml (34 repos) yield 263 matrix entries. Since repositories.yaml grew on 2026-09-11, the generate-sbom-cncf job has never been scheduled in any weekly run, so no project SBOMs have been generated since then – e.g. kptdev/kpt v1.0.1 (published 2026-09-25) was missed.

Fix

  • prepare-cncf-matrix now splits the project list into up to 3 batches of 200 (matrix1..3 / has_repos1..3) and fails loudly if even that is exceeded.
  • The inline generate-sbom-cncf job is replaced by generate-sbom-cncf-{1,2,3}, which call reusable-generate-sbom.yml – the same path the subproject batches already use (empty sbom_path_prefix → project bucket, unchanged key layout).
  • summarize-sbom-run dependencies and job-name filters updated accordingly.
  • README updated.

Locally verified: util/prepare-project-matrix.sh all → 263 repos → batches of 200 / 63 / 0; util/tests/prepare-project-matrix.sh passes; workflow YAML parses.

Follow-up

After merging, backfill the missed releases with a manual run: source=cncf, releases_mode=latest, max_releases=3.

The combined CNCF + manual project list has 263 repositories, which exceeds
GitHub Actions' maximum of 256 matrix configurations. Since 2026-09-11 the
generate-sbom-cncf job was therefore never scheduled and no project SBOMs
were produced by the weekly runs (e.g. kptdev/kpt v1.0.1 was missed).

Split the project matrix into batches of 200 and run them through the
reusable workflow, mirroring the existing subproject batching.

Signed-off-by: Mario Fahlandt <mfahlandt@pixel-haufen.de>
@mfahlandt
mfahlandt force-pushed the fix/batch-cncf-matrix branch from c253744 to 117f30f Compare October 5, 2026 14:31
@mfahlandt
mfahlandt merged commit 9ad0237 into cncf:main Oct 5, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant