Skip to content

ci(diff-guard): raise rocky_10 detection threshold to 20%#169

Merged
shino merged 2 commits into
mainfrom
ci/rocky10-detection-threshold-override
Jun 15, 2026
Merged

ci(diff-guard): raise rocky_10 detection threshold to 20%#169
shino merged 2 commits into
mainfrom
ci/rocky10-detection-threshold-override

Conversation

@shino

@shino shino commented Jun 15, 2026

Copy link
Copy Markdown
Contributor

What

Add a per-target diff-guard override rocky_10=20 to DETECTION_CHANGE_RATE_THRESHOLD_OVERRIDES in both DB workflows — .github/workflows/db-main.yml (DB) and .github/workflows/db-nightly.yml (DB Nightly) — raising the vuls diff detection change-rate threshold for rocky_10 from the global 5% to 20% and keeping the two workflows in sync.

Why

rocky_10 is a young, small-baseline detection target. Routine upstream Rocky Linux 10 errata batches produce a large relative change rate against the small baseline and repeatedly trip the global 5% threshold, failing the DB workflow even though the candidate DB is sound:

Run Date Baseline Target Added Removed Change Rate Threshold Result
27508894556 2026-06-14 205 227 +22 0 10.7% 5.0% FAIL
26731457315 2026-06-01 122 164 +42 0 34.4% 5.0% FAIL

Both failures were triaged as upstream-driven:

  • raw rocky-errata moved — new RLSA-2026:* advisories with affected_products[].major_version == 10 (e.g. the 06-14 run added 8 such advisories: RLSA-2026:24985, 25111, 25112, 25115, 25191, 25216, 25225, 25237).
  • extractor unchanged (no commits under pkg/extract/rocky or pkg/fetch/rocky in the affected window).
  • vuls2 builder unchanged (identical created_by in baseline vs candidate DB metadata).

i.e. legitimate new Rocky 10 errata, faithfully extracted — not a pipeline regression.

Choice of 20%

As the rocky_10 baseline grows (122 → 205 over two weeks), equivalent upstream batches shrink in relative terms, so a 20% per-target override covers the current regime while still catching genuinely anomalous churn. This mirrors the existing debian_13=20 entry for the same class of recent-release / small-baseline churn.

Note: the 2026-06-01 spike (34.4%, baseline 122) predates this threshold and would not have been covered by 20% — it reflects the initial post-launch seeding of Rocky 10 coverage rather than the steady-state regime this override targets.

🤖 Generated with Claude Code

rocky_10 is a young, small-baseline detection target that repeatedly
trips the global 5% `vuls diff detection` threshold on routine upstream
Rocky Linux 10 errata batches:

- run 26731457315 (2026-06-01): baseline 122 -> 164, +42, 34.4%
- run 27508894556 (2026-06-14): baseline 205 -> 227, +22, 10.7%

Both were confirmed upstream-driven (new RLSA advisories for
major_version 10; raw moved, extractor and vuls2 builder unchanged).
As the baseline grows the relative swings shrink, so a per-target
override of 20% covers the current regime while still catching
genuinely anomalous churn, mirroring the existing debian_13=20 entry.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Copilot AI review requested due to automatic review settings June 15, 2026 01:32
Keep the DB Nightly workflow's detection overrides in sync with
db-main; rocky_10 trips the same small-baseline churn there.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Raises the diff-guard vuls diff detection change-rate threshold specifically for the rocky_10 detection target in the DB workflow to prevent upstream-driven Rocky Linux 10 errata batches from repeatedly failing CI due to a small baseline.

Changes:

  • Add rocky_10=20 to DETECTION_CHANGE_RATE_THRESHOLD_OVERRIDES in .github/workflows/db-main.yml, increasing the per-target threshold from the global 5% to 20%.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated no new comments.

@shino shino requested a review from MaineK00n June 15, 2026 01:41

@MaineK00n MaineK00n left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@shino shino merged commit b7811e0 into main Jun 15, 2026
1 check passed
@shino shino deleted the ci/rocky10-detection-threshold-override branch June 15, 2026 09:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants