🌱 Add structured CI-observability summary to fuzz-mdx harness - #6797
🌱 Add structured CI-observability summary to fuzz-mdx harness#6797kubestellar-hive[bot] wants to merge 1 commit into
Conversation
fuzz-mdx-sanitizer.ts previously only printed decorative free-text lines (PASSED/FAILED) to stdout, with no machine-readable summary and no record of the run's outcome beyond raw job-log text. The harness now also, at the end of the same run (both pass and fail paths): - Prints one bounded FUZZ_MDX_SUMMARY JSON line (fixed fields only: status, seed, iterations, corpus_size, failures — no test inputs, error text, or unbounded content). - Appends a short Markdown table to $GITHUB_STEP_SUMMARY when that env var is set, so the outcome renders in the GitHub Actions run summary UI without opening raw logs. This happens in-process before process.exit(), so it naturally covers both pass and fail without needing a separate workflow step. No workflow YAML changes, no metrics backend, exporter, or off-box data flow — CI-log/UI observability only, and no new dependency (uses node:fs, already available). Fixes #6770 Signed-off-by: kubestellar-hive[bot] <kubestellar-hive[bot]@users.noreply.github.com>
|
Important Held for human sign-off on the direction, not on the code. This PR's only tracked rationale is #6770, which the hive filed itself — issue #6770 was filed by kubestellar-hive[bot] and no human has acknowledged it. An agent-filed issue does not, on its own, establish that anyone agreed to the direction (hivecommons/hive#5117). The change may well be right; nothing here is a review of it. To release the hold, acknowledge the direction on that issue — comment on it, assign yourself, or add the |
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
✅ Deploy Preview for kubestellar-docs ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
|
Hi @kubestellar-hive[bot]. Thanks for your PR. I'm waiting for a kubestellar member to verify that this patch is reasonable to test. If it is, they should reply with Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
Fixes #6770
What
fuzz-mdx-sanitizer.ts(the harness behindfuzz-mdx.yml) only printed decorative free-text lines (PASSED: all N iterations clean corpus=M/FAILED: K violation(s) found) to stdout. There was no machine-readable summary and no record of the run's outcome visible without opening the raw job log.Change
At the end of the same run (both pass and fail paths), the harness now:
FUZZ_MDX_SUMMARYJSON line (fixed fields only:status,seed,iterations,corpus_size,failures— no test inputs, error text, or unbounded content).$GITHUB_STEP_SUMMARYwhen that env var is set, so the run's outcome renders in the GitHub Actions run summary UI without opening raw logs.This happens in-process, before
process.exit(), on both the pass and fail branches — so it covers both outcomes without needing a separate workflow step orif: always()wiring, and requires no workflow YAML changes.Verification
GITHUB_STEP_SUMMARYset: confirmed the Markdown table is appended on a passing run.npx eslintandnpx tsc --noEmit -p tsconfig.json: no new errors (same pre-existingno-consolewarnings as before, matching the file's existing baseline).Out of scope
No metrics backend, exporter, or off-box data flow — CI-log/UI observability only, consistent with the 'no backend confirmed' posture for this repo. No new dependency (uses
node:fs, already available).— hive: agent=telemetry backend=copilot model=claude-sonnet-4-6