Skip to content

feat: intake coverage checker (#1673) - #1829

Merged
Ikalus1988 merged 1 commit into
Ikalus1988:mainfrom
zsxh1990:feat/intake-coverage-checker
Sep 19, 2026
Merged

Ikalus1988 merged 1 commit into
Ikalus1988:mainfrom
zsxh1990:feat/intake-coverage-checker

Conversation

@zsxh1990

Copy link
Copy Markdown
Contributor

Closes #1673.

What

New script scripts/intake_coverage.py — normalizes intake titles into search queries and determines coverage.

Usage

python3 scripts/intake_coverage.py --issue 1460
python3 scripts/intake_coverage.py --title "Docker build fails with exit code 137..."
python3 scripts/intake_coverage.py --issue 1460 --json

Calibration

Default --min-score=0.7:

  • #1460 (Docker exit 137) → hits CrashLoopBackOff at 0.7 ✅ lesson-covered
  • #1499 (roleplay vocative) → hits vocative disambiguation ✅ lesson-covered
  • Unrelated hits (GitHub automation, generic FAQ) score < 0.6 → filtered

Real runs

$ python3 scripts/intake_coverage.py --issue 1460
Conclusion: ✅ lesson-covered (CrashLoopBackOff, Docker Compose)

$ python3 scripts/intake_coverage.py --issue 1618
Conclusion: ⚠️ faq-only (BigQuery telemetry)

Tests

pytest tests/test_intake_coverage.py -v  # 18 passed

Does NOT modify search engine scoring or thresholds — tool only.

Signed-off-by: Ikalus1988 Ikalus1988@users.noreply.github.com

Closes Ikalus1988#1673. Script normalizes intake titles (strip boilerplate,
stop words, metadata) and generates 1-3 candidate search queries.
Calls local search engine directly (not CLI) to avoid IP quota.
Classification: lesson-covered / faq-only / no-coverage.

18 tests pass. Calibrated min-score=0.7 against Ikalus1988#1460/Ikalus1988#1499.

Signed-off-by: Ikalus1988 <Ikalus1988@users.noreply.github.com>
Signed-off-by: zsxh1990 <445655361@qq.com>
@codecov

codecov Bot commented Sep 18, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@Ikalus1988
Ikalus1988 merged commit 702abc9 into Ikalus1988:main Sep 19, 2026
23 checks passed
@github-actions

Copy link
Copy Markdown
Contributor

✅ Merged! Thanks again, @zsxh1990.

feat: intake coverage checker (#1673) (+449 lines, 2 files)

Quick question — did any MisakaNet lesson help you this time?
→ Share feedback

No need to reply if nothing comes to mind. ⚡

@github-actions

Copy link
Copy Markdown
Contributor

🎉 Merged — Thank you!

Your contribution has been merged into main.

PR: #1829 — feat: intake coverage checker (#1673)

What's next:

  • Your code is now part of MisakaNet's failure-lesson corpus (now 393 lessons)
  • Feel free to pick up another issue labeled good first issue or status: competition
  • Questions? Ask in this thread or open a Discussion

Welcome to the MisakaNet contributor community! 🧠

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bounty][$0][Search] 分诊辅助:把 intake 标题规范化为检索 query 并判定覆盖率

2 participants