Repository navigation
codeweb v0.14.0 — the gate, C/C++, and every number re-derived #89
GhostlyGawd
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
v0.14.0 is on npm and the release is published. This is the release where the CI gate
becomes the headline rather than a feature note, and where every published number was
re-derived from a repaired harness before it went out.
What is new
The deterministic regression gate leads. codeweb builds a call/import graph, and the
gate diffs that graph across a pull request. It fails on a new dependency cycle, a new
body-confirmed duplication, or a symbol that lost every caller. No LLM in the loop, so the
verdict is the same every run, and it costs zero tokens per PR.
C and C++ are first-class — 13 native languages now ship. Both follow the same contract
as the rest: pinned grammar, sha256 recorded in
scripts/grammars/PROVENANCE.md, ABIverified against the pinned runtime, regex-tier fallback so the AST tier stays optional.
The free/paid line is published, not implied. Anything that runs on one laptop against
one repository is free forever under MIT — the map, the 28 MCP tools, the hooks, the gate
Action, every language, now and later. There is a hosted tier for teams that want the gate
run for them across repositories; its price intent is EUR 10 per active author per month,
an active author being one who committed in the trailing 90 days. Intent, not a live offer.
A billing problem there is designed to degrade the hosted service without ever touching
local tooling or your CI.
Four benchmark instruments repaired. Every failure was in the measuring tool, not the
product, and each reproduced at pre-release HEAD. No published number moved as a result.
The receipts
32 pre-registered checks, graded against oracles written separately from the shipped code,
over six SHA-pinned repositories (axios, express, zod, flask, ripgrep, gorilla/mux). All 32
pass:
bench/results/correctness-query.jsonbench/results/edit-safety.jsonbench/results/determinism.jsonbench/results/determinism.jsonbench/results/detection-accuracy.jsonbench/results/detection-accuracy.jsonbench/results/performance.jsonbench/results/performance.jsonbench/results/auxiliary.jsonbench/results/benchmarks.jsonEvery one of those files is committed, and
node bench/run-all.mjsregenerates all of them.What did not work
The pre-registered capstone — "agents edit better with codeweb" — came back a null:
a paired difference of exactly zero on a frozen, adversarially screened task set. It is a
floor effect on tasks clean enough that the baseline already succeeded, and it is published
in the repo beside the passes rather than quietly dropped. An earlier token-savings result
from the discovery pilots did not replicate when re-run, and is likewise recorded as not
replicating.
The repo keeps a standing list of things it deliberately does not claim, rendered on the
site straight from
site/data/product.jsonso it cannot drift out of sync with the copy.Install
MIT, zero required dependencies, Node >= 22. Runs entirely on your machine: no account, no
telemetry, no license keys, and it reads code without executing it.
If a number in here does not re-derive on your machine, that is a bug worth an issue.
All reactions