Repository navigation
jevos-v5 - #45
Merged
Merged
jevos-v5#45
Conversation
…reference on its q8_0 GGUF
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The model of release jevos-v5: README chart and numbers, CI checks against the jevos-v5 model, and the parity reference recorded on jevos-v5's q8_0 GGUF (215 answers from the Python server; error bodies unchanged).
jevos-v5 is a new training run of the same 17-layer model on a wider mix (policies, records and contract excerpts written as natural text, and yes/no questions asked in the negative), with a short second pass on the natural-text part averaged with the first run.
Measured through
jev(OpenVINO INT8):The chart adds agent rules (DynaBench) to the six tasks: jevos-v5 is second behind Jev on all seven. Latency was measured with jevos-v5 itself, the median of 40 requests over four sessions (30 / 132 ms).
Local check with jevos-v5 (Windows, the release binary): parity 212/212, largest P(yes) gap 0.059; the release zip, unpacked next to the binary, answers the README example as shown. CI downloads the model from the jevos-v5 release, so it goes green once the release is published.
🤖 Generated with Claude Code