Skip to content

feat(eval): collect Codex token usage#85

Merged
yzs15 merged 6 commits into
paper/v3-integrationfrom
paper/v3/codex-token-usage
Jul 8, 2026
Merged

feat(eval): collect Codex token usage#85
yzs15 merged 6 commits into
paper/v3-integrationfrom
paper/v3/codex-token-usage

Conversation

@yzs15

@yzs15 yzs15 commented Jul 8, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Add --codex-usage-jsonl support for Codex CLI JSONL token usage parsing.
  • Persist model_input_tokens and model_output_tokens to runner CSV and runs schema.
  • Add evalrun schema/writer tests and TokenUsage metric regression coverage.

Test Plan

  • go test -count=1 ./tools/eval/runner ./internal/evalrun
  • python -m pytest tests/test_metrics_user_promoted.py
  • git diff --check

@yzs15
yzs15 force-pushed the paper/v3/codex-token-usage branch from 3b2ad17 to f64e279 Compare July 8, 2026 08:00
@yzs15
yzs15 merged commit 6a7e2ca into paper/v3-integration Jul 8, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants