You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Upgrade Codex ACP, Claude ACP, Gemini CLI, Pi ACP, OpenClaw, OpenCode, and MiMo CLI pins.
Dispatch reasoning effort through live ACP capabilities: reasoning_effort (Codex), effort (Claude), and thought_level (Pi).
Configure launch-time effort for OpenHands and Harvey LAB; leave agents without a confirmed effort interface fail-closed.
Root cause
BenchFlow’s prior Codex ACP pin and runtime assumed the legacy model[effort] protocol. Current Codex ACP exposes independent model and reasoning_effort options, so effort could not be correctly configured. The same review found launch-configured agents whose declared effort setting was not injected before process startup.
Thanks for reviewing this PR. Because BenchFlow’s manifest-parity check depends on benchflow-ai/agents@main, I have opened the companion manifest update in benchflow-ai/agents#60.
Could a maintainer please review and approve the workflow runs for that PR first? If its checks pass, please merge it so the updated manifests are available on agents/main. Afterward, please approve and re-run the checks on this PR so #946 can validate against the merged agent manifests. Thank you!
Thanks for reviewing this PR. Because BenchFlow’s manifest-parity check depends on benchflow-ai/agents@main, I have opened the companion manifest update in benchflow-ai/agents#60.
Could a maintainer please review and approve the workflow runs for that PR first? If its checks pass, please merge it so the updated manifests are available on agents/main. Afterward, please approve and re-run the checks on this PR so #946 can validate against the merged agent manifests. Thank you!
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #945
Summary
reasoning_effort(Codex),effort(Claude), andthought_level(Pi).Root cause
BenchFlow’s prior Codex ACP pin and runtime assumed the legacy
model[effort]protocol. Current Codex ACP exposes independentmodelandreasoning_effortoptions, so effort could not be correctly configured. The same review found launch-configured agents whose declared effort setting was not injected before process startup.Companion manifest PR
benchflow-ai/agents@mainand this PR’s workflow is rerun.Validation
302 passed, 2 skipped.70 passed.21 passed.ruff check src tests tools.ruff format --check src tests tools.ty check src.