Keep this file current. It is the resume point after a context reset.
| MS | Scope | Status |
|---|---|---|
| M0 | Parity audit, monorepo skeleton, protocol crate with TS codegen, config loading, CI | done. CI workflow added in M3 (see below) |
| M1 | vLLM client, tool parsing and fallbacks, resilience, Doctor, presets | done |
| M2 | Engine core loop, tools, rollouts, app-server JSON-RPC, exec |
done |
| M3 | Electron shell, thread end to end, onboarding, Models & Endpoints | done (onboarding, thread, composer, approvals e2e-tested) |
| M4 | Permissions/approvals UI, sandboxes, exec policy, hooks trust, project trust | done (approval cards, approval_policy, project .odex/rules, Permissions settings, hooks review) |
| M5 | Context engine tiers, recall, meter and view, soak test | done (meter ring, Context view, Context settings, /compact e2e) |
| M6 | Git/worktrees/review/PR/undo, terminal, actions/environments | done (review pane, Git/PR panel, hand-off, terminal, project actions/environments editor) |
| M7 | MCP client + settings, lazy tools, skills, plugins | done (MCP, Skills, Plugins, Hooks panels) |
| M8 | Subagents, plan, goal, automations, memories, notifications, tray | done (plan approval, goal row, Automations + Activity, Memories) |
| M9 | Computer use, appshots, in-app browser, browser use | done (Browser panel, browser + computer-use settings, agent browser e2e) |
| M10 | Palette, shortcuts, multi-window, packaging, docs | done (palette, rebindable shortcuts, find, undo, pop-out windows, deep links, packaging, docs). Stretch goals not started |
All built and tested on Windows 11. cargo test --workspace, cargo clippy --workspace --all-targets -D warnings and cargo fmt --check all pass.
protocol: wire types, method registry, TS codegen (odex-engine generate-ts).config:~/.odex, layering, profiles, comment-preserving edits, presets (presets/models.toml, verified against vLLM 0.30).llm: streaming client, retries, overflow parsing, fallback tool parsers, JSON repair and validation, registry, Doctor, loop guard.mock-vllm: axum mock with SSE fixtures, faults,max_model_lenenforcement, JSON rule policies and/__mock/*control endpoints, plus a mock ComfyUI (comfy,--comfy-port).context: budget, Tier 1 pruning, Tier 2 compaction (map-reduce, verbatim requirements, extractive fallback), Tier 3 emergency trim, template normalization.tools: tool schemas (codex/extended/minimal/compact), output capping and refs, edit/write ops.apply-patch,execpolicy,sandbox,hooks,file-search,git,mcp-client,computer-use,browser-bridge,comfyui,automations,memories: see each crate's docs.core: the engine (threads, turns, approvals, tools, extensions, subagents, background jobs, store, rollouts).app-server: JSON-RPC stdio server.exec: headless runs.cli: theodex-enginebinary.
Every suite below runs on Windows 11. CI (.github/workflows/ci.yml) runs the default suites on Windows, Ubuntu and macOS. The opt-in suites (Notepad, real vLLM) are local only.
| Suite | Where | Run | In CI |
|---|---|---|---|
| Engine format and lint | engine/ |
cargo fmt --all --check and cargo clippy --workspace --all-targets -- -D warnings |
yes |
| Engine unit and integration tests | each crate's src/ and tests/ |
cargo test --workspace (in engine/) |
yes |
| Engine end to end | engine/core/tests/e2e.rs |
cargo test -p odex-core --test e2e |
yes |
| Context soak | engine/core/tests/soak.rs |
cargo test -p odex-core --test soak -- --nocapture (~5 s in debug) |
yes, own step |
| Parallel endurance | engine/core/tests/soak_parallel.rs |
cargo test -p odex-core --test soak_parallel -- --nocapture (~30 s) |
yes |
| Headless browser use | engine/browser-bridge/tests/headless.rs |
part of cargo test --workspace |
yes |
| Desktop typecheck and lint | desktop/ |
npm run typecheck and npm run lint |
yes |
| Desktop e2e (Playwright + Electron) | desktop/e2e/*.spec.ts |
npm run build && npx playwright test |
yes (xvfb-run on Linux) |
| Notepad computer-use harness | engine/computer-use/tests/notepad.rs |
cargo test -p odex-computer-use --test notepad -- --ignored --test-threads=1 |
no |
| Real-vLLM smoke | engine/core/tests/real_vllm.rs |
ODEX_E2E_BASE_URL=http://host:8000/v1 cargo test -p odex-core --test real_vllm -- --nocapture --test-threads=1 |
no (skips) |
Engine tests against the mock. odex-mock-vllm (engine/mock-vllm) replays scripted replies: content, reasoning, native and fallback tool calls, malformed arguments, disconnects, 429/503 and overflow 400s. It enforces max_model_len. Tests use the in-process MockServer. The Playwright suite uses the binary with JSON rule files; the rule format is documented at the top of engine/mock-vllm/src/rules.rs.
e2e.rscovers the tool loop, sandboxed shell, approvals, overflow-400 recovery, plan mode, fork and rollback, recall, steer and queue, and interrupt.soak.rsruns a 4,096-token model through a 200-step task. It asserts at least 10 compactions, no request over the window, verbatim requirements surviving, andrecallfinding the compacted secret.soak_parallel.rsruns three worktree threads on a 32k model in parallel. Each must finish without context errors and stay isolated from the others.
Desktop e2e. Build the engine and mock first: cargo build -p odex-engine -p odex-mock-vllm in engine/. The harness (desktop/e2e/harness.ts) starts the mock, launches the built app with an isolated ODEX_HOME, and drives it. Set ODEX_OUT=out-<name> to build and test from a separate output directory (for parallel runs). Visual baselines live in desktop/e2e/__screenshots__/<platform>/. Refresh them with npx playwright test --update-snapshots. In CI, a platform without baselines records them instead of failing, and uploads them as the visual-baselines-<os> artifact so they can be committed. A failed run uploads playwright-report/ and test-results/ (traces).
Notepad computer-use harness. It needs an interactive Windows desktop, briefly takes focus, and opens and closes its own Notepad and password-box windows without saving. It's gated by #[ignore], so cargo test --workspace and CI skip it. Run it from engine/: cargo test -p odex-computer-use --test notepad -- --ignored --test-threads=1. It covers background screenshots, ui_tree search, typing through UI Automation, password-field refusal and the clipboard.
Real-vLLM smoke. It is opt-in: every test prints "skipped" and passes unless ODEX_E2E_BASE_URL is set. Optional variables:
ODEX_E2E_MODEL(default: the first served model)ODEX_E2E_API_KEYODEX_E2E_TIMEOUT_SECS(per turn, default 600)ODEX_E2E_MCP_SERVER
The tests:
discovery_and_doctor:/v1/modelsreports the model withmax_model_len, and a quick Doctor run has nofailfor connect, streaming or toolCall.agent_writes_file_and_runs_command: a real agent turn in a temp dir creates a file with a unique token and prints it with a shell command.agent_fixes_failing_node_test: fixessum.jssonode test.jspasses, without touching the test. Skipped withoutnode.mcp_round_trip: callscalc.addonodex-mcp-test-server. Build it first withcargo build -p odex-mcp-client --bins; the test is skipped otherwise.small_window_compacts_without_overflow: overrides the window to 4,096 tokens and sends log chunks until at least one compaction happens, then two more turns. It checks there are no overflow errors and the context stays within the window.
The suite has been verified against odex-mock-vllm with a rules file. It has not yet run against a real server: the vLLM test endpoint on the developer's LAN was unreachable from the build machine (the suite fails fast with "not reachable").
exec smoke. odex-engine --home <empty dir> --base-url http://host:8000/v1 exec "Create hello.txt containing 'hello from odex', then print it with a shell command." --auto-approve (see docs/vllm-setup.md).
Packaging.
npm run dist:win(indesktop/, aftercargo build --release -p odex-engine) producesdesktop/release/Odex-Setup-<version>-x64.exe(NSIS) andOdex-<version>-x64.msix.- To check a package, launch
release/win-unpacked/Odex.exewith a temporaryODEX_HOME: the engine should start fromresources/binand a terminal should open (node-pty unpacked from the asar). dist*also writeslatest.yml(latest-mac.yml,latest-linux.yml) and.blockmapfiles; the in-app updater needs them on the GitHub release (README "Releases and updates"). v0.1.0 was published without them, so 0.1.0 installs can't update themselves: users of 0.1.0 install 0.1.1 by hand once.
desktop/e2e/ (128 tests: 127 pass on Windows, 1 opt-in screenshot test skips): onboarding, composer (drag-drop, grouped @ mentions, / mid-draft, branch/environment chips, starter prompts), goal pause/resume/edit, model-change warnings, rollback/redo, /status and /doctor, Mermaid, lightbox, Ask Odex, Git settings and PR flows against a fake GitHub, environments/worktree retention/move-to-worktree, background sessions, side-panel layout, HTML preview, summary card, always-allow rules, MCP instructions, Quick Chat, thread end to end, approvals (exec escalation), plan mode, /compact, terminal, !cmd, edit and resend, find, project actions, undo, deep links, review pane (stage/revert/comment, hunks, big diffs, hand-off), files and editor, browser panel and agent browser use, MCP/skills/plugins/hooks, all settings panels with persistence, automations and Activity, app updates against a local release feed (check, background download, checksum failure, the restart prompt; Windows only), and visual snapshots of home and thread in light and dark.
A full audit of every keep/adapt/add row in docs/PARITY.md (205 rows) found 70 partial or missing rows; all were implemented in the follow-up round except three, which were marked Deferred in PARITY.md with reasons: macOS/Linux computer use, in-app self-update, and the Landlock fallback sandbox. In-app updates landed in 0.1.1 (D-039).
- Run the real-vLLM smoke suite and Doctor once a server is reachable, then mark the
vllm servecommands indocs/vllm-setup.mdas tested. - Push to GitHub so CI runs for the first time (Linux/macOS sandbox, Electron and visual baselines have only run here on Windows), then commit the Linux and macOS baselines from the CI artifacts.
- Replace the packaging placeholders (MSIX identity, deb maintainer) and add signing secrets.
- Stretch goals (PROMPT §1): SSH remote projects,
/ide-context, thread sections, permanent worktree projects.
-
PR badges refresh when a PR is created or viewed in the Git panel; there is no background polling of PR/check status.
ghcode paths are untested here (ghisn't installed); the REST paths are tested against a fake GitHub (ODEX_GITHUB_API). -
Dev-server URLs are auto-opened from agent
exec_commandsessions and project actions, not from interactive terminals or the one-shotshelltool. -
Model-change warnings are re-checked for loaded threads after an endpoint refresh; other threads are checked when opened or on their next turn.
-
The computer-use part of the
@menu lists real desktop windows, so it isn't e2e-tested. -
The real vLLM endpoint provided for testing (on the developer's LAN) was unreachable from the build machine: a full-tunnel VPN routed LAN traffic into the tunnel. Everything so far is tested against the mock. Run
odex-engine --base-url http://<host>:<port>/v1 doctorand the real-vLLM smoke suite once a server is reachable. -
The restricted-token sandbox doesn't isolate the network (D-017). Some tools that spawn children inside the sandbox (e.g. node
child_process) fail with EPERM; the engine offers a retry without the sandbox. -
MCP OAuth tokens are stored in a JSON file in
~/.odex, not viasafeStorage(D-022). -
Linux/macOS sandbox and computer-use paths are compile-checked only (no runtime test on this machine). CI is the first place they run: the Linux job installs bubblewrap and lifts Ubuntu's unprivileged-userns restriction for bwrap, headless Chrome and Electron.
-
Fixed: the extractive fallback summary could grow the context (it copied every user message, up to 4,000 chars each). It is now bounded (D-036) and covered by a unit test.
-
PR flows (create/view/comment) aren't e2e-tested: they need network and the
ghCLI. OAuth sign-in for MCP HTTP servers isn't e2e-tested either (no OAuth test server). -
[notifications]in config.toml is unused (the desktop keeps those settings indesktop.json), and so arewire_api = "responses",tool_call_formatandtokenizer_path. All are documented as reserved indocs/config.md. -
MSIX on this machine (Windows 11 build 26300): electron-builder's downloaded
makeappx.exe(both the default winCodeSign 2.6.0 bundle and the 26100 kits bundle) fails to start ("side-by-side configuration is incorrect", reported asspawn UNKNOWN). Building withELECTRON_BUILDER_WINDOWS_KITS_PATH="C:\Program Files (x86)\Windows Kits\10\bin\10.0.26100.0\x64"works, and CI sets this automatically when an SDK is installed. NSIS isn't affected.