Skip to content

plugin(caelestia-assistant): 12/12 test suite II (capability tests) and dev tooling - #18

Merged
ladybug-me merged 14 commits into
caelestia-kde:staging/caelestia-assistantfrom
0x0nYx:plugin/caelestia-assistant/12-tests-domains-scripts
Oct 24, 2026
Merged

ladybug-me merged 14 commits into
caelestia-kde:staging/caelestia-assistantfrom
0x0nYx:plugin/caelestia-assistant/12-tests-domains-scripts

Conversation

@0x0nYx

@0x0nYx 0x0nYx commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

What does this PR do?

Part 12/12 (final) of the caelestia-assistant migration. Adds the remaining capability tests and the dev tooling. After this part the plugin folder mirrors upstream caelestia-assistant@2c193e7 byte-for-byte (verified in the migration audit).

Plugin

  • id (folder name): caelestia-assistant
  • name: Caelestia Assistant
  • version: 0.1.0
  • type: quickshell
  • license (SPDX): GPL-3.0-or-later

What this part contains

125 files, +20,587 lines:

  • Tests for every remaining capability: settings, diagnostics (incl. tests/diagnostics/cases/), retrieval, generative, genius, agent, shellkb, scan, dedupe, devflow, graph, issues.
  • Dev tooling (scripts/): assemble_settings_tools.py, scripts/dev/ (golden check, measure_*.py measurements, mine_synonyms.py, gen_paraphrases.py, and the z_fuzz.py / z_determinism.py / hostile-input harnesses, with NOTES.md), and the bash completion scripts/completions/caelestia-assist.bash.

None of scripts/ is wired into the store or the shell; it is developer tooling shipped with the source.

Whole-stack summary (tip of this branch vs main)

635 files, +139,410 / -2 lines, all inside plugins/caelestia-assistant/ except the two files changed by #6 (CONTRIBUTING.md, scripts/check_safety.py).

Stack

  • Builds on plugin/caelestia-assistant/11-tests-foundation (part 11).
  • Review only this increment: 11...12.
  • Final part. Linear stack of 12; each PR targets main, so its diff is cumulative until earlier parts merge. Please use merge commit or rebase-and-merge (not squash).

Provenance and verification

  • Byte-identical copy of 0x0nYx/caelestia-assistant@2c193e7 (v0.1); sha256-verified in the migration audit recorded in the commit message.
  • scripts/check_safety.py: 0 errors on this tip (87 soft warnings vs 10 on main; the line-level findings are documented in .caelestia-audit-ignore, which no longer hides soft warnings by design, see feat(scripts): per-plugin .caelestia-audit-ignore opt-out file #6).
  • scripts/validate.py: OK on this tip.
  • GPL-3.0-or-later; no AGPL text or headers.

Checklist

  • The plugin lives in its own folder under plugins/caelestia-assistant/ and the folder name equals the id in metadata.json
  • metadata.json is valid JSON and passes python scripts/validate.py
  • A LICENSE file is included in the plugin folder
  • No compiled binaries or archives are included (source-only policy)
  • version follows semver and was bumped for updates (new plugin: 0.1.0)
  • For deprecations: not applicable (new plugin)
  • I have reviewed my plugin's code for safety and malicious behavior

0x0nYx added 13 commits October 9, 2026 12:13
The store's safety audit opts out per line, with a trailing
'caelestia-audit: allow-*' comment. That mechanism cannot express three
legitimate cases:

* JSON data artifacts - JSON has no comment syntax, so a marker would
  corrupt the data;
* flagged tokens inside docstrings or string vocabularies - appending a
  comment would change the string (and with it potentially pinned
  behavior);
* assertion-target strings in tests, where the banned pattern IS the
  assertion.

This adds a per-plugin `.caelestia-audit-ignore` file, parsed next to
metadata.json. Entries name a plugin-relative path, optionally restricted
to a line or inclusive line range, each with a '# reason' comment:

    assistant/data/index/bm25.json   # data artifact, not code
    src/verbs.py:120-132             # string vocabulary, not a call

Semantics are deliberately narrow:

* entries suppress HARD errors for exactly the listed paths/lines;
* the same-line 'caelestia-audit: allow-*' markers keep working and stay
  the preferred mechanism;
* soft warnings (shell-outs etc.) still surface - the file never hides
  them;
* unknown/typo'd paths in the file are inert, matching the store's
  warning-only posture for reviewable noise.

CONTRIBUTING.md documents the mechanism next to the existing opt-out
rule. First consumer: the caelestia-assistant plugin migration, whose
safety-classification vocabularies and built index artifacts trip the
regex scanner as text, not behavior.
…ion chunk 1/12)

Introduces the caelestia-assistant plugin folder: the store manifest (type quickshell - the plugin ships real Quickshell QML surfaces), GPL-3.0-or-later license, plugin README (upstream README + store header), upstream packaging and repo-meta files, the package root, the launcher, and the adapters layer (frozen settings-tool registry + the shell integration QML surfaces). Adapters land first because every later layer imports them.

Chunk contents (14 files):
- .github/workflows/ci.yml
- .gitignore
- CONTRIBUTING.md
- LICENSE
- assistant/__init__.py
- assistant/adapters/__init__.py
- assistant/adapters/caelestia/__init__.py
- assistant/adapters/caelestia/registry.py
- assistant/adapters/caelestia/shell/modules/sidebar/AiAssistant.qml
- assistant/adapters/caelestia/shell/services/CommandGate.qml
- assistant/adapters/caelestia/shell/services/SettingsTools.qml
- assistant/adapters/caelestia/tools.json
- ... and 2 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 14 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/02-capability-foundation
…w, issues, scan (migration chunk 2/12)

Zero-dependency capability tier: the capability package marker, its manifest registry, and the guard (memory pressure), dedupe, devflow, issues and scan capabilities. These import only the capability package itself, so they form a self-consistent stratum. (graph/ lands later: its query layer imports genius.)

Chunk contents (26 files):
- assistant/capabilities/__init__.py
- assistant/capabilities/_registry.py
- assistant/capabilities/dedupe/__init__.py
- assistant/capabilities/dedupe/manifest.py
- assistant/capabilities/dedupe/scan.py
- assistant/capabilities/devflow/__init__.py
- assistant/capabilities/devflow/__main__.py
- assistant/capabilities/devflow/diffstat.py
- assistant/capabilities/devflow/manifest.py
- assistant/capabilities/devflow/risk.py
- assistant/capabilities/devflow/todo.py
- assistant/capabilities/guard/__init__.py
- ... and 14 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 14 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/03-core-nlu-foundation
…arners, vectorization (migration chunk 3/12)

The core engine's NLU foundation: lexicon and phonetics, confusables, concepts, context, features, corpus/FTS store, conformal/abers/adwin learners, CRF/slot taggers, vectorization. Everything above imports these primitives.

Chunk contents (25 files):
- assistant/core/__init__.py
- assistant/core/abers.py
- assistant/core/adwin.py
- assistant/core/concepts.py
- assistant/core/conformal.py
- assistant/core/confusable_pairs.json
- assistant/core/confusables.py
- assistant/core/conservative.py
- assistant/core/context.py
- assistant/core/corpus.py
- assistant/core/crf_tagger.py
- assistant/core/dp.py
- ... and 13 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 14 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/04-core-cortex-eval
…d executor (migration chunk 4/12)

The rest of the core: cortex pipeline, router, dispatch, plans, schedules, inbox, personalization, refit, reranker, NL history, telemetry, the eval arena (dev/sealed sets) and the typed executor (argv-only, timeout-bounded plan runner). Note: dispatch and pipeline import the brain/settings capabilities at module level (upstream's own coupling); those imports resolve from chunks 07/08 onward.

Chunk contents (42 files):
- assistant/core/ask_pipeline.py
- assistant/core/cli.py
- assistant/core/coldstart.py
- assistant/core/compound.py
- assistant/core/coref.py
- assistant/core/delegate.py
- assistant/core/dispatch.py
- assistant/core/encoder_onnx.py
- assistant/core/engine_telemetry.py
- assistant/core/ensemble.py
- assistant/core/eval/__init__.py
- assistant/core/eval/__main__.py
- ... and 30 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 14 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/05-data-corpus
…ifact (migration chunk 5/12)

Local data tier: troubleshooting corpus, resolved-issue corpus, architecture docs, mined synonyms, paraphrase candidates and the built BM25 index artifact. Data only; no code imports it at module load (retrieval consumes it lazily).

Chunk contents (45 files):
- assistant/data/__init__.py
- assistant/data/corpus/DOC-ARCH-KWIN.md
- assistant/data/corpus/DOC-ARCH-LOCKSCREEN.md
- assistant/data/corpus/DOC-ARCH-SHORTCUT.md
- assistant/data/corpus/DOC-README.md
- assistant/data/corpus/DOC-TS-01.md
- assistant/data/corpus/DOC-TS-02.md
- assistant/data/corpus/DOC-TS-03.md
- assistant/data/corpus/DOC-TS-04.md
- assistant/data/corpus/DOC-TS-05.md
- assistant/data/corpus/DOC-TS-06.md
- assistant/data/corpus/DOC-TS-07.md
- ... and 33 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 15 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/06-diagnostics
…tion, forecasting (migration chunk 6/12)

The diagnostics capability: signed rulepacks (install/runtime/config_kde/known_regressions...), the diagnosis engine, rule rete, fusion, robust baselines, argumentation, forecast and telemetry.

Chunk contents (22 files):
- assistant/capabilities/diagnostics/__init__.py
- assistant/capabilities/diagnostics/argumentation.py
- assistant/capabilities/diagnostics/cli.py
- assistant/capabilities/diagnostics/drain.py
- assistant/capabilities/diagnostics/engine.py
- assistant/capabilities/diagnostics/forecast.py
- assistant/capabilities/diagnostics/fusion.py
- assistant/capabilities/diagnostics/manifest.py
- assistant/capabilities/diagnostics/rete.py
- assistant/capabilities/diagnostics/risk.py
- assistant/capabilities/diagnostics/robust_baseline.py
- assistant/capabilities/diagnostics/rulepack.py
- ... and 10 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 36 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/07-settings
…egistry, planner, applier (migration chunk 7/12)

The natural-language settings capability (issue #120): the frozen tool registry over the shell's settings schema, parser, planner, applier with bounded undo, presets, profiles, wizard, lint and the D-Bus surface.

Chunk contents (33 files):
- assistant/capabilities/settings/__init__.py
- assistant/capabilities/settings/__main__.py
- assistant/capabilities/settings/accessibility.py
- assistant/capabilities/settings/applier.py
- assistant/capabilities/settings/build_registry.py
- assistant/capabilities/settings/catalog.py
- assistant/capabilities/settings/causal.py
- assistant/capabilities/settings/cli.py
- assistant/capabilities/settings/consequences.py
- assistant/capabilities/settings/curations.py
- assistant/capabilities/settings/dbus_surface.py
- assistant/capabilities/settings/enumerate.py
- ... and 21 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 36 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/08-brain
…PKM engines (migration chunk 8/12)

The brain capability: proposals, ledger, bandits, NLP engines (kneser-ney, minhash, naive bayes), forecasting, anomaly, alignment/drift/calibration, the personal PKM engines with their in-package tests, and the QML/IPC bridge.

Chunk contents (74 files):
- assistant/capabilities/brain/__init__.py
- assistant/capabilities/brain/__main__.py
- assistant/capabilities/brain/align.py
- assistant/capabilities/brain/anomaly.py
- assistant/capabilities/brain/bandit.py
- assistant/capabilities/brain/bisect.py
- assistant/capabilities/brain/bridge.py
- assistant/capabilities/brain/brief.py
- assistant/capabilities/brain/bursts.py
- assistant/capabilities/brain/calibrate.py
- assistant/capabilities/brain/cli.py
- assistant/capabilities/brain/dreamtime.py
- ... and 62 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 37 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/09-genius-retrieval-generative
…trieval, generative fallback (migration chunk 9/12)

The genius universal intelligence layer (math/stats/logic/graphs/autodiff/sat/...), the knowledge-graph capability (whose query layer imports genius.graphs - hence this placement), the offline retrieval stack (BM25/CBR/disk index/structure mapping + corpus builders) and the opt-in generative fallback tier (RAG, reranker, assisted).

Chunk contents (53 files):
- assistant/capabilities/generative/__init__.py
- assistant/capabilities/generative/__main__.py
- assistant/capabilities/generative/assisted.py
- assistant/capabilities/generative/client.py
- assistant/capabilities/generative/manifest.py
- assistant/capabilities/generative/rag.py
- assistant/capabilities/generative/reranker.py
- assistant/capabilities/genius/__init__.py
- assistant/capabilities/genius/__main__.py
- assistant/capabilities/genius/angluin.py
- assistant/capabilities/genius/autodiff.py
- assistant/capabilities/genius/baysnet.py
- ... and 41 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 43 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/10-agent-shellkb-hub
…ub wiring (migration chunk 10/12)

The consent-gated agent (archetypes, goals, package probing), the shellkb shell-employee layer (CLI grammar, pubgrub, how-to) and the package completion: hub router, __main__, doctor composite health check and fixtures. From this branch the console entry point resolves every verb.

Chunk contents (25 files):
- assistant/__main__.py
- assistant/capabilities/agent/__init__.py
- assistant/capabilities/agent/__main__.py
- assistant/capabilities/agent/archetype_pack.py
- assistant/capabilities/agent/archetypes.py
- assistant/capabilities/agent/clarify.py
- assistant/capabilities/agent/cli.py
- assistant/capabilities/agent/engine.py
- assistant/capabilities/agent/goals.py
- assistant/capabilities/agent/manifest.py
- assistant/capabilities/agent/pkgprobe.py
- assistant/capabilities/shellkb/__init__.py
- ... and 13 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 44 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/11-tests-foundation
… tests, goldens (migration chunk 11/12)

The upstream test suite, part I: suite scaffolding (unittest harness, bash harness, seeded property helper), core/executor/brain tests, the sealed route goldens and the golden-lock guard. ~2,700 tests total across both test chunks.

Chunk contents (147 files):
- tests/__init__.py
- tests/brain/__init__.py
- tests/brain/test_ai_assistant_qml.py
- tests/brain/test_align.py
- tests/brain/test_anomaly_iforest.py
- tests/brain/test_bisect.py
- tests/brain/test_brain.py
- tests/brain/test_brain_v2.py
- tests/brain/test_bursts.py
- tests/brain/test_command_gate_qml.py
- tests/brain/test_config_drift.py
- tests/brain/test_dreamtime_throttle.py
- ... and 135 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 45 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

Next chunk: plugin/caelestia-assistant/12-tests-domains-scripts
…ng (migration chunk 12/12)

The upstream test suite, part II - every remaining capability test area (settings, diagnostics, retrieval, generative, genius, agent, shellkb, scan, dedupe, devflow, graph, issues) - plus the dev tooling (golden check, measurements, fuzz/determinism/hostile-input harnesses, completions). This completes the migration: the folder now mirrors upstream byte-for-byte.

Chunk contents (124 files):
- scripts/assemble_settings_tools.py
- scripts/completions/caelestia-assist.bash
- scripts/dev/NOTES.md
- scripts/dev/gen_paraphrases.py
- scripts/dev/measure_cli.py
- scripts/dev/measure_meanpool.py
- scripts/dev/measure_svd_delta.py
- scripts/dev/measure_svd_variants.py
- scripts/dev/mine_synonyms.py
- scripts/dev/z_deadcode.py
- scripts/dev/z_determinism.py
- scripts/dev/z_fuzz.py
- ... and 112 more

Source: 0x0nYx/caelestia-assistant@2c193e7 (main, v0.1)
Faithfulness: byte-identical copy (sha256-verified in the migration
audit; only metadata.json / README.md are plugin-store scaffolding,
and .caelestia-audit-ignore documents scanner false positives).
Safety audit: 0 errors; 60 line-level findings documented in .caelestia-audit-ignore (string vocabularies / rulepack prose / test assertion targets / opt-in provider calls - nothing executes).
Store CI: validate.py OK - check_safety.py OK - check_scope.py OK.

This is the final chunk: the migration is complete; the folder
mirrors caelestia-assistant@main byte-for-byte (verified).
@0x0nYx
0x0nYx marked this pull request as ready for review October 9, 2026 16:24
@0x0nYx
0x0nYx requested a review from 0xSolanaceae as a code owner October 9, 2026 16:24
@ladybug-me
ladybug-me changed the base branch from main to staging/caelestia-assistant October 24, 2026 09:41
@ladybug-me
ladybug-me merged commit 4bd4e1c into caelestia-kde:staging/caelestia-assistant Oct 24, 2026
@ladybug-me

Copy link
Copy Markdown
Collaborator

Review aur merging complete hua

Next, I will test this staging/caelestia-assisstant branch against our shell/

Once that is complete, if pluginsloader.qml doesn't require any changes, we can merge this with main and it will be available to everyone

@0x0nYx
0x0nYx deleted the plugin/caelestia-assistant/12-tests-domains-scripts branch October 24, 2026 14:15
@ladybug-me

Copy link
Copy Markdown
Collaborator

@0x0nYx
caelestia-assist worked flawlessly, great work👍

Now, lets talk about user interaction.
What are ur plans?

e.g. aiassistant.qml integration or as a tool for LLMs.

@0x0nYx

0x0nYx commented Oct 24, 2026

Copy link
Copy Markdown
Contributor Author

@0x0nYx caelestia-assist worked flawlessly, great work👍

Now, lets talk about user interaction. What are ur plans?

e.g. aiassistant.qml integration or as a tool for LLMs.

why not both... let things be flexible for users

@ladybug-me

Copy link
Copy Markdown
Collaborator

@0x0nYx alright, throw in a pr to staging branch when u get the chance

@0x0nYx

0x0nYx commented Oct 24, 2026

Copy link
Copy Markdown
Contributor Author

@0x0nYx alright, throw in a pr to staging branch when u get the chance

i will be deleting my account bruhhh.... i was just waiting for ts to be finished

@ladybug-me

Copy link
Copy Markdown
Collaborator

@0x0nYx alright, throw in a pr to staging branch when u get the chance

i will be deleting my account bruhhh.... i was just waiting for ts to be finished

Keep waiting 😜

@ladybug-me

Copy link
Copy Markdown
Collaborator

@0x0nYx Merged caelestia-assistant to main.
Thx for your contribution👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants