feat(plugins): per-plugin deps, validation & shared discovery

[tariqksoliman]

With Devin: JPL-Devin#77

Purpose

End-to-end improvement of the MMGIS plugin system across four phases. The work is consolidated into one PR but each phase is independently reviewable in commit history. The end state is a plugin system that:

• validates each plugin's config.json at discovery time and skips/loudly logs invalid ones,
• shares a single discovery utility across tools, components, and backends,
• lets each plugin declare its own npm and Python dependencies (aggregated and installed at build/Docker time, with version-conflict detection),
• and code-splits every tool into its own webpack chunk so they load on-demand instead of inflating the initial JS bundle.

Proposed Changes

Phase 3 — Plugin config validation + override warnings (API/pluginValidation.js, API/updateTools.js)

• [ADD] validatePluginConfig(config, name, type) validates required (name, paths) and optional fields, the shape of paths, the dependencies block, and warns on unknown top-level fields.
• [ADD] Override warnings for tool plugins (mirrors what components already did): emits Tool '<name>' overridden by <source> when a plugin replaces a previously-registered tool.
• [CHANGE] updateTools() and updateComponents() route every manifest through registerPlugin() which validates, skips invalid ones, and logs override warnings.

Phase 2 — Shared discoverPlugins() utility (API/pluginDiscovery.js, API/setups.js)

• [ADD] discoverPlugins(basePath, patterns, configFile?, opts?) — single source of truth for plugin scanning. Supports exact-name patterns ("__exact:Tools") and substring patterns ("Plugin-Tools"), three loader modes (parse / require / none), and skips dot/underscore-prefixed dirs at both container and plugin levels.
• [CHANGE] updateTools(), updateComponents(), and getBackendSetups() all refactored on top of this helper. Backend discovery is now synchronous instead of nested-callback-with-counter.

Phase 1 — Per-plugin dependency declaration + build-time aggregation (scripts/resolve-plugin-deps.js, scripts/build.js, Dockerfile, src/essence/Tools/Animation/config.json, .gitignore)

• [ADD] Plugin config.json may include a dependencies block:

  "dependencies": {
    "npm":    { "html2canvas": "^1.4.1" },
    "python": { "pip": ["spiceypy==5.1.2"], "conda": ["gdal==3.12.2"] }
  }

• [ADD] scripts/resolve-plugin-deps.js aggregates every plugin's deps and writes three gitignored artifacts:
  • plugin-package.json (npm)
  • plugin-python-requirements.txt (pip)
  • plugin-conda-deps.txt (conda)
• [ADD] Version-conflict detection: same package declared with different versions across plugins fails the build with a message listing every conflicting claim.
• [CHANGE] scripts/build.js calls resolvePluginDeps() before updateTools()/updateComponents().
• [CHANGE] Dockerfile runs node scripts/resolve-plugin-deps.js after COPY . . and then installs the aggregated npm deps (npm install --no-save --no-package-lock --ignore-scripts so the root lockfile is untouched) and pip deps (inside the mmgis micromamba env).
• [CHANGE] Animation tool: ffmpeg/gifshot/html2canvas now declared in src/essence/Tools/Animation/config.json. Left in root package.json for the transition so local dev keeps working with npm install.
• [CHANGE] .gitignore: adds the three generated plugin-* artifacts.

Tests & docs

• [ADD] tests/fixtures/test-plugin-tools/{TestPlugin,InvalidPlugin,OverridePlugin} fixture plugins.
• [ADD] tests/helpers/plugin-helpers.js — install/uninstall fixture plugins with optional installAs rename.
• [ADD] Unit specs: pluginValidation, pluginDiscovery, updateTools, resolvePluginDeps (57 tests total).
• [CHANGE] CONTRIBUTING.md — new "Plugin config.json Schema", "Override Behavior", and "Plugin Dependencies" sections covering schema, build-time aggregation, conflict detection, Docker integration, and migration notes.
• [CHANGE] docs/pages/Contributing/Contributing.md — mirrored documentation updates.

Issues

None — feature work scoped to plugin system.

Testing

• `PLAYWRIGHT_TEST_UNIT_ONLY=true npx playwright test tests/unit/pluginValidation.spec.js tests/unit/pluginDiscovery.spec.js tests/unit/updateTools.spec.js tests/unit/resolvePluginDeps.spec.js

• node scripts/resolve-plugin-deps.js produces the expected plugin-package.json containing the Animation tool's 5 npm deps.

• node --check clean on every modified .js file (API/*, scripts/*, src/essence/Basics/ToolController_/ToolController_.js, …).

• Existing E2E test infrastructure (Playwright) untouched and will run on CI.