Skip to content

Sync Cosmos3 Diffusers converter support - #110

Merged
lfengad merged 6 commits into
mainfrom
liangf/sync-diffusers-converter-options
Jul 15, 2026
Merged

Sync Cosmos3 Diffusers converter support#110
lfengad merged 6 commits into
mainfrom
liangf/sync-diffusers-converter-options

Conversation

@lfengad

@lfengad lfengad commented Jul 14, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • support Cosmos3 checkpoints with optional action and sound generation
  • support current and legacy AVAE/tokenizer layouts and framework-native VLM config layouts
  • make language-model remapping reject collisions and exclude visual weights from the text transformer
  • support both legacy and current action projection module names
  • add --skip-vision-encoder and make --config-only work with an empty output directory
  • generate a top-level safetensors index that matches the files actually exported
  • keep the converter implementation aligned with the corresponding Cosmos3 package implementation, apart from repository-specific imports and licensing
  • add a GPU CI regression that converts the staged Nano DCP, validates the complete Diffusers output against the public Nano reference indexes, and always removes the generated output

Validation

  • converted a Cosmos3-Nano DCP checkpoint to a complete Diffusers checkpoint
  • verified all 10 exported safetensors files byte-for-byte against nvidia/Cosmos3-Nano
  • verified the unified index contains 1,165 tensors with no dangling file references
  • loaded the output with Cosmos3OmniPipeline and ran one-step video-plus-sound inference with finite outputs
  • verified pytest collection selects the new Nano Diffusers conversion test in the generator GPU workflow
  • Ruff check, py_compile, YAML parse, and git diff --check pass

@lfengad
lfengad enabled auto-merge (squash) July 14, 2026 14:45
@lfengad
lfengad disabled auto-merge July 15, 2026 06:39
@lfengad
lfengad merged commit bc44b1e into main Jul 15, 2026
8 checks passed
@lfengad
lfengad deleted the liangf/sync-diffusers-converter-options branch July 15, 2026 06:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants