build: upgrade Mooncake MUSA wheel to 0.3.13 - #203
Merged
zichen-kuuga merged 2 commits intoSep 7, 2026
Merged
zichen-kuuga merged 2 commits into
zichen-kuuga merged 2 commits into
Conversation
yeahdongcn
reviewed
Aug 28, 2026
yeahdongcn
marked this pull request as draft
August 31, 2026 02:45
Elon-yf
force-pushed
the
codex/musa-90026-mooncake-te-0313
branch
from
September 7, 2026 03:45
a4a81ee to
edf0422
Compare
Elon-yf
marked this pull request as ready for review
September 7, 2026 05:26
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
0.3.12.post1to0.3.13in the vLLM-MUSA image path.MooncakeConnector; add only the v0.28compatibility needed for MUSA's K/V-first cache layout.
Validation
Candidate:
vllm-musa=a4a81ee4314d9a1d6c1d8e96a2376e9aee13d430Upstream vLLM:
2cf0a6915ce544dc493a0990f2ea38d81601128aDriver:
5.2.0-serverTorch/MUSA:
2.11.0.post1+musa5.2.0Mooncake:
0.3.1325 passed.f8d54776bd4b66f3c74b33587e30148694105c5792075d3ffd8904184124b3f7.SUPPORT_MUSA=True, two visible MUSA devices, and no generic CUDA Mooncakedistribution installed.
Package/runtime evidence:
sync/batched/async write, sync read, probe/error paths, completion status,
and payload correctness. The runtime selected RDMA with
MC_FORCE_HCA=1.RDMA runtime evidence:
default,auto, andtransfer_batch: 6/6 cases completed write/readback andpayload validation. All cases selected the MUSA transport with no RDMA/TCP
selection.
MUSA IPC/P2P runtime evidence:
The complete matrix is 2 directions x 3 copy policies; all 6 result records
reported
protocol="musa"andpayload_ok=true.threshold:
-2.10%for 32 MiB single write and-1.97%for 128 x 256 KiBbatch write.
Scope
This validates Mooncake MUSA wheel functionality on the tested single-node,
two-GPU S5000 environment with MUSA driver 5.2.0. The MUSA Transfer Engine
implementation comes from the upstream
0.3.13wheel; this repository carriesthe image/build contract and the v0.28 cache-layout compatibility patch.
This PR does not claim vLLM model performance, streaming, FA3, FlashMLA,
cross-node MUSA IPC, long-duration stability, failure recovery, or CUDA-wheel
compatibility. The A1/B/A2 result is an image-level TE regression check, not
strict wheel-only performance attribution.