MUSA: switch Ubuntu 22.04 image to system Python 3.12 - #119
Conversation
Follow-up: registry-control S5000 A/BI compared this PR's Python 3.12 image with the new Python 3.10 registry
Contract
Primary result: uncontaminated A1 -> B1 pairThe timestamps prove this first pair completed before any unrelated GPU
There is no material throughput or p99 regression in the clean pair. There is Isolation caveatThe broker returned an The later pair was directionally consistent (all throughput deltas remained Functional gate and decisionAll 3,072 measured requests in the four-session run completed with zero Decision: continue review of this draft PR. The current evidence supports |
Summary
without uv or a virtual environment.
Python 3.12.
cp310 wheel in a cp312 image.
vllm-rs.Wheel compatibility
The live Moore Threads index was checked before implementation. The required
cp312-capable set includes native wheels for
torch,torch_musa,torchvision,torchaudio,deep_ep,triton,apache-tvm-ffi, andtorch-c-dlpack-ext.tilelang_musais cp38-abi3; MATE, FlashAttention 3,FlashMLA, DeepGEMM, and SageAttention are pure-Python wheels.
Validation
codex/musa-60032-python312-image2f58508434663abcca0db808afa360b7cf287860v0.24.0-devate96a974b91063198f84f432b5fcfac991f95639evllm-musa:python312-2f58508-finalsha256:850d5cb5b78025b77089517158f34667b2fb71f9ce432414a66f96800d89a587sys.prefix == sys.base_prefix == /usr, nouv,no
python3.12-venv, required MUSA imports pass.python3 -m pytest -q tests/test_inplace_porting_contract.py(
12 passed),bash -n docker/build_image.sh, andgit diff --checkpass.MTT S5000 card; backend logs show MUSA
FLASH_ATTNandFULL_AND_PIECEWISEcompilation/capture.measured runs, same physical S5000 card, Python frontend on both sides.
Review caveats
BUILD_VLLM_RS=0andBUILD_MOONCAKE=0because the optional source downloads were unavailable in the build network;
the A/B explicitly used
VLLM_USE_RUST_FRONTEND=0on both images.musa5.2.0wheels; the registry control usesmusa5.2.0s5000wheels. The performance result is therefore a whole-imagecomparison, not a causal Python-only comparison.
no stable Python 3.12 uplift was observed. One candidate BS=64 run had a
one-off capture/scheduling outlier, retained in the local evidence bundle.
The bulky local smoke/A-B logs and normalized table are retained under
generated/MUSA-60032/20260723-python312-image-ab/in the developmentworkspace and are not added to this source PR.
Review follow-ups
third_party/PINSretains a build-box/package-floor comment mentioningPython 3.10; it has no runtime effect but can be refreshed during review.
retry behavior for transient Launchpad failures is a possible hardening item.