Skip to content

docs: add npu tutorial - #762

Merged
jiapingW merged 2 commits into
sgl-project:mainfrom
curnane-lab:add_npu_doc
Aug 17, 2026
Merged

docs: add npu tutorial#762
jiapingW merged 2 commits into
sgl-project:mainfrom
curnane-lab:add_npu_doc

Conversation

@curnane-lab

@curnane-lab curnane-lab commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

Motivation

The Ascend NPU managed-local stack landed in #722 but ships no documentation: the two SGLang patches, the device-visibility semantics, and the NPU-only constraints are currently only discoverable from PR descriptions. This PR adds the missing end-to-end Ascend tutorial, following the AMD ROCm template from #698, and ticks the docs checkbox left over from #722.

Modifications

  • docs/basic_usage/Ascend/ascend_npu.md: new tutorial — installation (--no-deps + the base/companion capture patches applied in order), data preparation, online training against an external capture server, the one-command managed-local full stack (including a 6:10 capture/trainer override and rerun cleanup), multi-node role split, an NPU troubleshooting list (empty ASCEND_RT_VISIBLE_DEVICES rejected by the driver, USP/yunchang CUDA-only, wildcard Mooncake registration, ACL_ERROR_RT_CONTEXT_NULL, teardown drain TTL), and the validated 16-card A3 reference results from feat(npu): managed-local disaggregated DFlash online training on Ascend NPU #722 with training curves.
  • docs/index.rst: register the tutorial in the Basic Usage toctree next to the ROCm one.

Related Issues

Accuracy Test

NA (documentation only). The tutorial's reference results reproduce the validated 16-card A3 run from #722 (loss ~6.0 -> ~2.0 over ~1.18k steps).

Benchmark & Profiling

NA (documentation).

Checklist

@curnane-lab
curnane-lab marked this pull request as ready for review August 10, 2026 12:31
@jiapingW
jiapingW self-requested a review August 17, 2026 07:05
@jiapingW
jiapingW merged commit 4c8e0c3 into sgl-project:main Aug 17, 2026
3 checks passed
@jiapingW
jiapingW deleted the add_npu_doc branch August 17, 2026 07:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants