Skip to content

Add configurable GQA and MLA sliding-window draft layers - #767

Draft
maocheng23 wants to merge 2 commits into
sgl-project:mainfrom
maocheng23:agent/general-swa-attention
Draft

Add configurable GQA and MLA sliding-window draft layers#767
maocheng23 wants to merge 2 commits into
sgl-project:mainfrom
maocheng23:agent/general-swa-attention

Commits

Commits on Aug 15, 2026