Skip to content

cuda: stream TurboQuant MoE experts from pinned host memory - #364

Merged
TheTom merged 6 commits into
TheTom:feature/turboquant-kv-cachefrom
jasstrong:pr/tq-moe-paging-rework
Sep 19, 2026
Merged

TheTom merged 6 commits into
TheTom:feature/turboquant-kv-cachefrom
jasstrong:pr/tq-moe-paging-rework