Add configurable GQA and MLA sliding-window draft layers - #767
Draft
maocheng23 wants to merge 2 commits into
Draft
Add configurable GQA and MLA sliding-window draft layers#767maocheng23 wants to merge 2 commits into
maocheng23 wants to merge 2 commits into