Skip to content

Pull requests: ikawrakow/ik_llama.cpp

New pull request New
28 Open 1,415 Closed
28 Open 1,415 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Bucket top_k (CPU): ~3% better TG at 128k context
#2225 opened Aug 1, 2026 by ikawrakow Owner Loading…
window-sized SWA ring KV cache (--swa-compress to opt in)
#2171 opened Jul 23, 2026 by joaomdsg Loading…
35
Fix RPC crash with dflash
#2167 opened Jul 23, 2026 by firecoperana Collaborator Loading…
1
6
NaN crash in mul_mat_iq4_nl_r4_q8_2 when not divisible by 256
#2154 opened Jul 18, 2026 by cora4 Contributor • Draft
2
CUDA sm_60: bound the fp16 flash-attention error on P100 prefill instead of disabling the fast path
#2151 opened Jul 18, 2026 by mb8565 Contributor Loading…
6
ggml : fix build and MoE inference on CPUs without AVX2 (AVX1-only)
#2138 opened Jul 15, 2026 by neomindryan Loading…
2 of 4 tasks
6
llama: disable fused up-gate when an offload backend lacks GGML_OP_FUSED_UP_GATE (fixes silent 3.5x Metal slowdown)
#2133 opened Jul 15, 2026 by hchengit Contributor Loading…
4
Scope split-mode graph mmap to the tensor being loaded. Prevents memory leak
#2126 opened Jul 13, 2026 by Farmadupe Contributor • Draft
2 of 4 tasks
Reduce host memory pressure when performing a sm graph load.
#2125 opened Jul 13, 2026 by Farmadupe Contributor • Draft
1
CUDA: update captured graph when a source tensor's shape changes
#2096 opened Jul 8, 2026 by fibrahimov Loading…
3
Be able to force synchronization when copying graph inputs
#2092 opened Jul 6, 2026 by ikawrakow Owner Loading…
1
add --split-output-tensor / -sot CLI parameter
#2056 opened Jun 29, 2026 by Nexesenex Contributor • Draft
2 of 4 tasks
2
implement perplexity in llama-server
#2011 opened Jun 22, 2026 by magikRUKKOLA Contributor • Draft
2
fix: checkpoint restore for hybrid/recurrent models
#1976 opened Jun 16, 2026 by razlani Loading…
1
5
Fix misc. expiring logit/sparam bias bugs
#1914 opened Jun 2, 2026 by dungquixote42 Contributor Loading…
2 of 4 tasks
9
Qwen3.5 MTP: extract selected tokens earlier
#1892 opened May 28, 2026 by ikawrakow Owner Loading…
server: enable checkpoint reuse for recurrent/hybrid models (qwen3next, Mamba)
#1888 opened May 26, 2026 by localweights Loading…
1
3
Fix prompt cache viability
#1877 opened May 25, 2026 by zeljkokalezic Loading…
2 of 4 tasks
5
docs: Complete rewrite of build.md – CMake-only, focused on supported backends
#1853 opened May 21, 2026 by maddes8cht Loading…
2 of 4 tasks
76
A GGUF MTP Extract and Merge Tool
#1849 opened May 20, 2026 by FNsi • Draft
2 of 4 tasks
2
cuda: add get_rows CUDA kernels for Q4_K, Q5_K, Q6_K
#1830 opened May 18, 2026 by localweights Loading…
5
Slightly expand the usage of VNNI256
#1764 opened May 9, 2026 by XZiar Contributor Loading…
2 of 4 tasks
1
A GGUF editor, which can be use to duplicate or delete layers in Qwen3.5 / Qwen Coder Next or whatever but may not run in 1 shot.
#1746 opened May 6, 2026 by FNsi • Draft
1 of 3 tasks
14
runtime : add --run-time-repack auto mode for swap-bound MoE safety
#1738 opened May 4, 2026 by AndrewMoryakov Contributor Loading…
2 of 4 tasks
12
Change signature of llama_set_draft_input_hidden_state
#1727 opened May 3, 2026 by ikawrakow Owner Loading…
3
ProTip! Follow long discussions with comments:>50.