Repository navigation

All pull requests

Labels (101)Milestones (9)New pull request

llama: exclude unloaded MTP layers from GPU placement counts
#31278Topazoo opened Oct 27, 20261 task done
hexagon: improve DDR bw utilization in transposed CONCAT
#31277trivikram-reddy1 opened Oct 27, 2026Contributor
ggml : fix clang-cl build with AVX512 BF16
#31276YagUber opened Oct 27, 2026
model : add LiquidAI/d1-2B and LiquidAI/d1-omni-2B
#31275tdakhran opened Oct 27, 2026Contributor
Save host memory for scheduler context sizing and graph metadata allocation
#31274joelagnel opened Oct 27, 2026Contributor
1
ui: build the reasoning menu from the template effort levels
#31273ServeurpersoCom opened Oct 27, 2026Contributor
server: expose the reasoning effort levels of the chat template
#31271ServeurpersoCom opened Oct 27, 2026Contributor
cann: fail early when checking if buffer type is supported
#31270rauletorresc opened Oct 27, 2026Contributor
server : add realtime conversation and transcription on /v1/realtime
#31269tdakhran opened Oct 27, 2026Contributor
1
CUDA: optimize Orin single-column MMVQ
#31268meitmt opened Oct 27, 20261 task done
opencl: initial support for iq2
#31267lhez opened Oct 27, 2026Contributor
vulkan: avoid redundant scans when zeroing skipped rows
#31266SG-Amadeus opened Oct 27, 2026Contributor
tests: fix CI riscv timeout in test-llama-context
#31265ServeurpersoCom opened Oct 27, 2026Contributor
docs: explain GGML_CUDA_FA_QUANTS and FlashAttention KV combinations
#31264Midvard-stark opened Oct 27, 2026
HIP/CUDA: enable sparse attn on CDNA
#31259IMbackK opened Oct 27, 2026Contributor
6
llama : add CPU LoRA fine-tuning for dense and hybrid models
#31258gianni-cor opened Oct 27, 2026Contributor
1
tests : adjust constants to reduce irrelevant warnings
#31254ggerganov opened Oct 27, 2026Member
Enable -sm tensor for LLM_ARCH_GLM5_NEXT (GLM-5.3-Flash / GLM5-Ne…
#31253lee-b opened Oct 27, 2026
2
sycl : add reordered IQ4_XS MMVQ
#31251zhaoyshine opened Oct 27, 2026
docs: CANN backend supports BF16 on 910B, document GGML_CANN_NO_PINNED
#31249li-lizhe opened Oct 27, 2026
1
ui : show save and reset settings buttons only when relevant
#31248allozaur opened Oct 27, 2026Contributor
1
cuda: potential fix for Q8_1 correction sum
#31247mmalpe-nv opened Oct 27, 2026
1
server: preserve sampled token IDs across native SSE buffering
#31244bytkim opened Oct 27, 2026
common : escape raw control bytes in json-schema-to-grammar
#31241b1u3bird opened Oct 27, 2026
1
ui: Support OGG audio attachments by converting them to WAV
#31237allozaur opened Oct 27, 2026Contributor
2