Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Apr 1, 2024

• feat: add support for KV cache quantization options (#1307)

  Show description for f165048
  

  Limour-dev

  and

  abetlen

  authored
  f165048

  Copy full SHA for f165048

Commits on Feb 28, 2024

• misc: Format

  abetlen

  committed
  727d60c

  Copy full SHA for 727d60c

• feat: Update llama.cpp

  abetlen

  committed
  0d37ce5

  Copy full SHA for 0d37ce5

Commits on Feb 26, 2024

• feat(server): Add support for pulling models from Huggingface Hub (#1222)

  Show description for 4d574bd
  abetlen

  authored
  4d574bd

  Copy full SHA for 4d574bd

• fix: remove prematurely commited change

  abetlen

  committed
  dcf38f6

  Copy full SHA for dcf38f6

Commits on Feb 25, 2024

• feat: Update llama.cpp

  abetlen

  committed
  2292af5

  Copy full SHA for 2292af5

Commits on Feb 17, 2024

• feat: Update llama.cpp

  abetlen

  committed
  fdce078

  Copy full SHA for fdce078

Commits on Jan 31, 2024

• Add speculative decoding (#1120)

  Show description for fb762a6
  abetlen

  authored
  fb762a6

  Copy full SHA for fb762a6

Commits on Jan 29, 2024

• Automatically set chat format from gguf (#1110)

  Show description for da003d8
  abetlen

  authored
  da003d8

  Copy full SHA for da003d8

Commits on Jan 19, 2024

• feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

  abetlen

  committed
  b8fc1c7

  Copy full SHA for b8fc1c7

Commits on Jan 18, 2024

• Offload KQV by default

  abetlen

  committed
  48c3b77

  Copy full SHA for 48c3b77

Commits on Jan 16, 2024

• fix(cli): allow passing n_ctx=0 to openAI API server args to use model n_ctx_train field per #1015 (#1093)

  K-Mistele

  authored
  9c36688

  Copy full SHA for 9c36688

Commits on Jan 15, 2024

• Add split_mode option. Closes #1085

  abetlen

  committed
  84615ad

  Copy full SHA for 84615ad

• Implement GGUF metadata KV overrides (#1011)

  Show description for 76aafa6
  

  phiharri

  and

  abetlen

  authored
  76aafa6

  Copy full SHA for 76aafa6

Commits on Dec 22, 2023

• docs: add server config docs

  abetlen

  committed
  522aecb

  Copy full SHA for 522aecb

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2f

  Copy full SHA for 12b7f2f

Loading