Commits

Breadcrumbs

History for

ondisk_cache_server

User selector

All users

All time

Commit History

Commits on Mar 9, 2024

• feat: Add endpoints for tokenize, detokenize and count tokens (#1136)

  Show description for c139f8b
  

  felipelo

  and

  abetlen

  authored
  c139f8b

  Copy full SHA for c139f8b

Commits on Feb 28, 2024

• misc: Format

  abetlen

  committed
  727d60c

  Copy full SHA for 727d60c

Commits on Feb 15, 2024

• fix: Use '\n' seperator for EventSourceResponse (#1188)

  Show description for ea1f88d
  

  khimaros

  and

  abetlen

  authored
  ea1f88d

  Copy full SHA for ea1f88d

Commits on Jan 25, 2024

• feat(server): include llama-cpp-python version in openapi spec

  abetlen

  committed
  cde7514

  Copy full SHA for cde7514

Commits on Jan 16, 2024

• Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)

  Show description for cfb7da9
  

  3 peopleauthored
  cfb7da9

  Copy full SHA for cfb7da9

Commits on Dec 22, 2023

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2f

  Copy full SHA for 12b7f2f

Commits on Dec 21, 2023

• Implement openai api compatible authentication (#1010)

  docmeth02

  authored
  33cc623

  Copy full SHA for 33cc623

Commits on Dec 18, 2023

• Add offload_kqv option to llama and server

  abetlen

  committed
  095c650

  Copy full SHA for 095c650

• Bugfix: Remove f16_kv, add offload_kqv field (#1019)

  Show description for 62944df
  brandonrobertz

  authored
  62944df

  Copy full SHA for 62944df

Commits on Dec 12, 2023

• Add support for running the server with SSL (#994)

  rgerganov

  authored
  8e44a32

  Copy full SHA for 8e44a32

Commits on Nov 24, 2023

• docs: Update openapi endpoint names

  abetlen

  committed
  1a7bf20

  Copy full SHA for 1a7bf20

Commits on Nov 21, 2023

• Fix #569

  abetlen

  committed
  128dc47

  Copy full SHA for 128dc47

• Format

  abetlen

  committed
  7a3f878

  Copy full SHA for 7a3f878

• Add support for logit_bias outside of server api. Closes #827

  abetlen

  committed
  07e47f5

  Copy full SHA for 07e47f5

• Added support for min_p (#921)

  Show description for b8438f7
  tk-master

  authored
  b8438f7

  Copy full SHA for b8438f7

Commits on Nov 10, 2023

• Fix: default max_tokens matches openai api (16 for completion, max length for chat completion)

  abetlen

  committed
  e7962d2

  Copy full SHA for e7962d2

Commits on Nov 8, 2023

• Fix destructor NoneType is not callable error

  abetlen

  committed
  ca4cb88

  Copy full SHA for ca4cb88

• Add JSON mode support. Closes #881

  abetlen

  committed
  b30b9c3

  Copy full SHA for b30b9c3

• Add seed parameter support for completion and chat_completion requests. Closes #884

  abetlen

  committed
  86aeb9f

  Copy full SHA for 86aeb9f

• Multimodal Support (Llava 1.5) (#821)

  Show description for aab74f0
  

  damian0815

  and

  abetlen

  authored
  aab74f0

  Copy full SHA for aab74f0

Commits on Nov 3, 2023

• Update llama.cpp

  abetlen

  committed
  df9362e

  Copy full SHA for df9362e

• Add functionary support (#784)

  Show description for 3af7b21
  abetlen

  authored
  3af7b21

  Copy full SHA for 3af7b21

Commits on Nov 2, 2023

• Update llama.cpp

  Show description for fa83cc5
  abetlen

  committed
  fa83cc5

  Copy full SHA for fa83cc5

• fix: tokenization of special characters: (#850)

  Show description for 4d4e0f1
  

  antoine-lizee

  authored and

  abetlen

  committed
  4d4e0f1

  Copy full SHA for 4d4e0f1

Commits on Nov 1, 2023

• Iterate over tokens that should be biased rather than the entire vocabulary. (#851)

  zolastro

  authored
  3fc9147

  Copy full SHA for 3fc9147

• Pass-Through grammar parameter in web server. (#855) Closes #778

  dthuerck

  authored
  5f8f369

  Copy full SHA for 5f8f369

Commits on Oct 18, 2023

• update value check for n_gpu_layers field (#826)

  hxy9243

  authored
  a315128

  Copy full SHA for a315128

Commits on Oct 10, 2023

• Print traceback on server error

  abetlen

  committed
  d6a130a

  Copy full SHA for d6a130a

Commits on Sep 30, 2023

• Log server exceptions to stdout

  abetlen

  committed
  5ef5280

  Copy full SHA for 5ef5280

Commits on Sep 29, 2023

• Update server params

  abetlen

  committed
  d9bce17

  Copy full SHA for d9bce17

Commits on Sep 25, 2023

• Adds openai-processing-ms response header (#748)

  

  Viacheslav/Slava Tradunsky

  authored
  3d5e5b1

  Copy full SHA for 3d5e5b1

Commits on Sep 14, 2023

• Update app.py (#705)

  earonesty

  authored
  58a6e42

  Copy full SHA for 58a6e42

• Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.

  abetlen

  committed
  f4090a0

  Copy full SHA for f4090a0

• Format

  abetlen

  committed
  4daf77e

  Copy full SHA for 4daf77e

• Update server params. Added lora_base, lora_path, low_vram, and main_gpu. Removed rms_norm_eps and n_gqa (deprecated in llama.cpp)

  abetlen

  committed
  2920c4b

  Copy full SHA for 2920c4b