Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Sep 30, 2023

• Log server exceptions to stdout

  abetlen

  committed
  5ef5280

  Copy full SHA for 5ef5280

Commits on Sep 29, 2023

• Update server params

  abetlen

  committed
  d9bce17

  Copy full SHA for d9bce17

Commits on Sep 25, 2023

• Adds openai-processing-ms response header (#748)

  

  Viacheslav/Slava Tradunsky

  authored
  3d5e5b1

  Copy full SHA for 3d5e5b1

Commits on Sep 15, 2023

• Remove confusing helpstring from server cli args. Closes #719

  abetlen

  committed
  b047b30

  Copy full SHA for b047b30

Commits on Sep 14, 2023

• Fix boolean env vars and cli arguments

  abetlen

  committed
  0449d29

  Copy full SHA for 0449d29

• Update app.py (#705)

  earonesty

  authored
  58a6e42

  Copy full SHA for 58a6e42

• Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs.

  abetlen

  committed
  f4090a0

  Copy full SHA for f4090a0

• Fix boolean cli flags

  abetlen

  committed
  c999325

  Copy full SHA for c999325

• Format

  abetlen

  committed
  4daf77e

  Copy full SHA for 4daf77e

• Update server params. Added lora_base, lora_path, low_vram, and main_gpu. Removed rms_norm_eps and n_gqa (deprecated in llama.cpp)

  abetlen

  committed
  2920c4b

  Copy full SHA for 2920c4b

• Fix tensor_split cli option

  abetlen

  committed
  c4c440b

  Copy full SHA for c4c440b

Commits on Sep 13, 2023

• Fix issue with Literal and Optional cli arguments not working. Closes #702

  abetlen

  committed
  759405c

  Copy full SHA for 759405c

• Add X-Request-ID request header for mirroring custom IDs. (#703)

  devrimcavusoglu

  authored
  da9df78

  Copy full SHA for da9df78

Commits on Sep 12, 2023

• Merge branch 'main' into v0.2-wip

  abetlen

  committed
  1910793

  Copy full SHA for 1910793

Commits on Aug 25, 2023

• Add copilot-codex completions endpoint for drop-in copilot usage

  abetlen

  committed
  5de8009

  Copy full SHA for 5de8009

Commits on Aug 24, 2023

• Merge branch 'main' into v0.2-wip

  abetlen

  committed
  cf405f6

  Copy full SHA for cf405f6

Commits on Aug 8, 2023

• Add mul_mat_q option

  abetlen

  committed
  d015bdb

  Copy full SHA for d015bdb

Commits on Jul 24, 2023

• Merge branch 'main' into v0.2-wip

  abetlen

  committed
  3434803

  Copy full SHA for 3434803

• Add temporary rms_norm_eps parameter

  abetlen

  committed
  11dd2bf

  Copy full SHA for 11dd2bf

Commits on Jul 20, 2023

• Merge branch 'main' into v0.2-wip

  abetlen

  committed
  0538ba1

  Copy full SHA for 0538ba1

• Fix compatibility with older python versions

  abetlen

  committed
  28a1117

  Copy full SHA for 28a1117

• Merge pull request #481 from c0sogi/main

  Show description for 365d9a4
  abetlen

  authored
  365d9a4

  Copy full SHA for 365d9a4

Commits on Jul 19, 2023

• Format

  abetlen

  committed
  0b121a7

  Copy full SHA for 0b121a7

• Add functions parameters

  abetlen

  committed
  b43917c

  Copy full SHA for b43917c

Commits on Jul 18, 2023

• Use numpy arrays for logits_processors and stopping_criteria. Closes #491

  abetlen

  committed
  19ba9d3

  Copy full SHA for 19ba9d3

• expose RoPE param to server start

  

  shutup

  committed
  5ed8bf1

  Copy full SHA for 5ed8bf1

Commits on Jul 16, 2023

• Added `RouteErrorHandler` for server

  c0sogi

  committed
  1551ba1

  Copy full SHA for 1551ba1

Commits on Jul 14, 2023

• fix: tensor_split should be optional list

  abetlen

  committed
  118b7f6

  Copy full SHA for 118b7f6

• Resolve merge conflicts

  

  Shouyi Wang

  committed
  579f526

  Copy full SHA for 579f526

• bugfix: pydantic v2 fields

  abetlen

  committed
  de4cc5a

  Copy full SHA for de4cc5a

Commits on Jul 9, 2023

• bugfix: pydantic settings missing / changed fields

  abetlen

  committed
  6f70cc4

  Copy full SHA for 6f70cc4

• Add tensor split

  

  Shouyi Wang

  committed
  9f21f54

  Copy full SHA for 9f21f54

Commits on Jul 8, 2023

• Upgrade fastapi to 0.100.0 and pydantic v2

  abetlen

  committed
  52753b7

  Copy full SHA for 52753b7

Commits on Jul 7, 2023

• Add setting to control request interruption

  abetlen

  committed
  57d8ec3

  Copy full SHA for 57d8ec3

• Add interruptible streaming requests for llama-cpp-python server. Closes #183

  abetlen

  committed
  4c7cdcc

  Copy full SHA for 4c7cdcc