Commits

Commit history

1. Commits on May 8, 2023

   • Set repeat_penalty to 0 by default

     abetlen

     committed
     0d751a6View commit details

     Copy full SHA for 0d751a6

     View code at this pointBrowse repository at this point

   • Add openai frequency and presence penalty parameters. Closes #169

     abetlen

     committed
     65d9cc0View commit details

     Copy full SHA for 65d9cc0

     View code at this pointBrowse repository at this point

   • Bugfix for models endpoint

     abetlen

     committed
     a0b61eaView commit details

     Copy full SHA for a0b61ea

     View code at this pointBrowse repository at this point
2. Commits on May 7, 2023

   • Added cache size to settins object.

     abetlen

     committed
     14da46fView commit details

     Copy full SHA for 14da46f

     View code at this pointBrowse repository at this point

   • Add verbose flag to server

     abetlen

     committed
     627811eView commit details

     Copy full SHA for 627811e

     View code at this pointBrowse repository at this point

   • Fix mlock_supported and mmap_supported return type

     abetlen

     committed
     3fbda71View commit details

     Copy full SHA for 3fbda71

     View code at this pointBrowse repository at this point

   • Update cpu_count

     abetlen

     committed
     5a3413eView commit details

     Copy full SHA for 5a3413e

     View code at this pointBrowse repository at this point

   • Update settings fields and defaults

     abetlen

     committed
     1a00e45View commit details

     Copy full SHA for 1a00e45

     View code at this pointBrowse repository at this point

   • Revert "llama_cpp server: delete some ignored / unused parameters"

     Show description for 8675397
     abetlen

     committed
     8675397View commit details

     Copy full SHA for 8675397

     View code at this pointBrowse repository at this point

   • Revert "llama_cpp server: mark model as required"

     Show description for c382d8f
     abetlen

     committed
     c382d8fView commit details

     Copy full SHA for c382d8f

     View code at this pointBrowse repository at this point

   • Merge branch 'main' of github.com:abetlen/llama_cpp_python into better-server-params-and-fields

     abetlen

     committed
     d8fddccView commit details

     Copy full SHA for d8fddcc

     View code at this pointBrowse repository at this point
3. Commits on May 5, 2023

   • Add cli options to server. Closes #37

     abetlen

     committed
     24fc387View commit details

     Copy full SHA for 24fc387

     View code at this pointBrowse repository at this point
4. Commits on May 2, 2023

   • llama_cpp server: prompt is a string

     Show description for b9098b0
     Stonelinks

     committed
     b9098b0View commit details

     Copy full SHA for b9098b0

     View code at this pointBrowse repository at this point

   • Merge branch 'main' into better-server-params-and-fields

     abetlen

     authored
     7ab08b8View commit details

     Copy full SHA for 7ab08b8

     View code at this pointBrowse repository at this point

   • Refactor server to use factory

     abetlen

     committed
     9eafc4cView commit details

     Copy full SHA for 9eafc4c

     View code at this pointBrowse repository at this point
5. Commits on May 1, 2023

   • llama_cpp server: fix to ChatCompletionRequestMessage

     Show description for dbbfc4b
     Stonelinks

     committed
     dbbfc4bView commit details

     Copy full SHA for dbbfc4b

     View code at this pointBrowse repository at this point

   • llama_cpp server: fields for the embedding endpoint

     Stonelinks

     committed
     fa2a61eView commit details

     Copy full SHA for fa2a61e

     View code at this pointBrowse repository at this point

   • llama_cpp server: define fields for chat completions

     Show description for 8dcbf65
     Stonelinks

     committed
     8dcbf65View commit details

     Copy full SHA for 8dcbf65

     View code at this pointBrowse repository at this point

   • llama_cpp server: add some more information to fields for completions

     Stonelinks

     committed
     978b6daView commit details

     Copy full SHA for 978b6da

     View code at this pointBrowse repository at this point

   • llama_cpp server: add missing top_k param to CreateChatCompletionRequest

     Show description for a5aa6c1
     Stonelinks

     committed
     a5aa6c1View commit details

     Copy full SHA for a5aa6c1

     View code at this pointBrowse repository at this point

   • llama_cpp server: move logprobs to supported

     Show description for 1e42913
     Stonelinks

     committed
     1e42913View commit details

     Copy full SHA for 1e42913

     View code at this pointBrowse repository at this point

   • llama_cpp server: delete some ignored / unused parameters

     Show description for b47b954
     Stonelinks

     committed
     b47b954View commit details

     Copy full SHA for b47b954

     View code at this pointBrowse repository at this point

   • llama_cpp server: mark model as required

     Show description for e40fcb0
     Stonelinks

     committed
     e40fcb0View commit details

     Copy full SHA for e40fcb0

     View code at this pointBrowse repository at this point

   • Fix import error

     abetlen

     committed
     9ff9cddView commit details

     Copy full SHA for 9ff9cdd

     View code at this pointBrowse repository at this point
6. Commits on Apr 29, 2023

   • llama_cpp server: slight refactor to init_llama function

     Show description for efe8e6f
     Stonelinks

     committed
     efe8e6fView commit details

     Copy full SHA for efe8e6f

     View code at this pointBrowse repository at this point

   • tests: simple test for server module

     Stonelinks

     committed
     6d8db9dView commit details

     Copy full SHA for 6d8db9d

     View code at this pointBrowse repository at this point

   • llama_cpp server: app is now importable, still runnable as a module

     Stonelinks

     committed
     468377bView commit details

     Copy full SHA for 468377b

     View code at this pointBrowse repository at this point
7. Commits on Apr 25, 2023

   • Update n_batch for server

     abetlen

     committed
     3cab3efView commit details

     Copy full SHA for 3cab3ef

     View code at this pointBrowse repository at this point
8. Commits on Apr 19, 2023

   • Add use_mmap flag to server

     abetlen

     committed
     e4647c7View commit details

     Copy full SHA for e4647c7

     View code at this pointBrowse repository at this point
9. Commits on Apr 15, 2023

   • Add experimental cache

     abetlen

     committed
     92c0771View commit details

     Copy full SHA for 92c0771

     View code at this pointBrowse repository at this point
10. Commits on Apr 14, 2023

    • Fix completion request

      abetlen

      committed
      6c7cec0View commit details

      Copy full SHA for 6c7cec0

      View code at this pointBrowse repository at this point
11. Commits on Apr 13, 2023

    • Formatting

      abetlen

      committed
      4f5f99eView commit details

      Copy full SHA for 4f5f99e

      View code at this pointBrowse repository at this point
12. Commits on Apr 12, 2023

    • Enable logprobs on completion endpoint

      abetlen

      committed
      0daf16dView commit details

      Copy full SHA for 0daf16d

      View code at this pointBrowse repository at this point

    • Fix threading bug. Closes #62

      abetlen

      committed
      19598acView commit details

      Copy full SHA for 19598ac

      View code at this pointBrowse repository at this point

    • Implement logprobs parameter for text completion. Closes #2

      abetlen

      committed
      b3805bbView commit details

      Copy full SHA for b3805bb

      View code at this pointBrowse repository at this point