Commits

Commit history

1. Commits on Apr 5, 2024

   • Release v0.2.0 (#31)

     Show description for ae2ca8c
     JoeZijunZhou

     authored
     ae2ca8cView commit details

     Copy full SHA for ae2ca8c

     Browse repository at this point
2. Commits on Apr 4, 2024

   • Update README (#30)

     Show description for 10bd138
     JoeZijunZhou

     authored
     10bd138View commit details

     Copy full SHA for 10bd138

     Browse repository at this point

   • Enable pylint linter and pyink formatter (#29)

     Show description for 385ecac
     JoeZijunZhou

     authored
     385ecacView commit details

     Copy full SHA for 385ecac

     Browse repository at this point
3. Commits on Apr 3, 2024

   • Support JetStream MaxText user guide (#28)

     JoeZijunZhou

     authored
     90b2a9dView commit details

     Copy full SHA for 90b2a9d

     Browse repository at this point

   • move tokenizer model to third party llama2 (#27)

     FanhaiLu1

     authored
     426c915View commit details

     Copy full SHA for 426c915

     Browse repository at this point
4. Commits on Apr 2, 2024

   • Update ckpt conversion scripts (#25)

     JoeZijunZhou

     authored
     a7e7e81View commit details

     Copy full SHA for a7e7e81

     Browse repository at this point

   • refactor to sample before tokenize (#26)

     morgandu

     authored
     5820c95View commit details

     Copy full SHA for 5820c95

     Browse repository at this point
5. Commits on Mar 30, 2024

   • Add model ckpt conversion and AQT scripts for JetStream MaxText Serving (#23)

     Show description for 2245876
     JoeZijunZhou

     authored
     2245876View commit details

     Copy full SHA for 2245876

     Browse repository at this point

   • Update benchmark to run openorca dataset (#21)

     Show description for 81beb11
     morgandu

     authored
     81beb11View commit details

     Copy full SHA for 81beb11

     Browse repository at this point
6. Commits on Mar 29, 2024

   • Fix whitespace replacement bug (#24)

     FanhaiLu1

     authored
     970b529View commit details

     Copy full SHA for 970b529

     Browse repository at this point

   • Fix llama2 decode bug in tokenizer (#22)

     Show description for 9376d50
     FanhaiLu1

     authored
     9376d50View commit details

     Copy full SHA for 9376d50

     Browse repository at this point
7. Commits on Mar 28, 2024

   • Add Token util unit test (#20)

     Show description for ea4bb9d
     FanhaiLu1

     authored
     ea4bb9dView commit details

     Copy full SHA for ea4bb9d

     Browse repository at this point
8. Commits on Mar 27, 2024

   • Fix starvation with async server and interleaving optimization (#13)

     Show description for 64b1e50
     JoeZijunZhou

     authored
     64b1e50View commit details

     Copy full SHA for 64b1e50

     Browse repository at this point
9. Commits on Mar 26, 2024

   • Allows more requests than available data. (#19)

     patemotter

     authored
     2a91d38View commit details

     Copy full SHA for 2a91d38

     Browse repository at this point

   • Merge branch 'main' of github.com:google/JetStream

     vipannalla

     committed
     36f6e60View commit details

     Copy full SHA for 36f6e60

     Browse repository at this point

   • Remove reference to GPU, its not supported yet. We can add back when the support is ready.

     vipannalla

     committed
     ee5f9a9View commit details

     Copy full SHA for ee5f9a9

     Browse repository at this point
10. Commits on Mar 25, 2024

    • Adds filtering for sharegpt based on conversation starter. (#17)

      patemotter

      authored
      0637309View commit details

      Copy full SHA for 0637309

      Browse repository at this point
11. Commits on Mar 21, 2024

    • Refine requester util (#15)

      JoeZijunZhou

      authored
      1c153b1View commit details

      Copy full SHA for 1c153b1

      Browse repository at this point
12. Commits on Mar 19, 2024

    • Merge branch 'main' of github.com:google/JetStream

      vipannalla

      committed
      c6554e1View commit details

      Copy full SHA for c6554e1

      Browse repository at this point

    • Add CODEWONERS file to JetStream repo

      vipannalla

      committed
      eb9acc1View commit details

      Copy full SHA for eb9acc1

      Browse repository at this point
13. Commits on Mar 15, 2024

    • Replace token_list with generated_text in saved outputs (#12)

      FanhaiLu1

      authored
      b9d4ecfView commit details

      Copy full SHA for b9d4ecf

      Browse repository at this point

    • Add option to warm up (#11)

      qihqi

      authored
      e04302cView commit details

      Copy full SHA for e04302c

      Browse repository at this point
14. Commits on Mar 14, 2024

    • Fix output token drop issue (#9)

      Show description for 2b9db52
      JoeZijunZhou

      authored
      2b9db52View commit details

      Copy full SHA for 2b9db52

      Browse repository at this point

    • Set max_output_length by 1024 as default and use max_output_length in inference request (#10)

      FanhaiLu1

      authored
      8289e65View commit details

      Copy full SHA for 8289e65

      Browse repository at this point
15. Commits on Mar 8, 2024

    • Save request outputs and add eval accuracy support (#8)

      Show description for 41ad033
      FanhaiLu1

      authored
      41ad033View commit details

      Copy full SHA for 41ad033

      Browse repository at this point
16. Commits on Mar 6, 2024

    • Support gracefully stopping orchestrator and server (#6)

      Show description for 0d7fcf7
      JoeZijunZhou

      authored
      0d7fcf7View commit details

      Copy full SHA for 0d7fcf7

      Browse repository at this point
17. Commits on Mar 5, 2024

    • First support necessary for MaxText (#5)

      Show description for da4328e
      rwitten

      authored
      da4328eView commit details

      Copy full SHA for da4328e

      Browse repository at this point

    • Add benchmarks maximum threads config (#4)

      Show description for 25527d6
      JoeZijunZhou

      authored
      25527d6View commit details

      Copy full SHA for 25527d6

      Browse repository at this point

    • Optimize maximum threads to saturate decoding capacity (#3)

      JoeZijunZhou

      authored
      ccdb782View commit details

      Copy full SHA for ccdb782

      Browse repository at this point

    • Refine thread in orchestrator (#2)

      JoeZijunZhou

      authored
      78a7612View commit details

      Copy full SHA for 78a7612

      Browse repository at this point
18. Commits on Mar 4, 2024

    • Add unit tests CI github action (#1)

      Show description for 78a0b06
      JoeZijunZhou

      authored
      78a0b06View commit details

      Copy full SHA for 78a0b06

      Browse repository at this point

    • Add online serving benchmark script

      JoeZijunZhou

      committed
      e2ca618View commit details

      Copy full SHA for e2ca618

      Browse repository at this point

    • Fix doc typo

      JoeZijunZhou

      committed
      b1cc696View commit details

      Copy full SHA for b1cc696

      Browse repository at this point
19. Commits on Mar 1, 2024

    • Release JetStream pip package v0.1.1

      Show description for 0761138
      JoeZijunZhou

      committed
      0761138View commit details

      Copy full SHA for 0761138

      Browse repository at this point

    • JetStream pip package setup

      JoeZijunZhou

      committed
      7a76d6cView commit details

      Copy full SHA for 7a76d6c

      Browse repository at this point