You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Image cache and balloon on H100s, also temporarily stop people from u…
…sing A100 (#523)
* Cache H100
* Stop people from using A100
* no cover
* no cover
* update client version
[Client] Add num_prompt_tokens to the client's CompletionOutputs (#467)
* add prompt token, untested
* comment
* remove stop_str stuff, it doesn't do anything with the public api, and it breaks on certain frameworks when hosted locally