Skip to content

Implement streaming for Functionary v2 + Bug fixes#1419

Merged
abetlen merged 7 commits into
abetlen:mainfrom
jeffrey-fong:functionary-stream
May 4, 2024
Merged

Implement streaming for Functionary v2 + Bug fixes#1419
abetlen merged 7 commits into
abetlen:mainfrom
jeffrey-fong:functionary-stream

Conversation

@jeffrey-fong

Copy link
Copy Markdown
Contributor

Features

  • Set up streaming for functionary-v2 chat handler
  • Raises error if users use functionary-v1
  • Returns only 1 function/tool call if functions is provided and >= 1 if tools is provided

Bug Fixes

  • Fix function-call={...} always converted to auto bug

@abetlen

abetlen commented May 4, 2024

Copy link
Copy Markdown
Owner

@jeffrey-fong thank you, looks good to me!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants