Skip to content

talk-llama: optional wake-up command and audio confirmation - #1765

Merged
ggerganov merged 5 commits into
ggml-org:masterfrom
Rakksor:master
Jan 16, 2024
Merged

ggerganov merged 5 commits into
ggml-org:masterfrom
Rakksor:master

Conversation

@Rakksor

@Rakksor Rakksor commented Jan 14, 2024

Copy link
Copy Markdown
Contributor

This adds two optional flags to talk-llama:

  • -w TEXT / --wake-command TEXT: only process commands starting with the given text. This is basically a 1:1 copy of the always-prompt mode code from the command example.
  • -ho TEXT / --heard-ok TEXT: A word or phrase said by the TTS to confirm that the text is being processed. This plays directly after whisper transcription to bridge the silence until llama generated an answer (useful for slower systems).

Example usage:

./talk-llama -mw ./models/ggml-tiny.en.bin \
             -ml ../llama.cpp/models/tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf \
             -w "computer" \
             -ho "processing"

This will only answer to input starting with "computer" and say "processing" while waiting for an answer.

@Rakksor Rakksor changed the title talk-llama: wake-up command and audio confirmation talk-llama: optional wake-up command and audio confirmation Jan 14, 2024
@ggerganov
ggerganov merged commit f661415 into ggml-org:master Jan 16, 2024
jiahansu pushed a commit to WiseSync/whisper.cpp that referenced this pull request Apr 17, 2024
…g#1765)

* talk-llama: add optional wake-word detection from command

* talk-llama: add optional audio confirmation before generating answer

* talk-llama: fix small formatting issue in output

* talk-llama.cpp: fix Windows build
viktor-silakov pushed a commit to viktor-silakov/whisper_node_mic.cpp that referenced this pull request May 11, 2024
…g#1765)

* talk-llama: add optional wake-word detection from command

* talk-llama: add optional audio confirmation before generating answer

* talk-llama: fix small formatting issue in output

* talk-llama.cpp: fix Windows build
iThalay pushed a commit to iThalay/whisper.cpp that referenced this pull request Sep 23, 2024
…g#1765)

* talk-llama: add optional wake-word detection from command

* talk-llama: add optional audio confirmation before generating answer

* talk-llama: fix small formatting issue in output

* talk-llama.cpp: fix Windows build
iThalay pushed a commit to iThalay/whisper.cpp that referenced this pull request Sep 23, 2024
…g#1765)

* talk-llama: add optional wake-word detection from command

* talk-llama: add optional audio confirmation before generating answer

* talk-llama: fix small formatting issue in output

* talk-llama.cpp: fix Windows build
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants