Repository navigation
Conversation
…amed speech and barge-in; bench vs fixed silence
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Talk mode: a real-time spoken conversation with Buddy (Ctrl+Alt+T)
Press Ctrl+Alt+T (or Talk with Buddy in the tray) and talk, no key to hold.
keyit_talk.TurnTakerreads the words at every pause and waits 0.3 s after a completesentence, 0.7 s when it cannot tell, 1.6 s when you trail off ("and", "because", "um"). English, Indonesian and Chinese
rules; other languages get the plain 0.7 s pause.
EchoGatecompares the microphone with what Buddy is playing and stops the voice when you talk over it.Gates (frozen rubric
buddy-talk-v1)coreandwindowsNot merged automatically: G4 fails. Giving Whisper only the last 1.2 s still takes 0.43 s (p95) at 100% CPU, so it needs a streaming recognizer or a quiet PC. Council score (3 judges): 1.3.2 4.0, this PR 7.62, blind pair 3-0. Jev was not run; its figures are the vendor's published ones.
Not verified
A real person at a real microphone; a real loudspeaker-to-microphone echo; voice stop on the real output device
(bench part d did not start); the talk mode UI running end to end; latency on a quiet PC; brain latency on CPU-only Ollama.
Bench:
bench/talk_turns.py, results inbench/results_talk/, write-up inbench/README.md(Talk mode) andREADME.md(Talk mode vs Jev).