Skip to content

feat(lipsync): add voice-driven visemes with vrchat osc discovery and headset mic - #12

Merged
Yeusepe merged 3 commits into
mainfrom
lipsync/voice-visemes
Oct 14, 2026
Merged

Yeusepe merged 3 commits into
mainfrom
lipsync/voice-visemes

Conversation

@Yeusepe

@Yeusepe Yeusepe commented Oct 13, 2026 •

Copy link
Copy Markdown
Owner

Adds voice-driven lip sync. Studio runs the selected microphone, or the headset microphone, through OVR LipSync on this PC and sends visemes to VRChat over OSC using VRCFaceTracking parameter names. VRChat OSCQuery discovery reports which avatar parameters exist.

Studio gets a Lip sync page with Mouth shapes, Sound and VRChat sub-pages, a back button for sub-pages, and a Lip sync row on the Tracking page. Studio reopens on the last page used.

Validation: Windows app build; Quest app compile; native and Python syntax checks; resource validator and its tests. Merges cleanly with the other four PRs from this split in any order.

Summary by CodeRabbit

  • New Features
    • Added configurable lip-sync controls for microphone selection, mouth shapes, audio processing, and VRChat output.
    • Added headset microphone support, live input and status indicators, and avatar parameter matching.
    • Added Lip Sync pages to Studio navigation and search.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 13, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-14T17:39:19.373518Z ebb2416 New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@coderabbitai

coderabbitai Bot commented Oct 13, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

Note

Currently processing new changes in this PR. This may take a few minutes, please wait...

⚙️ Run configuration
  • Configuration used: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 5d49d621-eedd-49ec-99aa-081057867e08
📥 Commits

Reviewing files that changed from the base of the PR and between 5bc3a8b and ebb2416.

📒 Files selected for processing: 11
  • src/app/HeadsetMicrophone.cs
  • src/app/LipSync.cs
  • src/app/Localization/Strings.resx
  • src/app/QFTPlus.csproj
  • src/app/StudioLipSync.cs
  • src/app/StudioSearch.cs
  • src/app/StudioWindow.xaml
  • src/app/StudioWindow.xaml.cs
  • src/app/Symbols.cs
  • src/app/VRChatOsc.cs
  • src/headset/mic.c
 _________________________________________
< Schrodinbug: works until I stare at it. >
 -----------------------------------------
  \
   \   \
        \ /\
        ( )
      .( o ).
✨ Finishing Touches
📝 Generate docstrings
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 392bb7659e

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/app/LipSync.cs
Comment thread src/app/LipSync.cs
Comment thread src/app/StudioLipSync.cs Outdated
@Yeusepe
Yeusepe merged commit 2d508c0 into main Oct 14, 2026
1 of 2 checks passed

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: ebb2416457

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread src/app/VRChatOsc.cs
Comment thread src/app/StudioWindow.xaml.cs
Yeusepe added a commit that referenced this pull request Oct 14, 2026
Keep tracking shutdown bounded when termination or output draining fails, and report when a tracking process remains alive after cleanup. Handle Windows adapter-enumeration errors during OSC discovery, and stop lipsync status and meter timers immediately on navigation or window closure.

For an unreadable headset backup, preserve the archive and show localized instructions for moving it aside before retrying with defaults. Preserve specific wrong-headset guidance during fresh installs. These changes address late findings on #11, #12, and #14 and reuse the existing timer and error paths.

Validation: Windows Release build; bounded process shutdown, output-drain and log-retention checks; incomplete-shutdown status; WPF rapid-navigation and missing-microphone tests; existing lipsync checks; twelve backup/restore tests including corrupt-archive recovery and wrong-device guidance; localization and source checks.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant