New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added Avatar backend from talkinghead-js #6

Open

altairmn wants to merge 4 commits into main from sahil/eng-152-add-avatar-from-talkingheadjs-to-frontend

Contributor

altairmn commented Sep 29, 2024

Avatar backend does the following:

Takes in text
Processes the text and generate visemes
Processes text to generate marked up text (ssml)
Marked up text is sent to google TTS
Visemes and googleTTS result is combined and sent back to frontend

The audio and animation payload are sent in the same packet and will be processed by a modified talkinghead.mjs in the frontend.

linear bot commented Sep 29, 2024

ENG-152 Add avatar from talkinghead.js to frontend

altairmn force-pushed the sahil/eng-152-add-avatar-from-talkingheadjs-to-frontend branch from 8f8f3ad to d4326e5 Compare

October 5, 2024 04:38

altairmn added 4 commits

November 1, 2024 11:40


          added lipsync from talkinghead

9646e55


          refactored avatar.py example to fix the voice mode issue

99f8b4b


          fixes

6db7287


          fixed init

c8c19ed

altairmn force-pushed the sahil/eng-152-add-avatar-from-talkingheadjs-to-frontend branch from 8bb9cbf to c8c19ed Compare

November 1, 2024 18:45

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet