3D Avatar Lip Synchronization from speech (JALI based face-rigging)

vits2 backbone with multilingual-bert

[ECCV 2024] The official repo for "Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing"

A complete head tracking pipeline from videos to NeRF/3DGS-ready datasets.

[MICCAI 2024] TeethDreamer: 3D Teeth Reconstruction from Five Intra-oral Photographs

[ACMMM24] UVMap-ID: A Controllable and Personalized UV Map Generative Model

Official repository for 'GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivation'

Code for robust monocular depth estimation described in "Ranftl et. al., Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer, TPAMI 2022"

Official implementation of “GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splatting” by Kyusun Cho, Joungbin Lee, Heeji Yoon, Yeobin Hong, Jaehoon Ko,…

The official code for the paper Multi-scale Promoted Self-adjusting Correlation Learning for Facial Action Unit Detection.

V-Express aims to generate a talking head video under the control of a reference image, an audio, and a sequence of V-Kps images.

Official implementation of EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars

[AAAI 2024] Official repository for "Sync-NeRF: Generalizing Dynamic NeRFs to Unsynchronized Videos"

[CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"

Emote Portrait Alive: Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions

Multi-modal Speech Emotion Recogniton on IEMOCAP dataset

FRAME-LEVEL EMOTIONAL STATE ALIGNMENT METHOD FOR SPEECH EMOTION RECOGNITION

Python implementation of the article "EMOVOME Database: Advancing Emotion Recognition in Speech Beyond Staged Scenarios"

Speech emotion recognition implemented in Keras (LSTM, CNN, SVM, MLP) | 语音情感识别

2018年7⽉30⽇-8⽉13⽇持续2周的AI训练营中语⾳情感识别营的项目报告。

[ECCV'24] TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splatting

Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decomposition

[NeurIPS 2024] GaussianCube: A Structured and Explicit Radiance Representation for 3D Generative Modeling

Source code for: Expressive Speech-driven Facial Animation with controllable emotions

A Python framework for high performance GPU simulation and graphics

MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

[CVPR 2024 Highlight] PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics

Must-read and classic books of computational geometry and computer graphics