Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generation

Shuling Zhao¹   Fa-Ting Hong¹   Xiaoshui Huang²   Dan Xu¹

¹The Hong Kong University of Science and Technology
²Shanghai Jiao Tong University

Cross-identity Reenactment Results

Method

Updates

• 2024/11/29: We released this repo.

Acknowledgement

Our implementation is based on FOMM, MRFA and CodeFormer. We appreciate their great works.

Citation

@misc{zhao2024synergizingmotionappearancemultiscale,
      title={Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generation}, 
      author={Shuling Zhao and Fa-Ting Hong and Xiaoshui Huang and Dan Xu},
      year={2024},
      eprint={2412.00719},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2412.00719}, 
}

Contact

If you have any question or collaboration needs, please email [email protected].