Awesome-Human-Video-Generation

This is a repository with our survey paper : "A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insights".

It is a continuously updated project to track the latest progress in human video generation.

We would feel quite insprised if this repository can bring you some insights.

If you like our project, please give us a star ⭐ on this GitHub.

If you have any suggestions or comments to our project or survey, please feel free to contact: [email protected].

💥 Highlights

• 2024.07.12: The Survey Paper is Online on arXiv.
• 2024.06.05: Our Awesome Human Video Generation Repository Started.

Human Body Video Demo

Here are some Demo results from latest repository/paper.

unianimate.mp4	champ.mp4
animeteanyone.mp4	magicanimate.mp4
FollowYourPose-V2.mp4	MimicMotion.mp4

Citation

If you find our work useful in your research, please consider citing:

@article{lei2024humanvideo,
      title={A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insights}, 
      author={Wentao Lei and Jinting Wang and Fengji Ma and Guanjie Huang and Li Liu},
      journal={arXiv preprint arXiv:2407.08428},
      year={2024}
}

Table of Contents

• Text Guided Human Video Generation
• Audio Guided Human Video Generation
• • Dance Video Generation
• • Performance Video Generation
• • Co-Speech Gesture Video Generation
• Pose Guided Human Video Generation
• Applications
• Datasets

Text Guided Human Video Generation

• HMTV (WACV 2024)

• SignLLM

• Text2Performer (ICCV2023)

Audio Guided Human Video Generation

Dance Video Generation

• DanceIt (TIP 2021)

Performance Video Generation

• Music2Play (CAC 2023)

Co-Speech Gesture Video Generation

• S2G-MDDiffusion (CVPR 2024)

• ANGIE (NeurIPS 2022)

Pose Guided Human Video Generation

• FollowYourPose

• PSGAN

• DwNet

• Animateanyone

• ID-Animator

• DreaMoving

• MagicPose

• LEO

• MuseV

• MusePose

• MagicAnimate

• UniAnimate

• Champ

• Magic-Me

• Disco

• TwoStreamVAN

• MoCoGAN

• Pose-Guided Human Animation from a Single Image in the Wild

• MimicMotion

• Human4DiT

• FollowYourPose-v2

• IDOL

• MagicFight

• DiffPerformer CVPR(2024)

• Dance Your Latents

• MotionFollower

• 3DHM

• Animate-X

• RealisDance

• High Quality Human Image Animation using Regional Supervision and Motion Blur Condition

Applications

• Keling

• Viggle

• Luma

• Runway

Datasets

• Text2performer
• Tiktok
• Tiktok-v4
• TED gesture dataset
• Bold
• DeepFashion
• Taichi
• Ubody
• ASTS
• UCF-101
• human3.6m
• NTU RGB+D
• HAR
• 3D People Synthetic
• MSP-Avatar
• EverybodyDance
• AIST++
• DanceIt
• Disco
• Sub-URMP
• URMP