[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

Stag-1: Towards Realistic 4D Driving Simulation with Video Generation Model

OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]

HunyuanVideo: A Systematic Framework For Large Video Generation Model

ROOT: VLM based System for Indoor Scene Understanding and Beyond

[TPAMI 2024] PERF: Panoramic Neural Radiance Field from a Single Panorama

Stitching 360 panorama with OpenCV/Python

Generative World Explorer

Infinite Photorealistic Worlds using Procedural Generation

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion

This is a collective repository for all 3DGS related progresses in research and industry world

Next-Token Prediction is All You Need

Official Implementation of paper "Tex4D: Zero-shot 4D Scene Texturing with Video Diffusion Models"

DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videos

Official Implementation of paper "MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion"

Estimating Body and Hand Motion in an Ego-sensed World

3D Gaussian Splatting for Real-Time Radiance Field Rendering - Detailed Windows Install & Usage Instructions

Heterogeneous Pre-trained Transformer (HPT) as Scalable Policy Learner.

[CVPR 2024] Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution

Official implementation of paper "Pyramid Diffusion for Fine 3D Large Scene Generation" (ECCV 2024 Oral)

Generative models for conditional audio generation

Gaussian splatting implementation of Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions

High-resolution models for human tasks.

text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)