Janus-Series: Unified Multimodal Understanding and Generation Models

Python inverse kinematics based on Pinocchio

This repository implements teleoperation of the Unitree humanoid robot using XR Devices.

A brief introduction to the quaternions and its applications in 3D geometry.

A Strong and Easy-to-use Single View 3D Hand+Body Pose Estimator

SMPL-X

Humanoid robot arms retarget algorithm with VisionPro app

Awesome work on hand pose estimation/tracking

Official Implementation of the ICCV 2023 paper: Perpetual Humanoid Control for Real-time Simulated Avatars

VisionOS App + Python Library to stream head / wrist / finger tracking data from Vision Pro to any robots.

[RSS 2024] 3D Diffusion Policy: Generalizable Visuomotor Policy Learning via Simple 3D Representations

GRUtopia: Dream General Robots in a City at Scale

Unified framework for robot learning built on NVIDIA Isaac Sim

[CoRL 2024] HumanPlus: Humanoid Shadowing and Imitation from Humans

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)

[CoRL 2024] Open-TeleVision: Teleoperation with Immersive Active Visual Feedback

Isaac Gym Reinforcement Learning Environments

Official Pytorch Implementation of Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think (ICLR 2025)

The source code for "LaSe-E2V: Towards Language-guided Semantic-Aware Event-to-Video Reconstruction"

The source code for "Towards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approach" (CVPR24 Oral)

Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal Large Language Models'.