An example RLDS dataset builder for X-embodiment dataset conversion.

ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation

Code release for CVPR'24 submission 'OmniGlue'

A list of awesome and popular robot learning environments

🤗 LeRobot: Making AI for Robotics more accessible with end-to-end learning

VP2 Benchmark (A Control-Centric Benchmark for Video Prediction, ICLR 2023)

[CVPR 2024 Oral] Rethinking Inductive Biases for Surface Normal Estimation

Recall to Imagine, a model-based RL algorithm with superhuman memory. Oral (1.2%) @ ICLR 2024

Structured state space sequence models

PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm

We present MocapNET, a real-time method that estimates the 3D human pose directly in the popular Bio Vision Hierarchy (BVH) format, given estimations of the 2D body joints originating from monocula…

[CVPR'24 Highlight & Best Demo Award] Gaussian Splatting SLAM

[CVPR 2024 Highlight] PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics

OpenMMLab 3D Human Parametric Model Toolbox and Benchmark

Official release of the CLVR Jaco Play Dataset, Dass et al. 2023

OpenMMLab Pose Estimation Toolbox and Benchmark.