Large Concept Models: Language modeling in a sentence representation space

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

🤝 The code for "Can Large Language Model Agents Simulate Human Trust Behaviors?"

Unsupervised Semantic Segmentation by Distilling Feature Correspondences

Official implementation for "An image is worth multiple words: discovering object level concepts using multi-concepts prompts learning" [ICML 2024]]

ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.

[ICML 2024 Oral] A framework for society simulation that supports complex simulation, for example: multi-scene.

A curated list of resources for using LLMs to develop more competitive grant applications.

This repository is for the first comprehensive survey on Meta AI's Segment Anything Model (SAM).

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

Pytorch-based Differentiable Slicing for Mesh Learning in Medical Imaging

[ICLR 2025] Diffusion Feedback Helps CLIP See Better

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use th…

Official implementation of 'CLIP-DINOiser: Teaching CLIP a few DINO tricks' paper.

OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]

Code for the paper "Placing Objects in Context via Inpainting for Out-of-distribution Segmentation", ECCV 2024

[ICML 2024] Compositional Image Decomposition with Diffusion Models

[CVPR'24 Highlight] SHiNe: Semantic Hierarchy Nexus for Open-vocabulary Object Detection

Implementation of Motion Planning via Optimal Transport (MPOT) in PyTorch, NeurIPS 2023.

Code of ComboStoc, the diffusion models and training/sampling code for our paper exploring the Combinatorial Stochasticity for Diffusion Generative Models.

Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR 2023

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Localized Narratives

Deformable image registration (alignment) toolbox