LLM training code for MosaicML foundation models

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A PyTorch implementation of the paper "All are Worth Words: A ViT Backbone for Diffusion Models".

An open source implementation of CLIP.

[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

Unofficial PyTorch Implementation of Denoising Diffusion Probabilistic Models (DDPM)

PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)

Denoising Diffusion Implicit Models

Code for the Paper "Improving Diffusion Model Efficiency Through Patching"

Pixel-Perfect Structure-from-Motion with Featuremetric Refinement (ICCV 2021, Oral)

Deep Learning (with PyTorch)