🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Ongoing research training transformer models at scale

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

An implementation of a deep learning recommendation model (DLRM)

A PyTorch native library for large model training

Pytorch domain library for recommendation systems

Repository hosting code for "Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations" (https://arxiv.org/abs/2402.17152).

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and versatility of software and hardware.