Blazingly fast LLM inference.

cpuid library in rust.

Fast inference engine for Transformer models

Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.

Safe rust wrapper around CUDA toolkit

Half-precision floating point types f16 and bf16 for Rust.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Simple, safe way to store and distribute tensors

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

An asyncronous resampling library written in Rust

Rust bindings for the Python interpreter

FastAPI framework, high performance, easy to learn, fast to code, ready for production

Deezer source separation library including pretrained models.

PhyCV: The First Physics-inspired Computer Vision Library