FlashInfer: Kernel Library for LLM Serving

Dynamic Memory Management for Serving LLMs without PagedAttention

flash attention tutorial written in python, triton, cuda, cutlass

Fast and memory-efficient exact attention

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Universal LLM Deployment Engine with ML Compilation

A throughput-oriented high-performance serving framework for LLMs

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

👑 Easy-to-use and powerful NLP library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Ques…

Fast Hadamard transform in CUDA, with a PyTorch interface

how to optimize some algorithm in cuda.

CUDA Templates for Linear Algebra Subroutines

Stable Diffusion web UI

📚 C/C++

《Hello 算法》：动画图解、一键运行的数据结构与算法教程，支持 Java, C++, Python, Go, JS, TS, C#, Swift, Rust, Dart, Zig 等语言。

《Machine Learning Systems: Design and Implementation》- Chinese Version

This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, s…

2023年最新整理 c++后端开发，1000篇优秀博文，含内存，网络，架构设计，高性能，数据结构，基础组件，中间件，分布式相关

Transformer related optimization, including BERT, GPT

Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC Loc…

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)

A primitive library for neural network

Documentations for PaddlePaddle

PaddlePaddle Developer Community

快速入门CMake,通过例程学习语法。在线阅读地址：https://sfumecjf.github.io/cmake-examples-Chinese/

AiLearning：数据分析+机器学习实战+线性代数+PyTorch+NLTK+TF2