zhangmenghao
Follow
Stars
Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation
A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
DLRover: An Automatic Distributed Deep Learning System
ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale
Lumina is a user-friendly tool to test the correctness and performance of hardware network stacks.
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Large Language Model (LLM) Systems Paper List
PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for evaluation of training and inference platforms.
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
Zeta is a distributed platform for developing and deploying complex, elastic, and highly available multi-tenant network services.
The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.
NVIDIA Linux open GPU kernel module source
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…
Transformer related optimization, including BERT, GPT
eBPF implementation that runs on top of Windows
A series of large language models developed by Baichuan Intelligent Technology
A platform for building proxies to bypass network restrictions.
Tensors and Dynamic neural networks in Python with strong GPU acceleration