DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

SGLang is a fast serving framework for large language models and vision language models.

PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.

🦜🔗 Build context-aware reasoning applications

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch

An easy to use PyTorch to TensorRT converter

This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, s…

Transformer related optimization, including BERT, GPT

The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.

A high-throughput and memory-efficient inference and serving engine for LLMs

Development repository for the Triton language and compiler

云原生一站式机器学习平台，多租户，数据资产，notebook在线开发，拖拉拽任务流编排，多机多卡分布式训练，超参搜索，推理服务，多集群调度，多项目组资源组，边缘计算，大模型实时训练, ai应用商店

Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.

A collection of diffusion models based on MindSpore

Production First and Production Ready End-to-End Speech Recognition Toolkit

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

http://www.facegood.cc

stock，股票系统。使用python进行开发。

A Deep Learning Recommender System

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

中文文本分类，TextCNN，TextRNN，FastText，TextRCNN，BiLSTM_Attention，DPCNN，Transformer，基于pytorch，开箱即用。

The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)

Bloaty McBloatface: a size profiler for binaries

Python server for communicating with Kaldi from the browser using WebRTC