SGLang is a fast serving framework for large language models and vision language models.

xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism

Fast and memory-efficient exact attention

Development repository for the Triton language and compiler

A high-throughput and memory-efficient inference and serving engine for LLMs

主要记录大语言大模型（LLMs） 算法（应用）工程师相关的知识及面试题