Popular repositories Loading

1. vidur vidur Public

   Forked from microsoft/vidur

   A large-scale simulation framework for LLM inference

   Python

2. DistServe DistServe Public

   Forked from LLMServe/DistServe

   Disaggregated serving system for Large Language Models (LLMs).

   Jupyter Notebook

3. BurstGPT BurstGPT Public

   Forked from HPMLL/BurstGPT

   A ChatGPT(GPT-3.5) & GPT-4 Workload Trace to Optimize LLM Serving Systems

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python