A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Merico Build is a web app empowering open source developers, maintainers, and communities with metrics from Git, GitHub, and more.

CSI driver to bring SPDK to Kubernetes storage through NVMe-oF or iSCSI. Supports dynamic volume provisioning and enables Pods to use SPDK storage transparently.

A RocksDB compatible KV storage engine with better performance

Concurrent data structures in C++

Bot Framework provides the most comprehensive experience for building conversation applications.

Multithreaded HTTP Download Accelerator

A Python library for using the duoshuo API

PyCoder's Weekly Chinese Translate Sources Repo