A high-throughput and memory-efficient inference and serving engine for LLMs

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Universal LLM Deployment Engine with ML Compilation

The Triton TensorRT-LLM Backend

Disaggregated serving system for Large Language Models (LLMs).

A local chatbot fine-tuned by bilibili user comments.

📚 技术面试必备基础知识、Leetcode、计算机操作系统、计算机网络、系统设计

30天自制C++服务器，包含教程和源代码

C++那些事

开发内功修炼

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

80x23 terminal tetris!

这是一个用于显示当前网速、CPU及内存利用率的桌面悬浮窗软件，并支持任务栏显示，支持更换皮肤。

多维监控异常根因分析，复现论文ISSRE 2019 REG paper 'Generic and Robust Localization of Multi-Dimensional Root Cause'.

log anomaly detection toolkit including DeepLog

A Golang implemented Redis Server and Cluster. Go 语言实现的 Redis 服务器和分布式集群

A machine learning toolkit for log parsing [ICSE'19, DSN'16]

程序员的浪漫方式集合，欢迎大家积极补充...

A cross-platform programmable network tool

python实现GBDT的回归、二分类以及多分类，将算法流程详情进行展示解读并可视化，庖丁解牛地理解GBDT。Gradient Boosting Decision Trees regression, dichotomy and multi-classification are realized based on python, and the details of algorithm flo…

百度网盘不限速客户端, golang + qt5, 跨平台图形界面

Golang相关：[审稿进度80%]Go语法、Go并发思想、Go与web开发、Go微服务设施等

程序员的小浪漫

Graceful restart & zero downtime deploy for Go servers.

Weekly Go Online Meetup via Bilibili｜Go 夜读｜通过 bilibili 在线直播的方式分享 Go 相关的技术话题，每天大家在微信/telegram/Slack 上及时沟通交流编程技术话题。

基于Spring Boot+Spring Security+JWT+Vue前后端分离的旺旺小小酥  ( 一口一口又香又脆❤~ )

从视频流中检测出人脸并识别

A push notification server written in Go (Golang).