Stars
Community maintained hardware plugin for vLLM on Ascend
LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.
Official Implementation of FastKV: KV Cache Compression for Fast Long-Context Processing with Token-Selective Propagation
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous …
本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
Insight for Community Operations Management
Composable building blocks to build Llama Apps
A cross-platform, OpenGL terminal emulator.
High Performance ServiceMesh Data Plane Based on eBPF and Programmable Kernel
Start building LLM-empowered multi-agent applications in an easier way.
Docker images for compiling static Rust binaries using musl-cross
Fast package resolver written in Rust (CDCL based SAT solving)
Mega is an unofficial open source implementation of Google Piper.
Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: …
《构筑大语言模型应用:应用开发与架构设计》一本关于 LLM 在真实世界应用的开源电子书,介绍了大语言模型的基础知识和应用,以及如何构建自己的模型。其中包括Prompt的编写、开发和管理,探索最好的大语言模型能带来什么,以及LLM应用开发的模式和架构设计。
Large Language Model Text Generation Inference
Overview and tutorial of the LangChain Library
面向开发者的 LLM 入门教程,吴恩达大模型系列课程中文版
compatible library for ebpf programs to improve BTF portability
Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and…
Papers from the computer science community to read and discuss.
A multi-sandbox container runtime that provides cloud-native, all-scenario multiple sandbox container solutions.
A fancy self-hosted monitoring tool
Cloud-native build and release tools tailored to building, releasing and maintaining Linux distributions and forks
Fast container image distribution plugin with lazy pulling
Fast container image distribution plugin with lazy pulling