Task-Aware Agent-driven Prompt Optimization Framework

Open source code of the paper: "OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domain"

RetroLLM: Empowering LLMs to Retrieve Fine-grained Evidence within Generation

Writing Extension for Text Generation WebUI

Excalidraw meets ComfyUI for LLMs

Graph-Based Editor for LLM Workflows

Framework for building synthetic datasets with AI feedback

Evaluate your LLM's response with Prometheus and GPT4 💯

Benchmarking Agentic LLM and VLM Reasoning On Games

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

ExtractThinker is a Document Intelligence library for LLMs, offering ORM-style interaction for flexible and powerful document workflows.

LM inference server implementation based on llama.cpp.

⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation (AAAI 2025)

Generate large synthetic data using an LLM

tiny vision language model

lightweight, standalone C++ inference engine for Google's Gemma models.

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024

A new chunking strategy developed by ZeroEntropy for general semantic chunking using Llama-70B.

A high-quality tool for convert PDF to Markdown and JSON.一站式开源高质量数据提取工具，将PDF转换成Markdown和JSON格式。

A Lightweight Library for AI Observability

SwarmUI (formerly StableSwarmUI), A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.

A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and fully reproducible.

Rudimentary support for using multiple GPUs in a ComfyUI workflow

A python program that turns an LLM, running on Ollama, into an automated researcher, which will with a single query determine focus areas to investigate, do websearches and scrape content from vari…

Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.Cpp, in Cuda mode mainly!)

Search the web and your self-hosted apps using local AI agents.

Stable Diffusion and Flux in pure C/C++