andysalerno
Follow
Lists (1)
Stars
nsync is a C library that exports various synchronization primitives, such as mutexes
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
Effortlessly run LLM backends, APIs, frontends, and services with one command.
A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
A Beautiful Private and Secure Desktop Investment Tracking Application
A standalone version of the readability lib
A fast inference library for running LLMs locally on modern consumer-class GPUs
π€ Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
β¨ Light and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows
Enforce the output format (JSON Schema, Regex etc) of a language model
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
A simple, Git-powered wiki with a local frontend and support for many kinds of markup and content.
CMS/Wiki system using Javascript for 100% client side single page application using Markdown.
β© Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains
llama3 implementation one matrix multiplication at a time
Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
Tile primitives for speedy kernels
π OpenHands: Code Less, Make More
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
Enhanced ChatGPT Clone: Features Agents, DeepSeek, Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message seβ¦
LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath