Popular repositories Loading

1. worker-vllm worker-vllm Public

   Forked from runpod-workers/worker-vllm

   The RunPod worker template for serving our large language model endpoints. Powered by vLLM.

   Python

2. llama-runpod llama-runpod Public

   Forked from louisabraham/llama-runpod

   Run llama.cpp on RunPod

   Dockerfile

3. text-generation-webui text-generation-webui Public

   Forked from oobabooga/text-generation-webui

   A Gradio web UI for Large Language Models.

   Python

4. PicoMLXServer PicoMLXServer Public

   Forked from PicoMLX/PicoMLXServer

   The easiest way to run the fastest MLX-based LLMs locally

   Swift