v1.2.0

Features

• Add TUI dashboard (paddler dashboard --management-addr [HOST]:[PORT]) to be able to easily observe balancer instances from the terminal level (thank you @Propfend for the contribution!)

v1.1.0

• More meaningful error messages when the agent can't connect to the llama.cpp slot endpoint, or when slot endpoint is not enabled in llama.cpp
• Set default logging level to info for agents and balancer to increase the amount of information in the logs (it wasn't clean if the agent was running or not)
• Enable LTO optimization for the release builds (see #28) (thank you @zamazan4ik)

v1.0.0

Paddler is now rewritten in Rust and uses the Pingora framework for the networking stack. A few minor API changes and reporting improvements are introduced (documented in the README).

This is a stability/quality release that solves some memory related issues, and makes the balancer more resilient to agents randomly going up/down.

v1.0.0-rc1

chore(gh-actions): consistent asset names

v0.10.0

chore: update README

v0.9.0

Features

• Add --local-llamacpp-api-key flag to balancer to support llama.cpp API keys (see: #23)

v0.8.0

Features

• Add --rewrite-host-header flag to balancer to rewrite the Host header in forwarded requests (see: #20)

v0.8.0-rc1

Features

• Add --rewrite-host-header flag to balancer to rewrite the Host header in forwarded requests (see: #20)

v0.7.1

chore: tidy mods

v0.7.1-rc1

chore: tidy mods