← Back to browse
Editor score 71
Tools
olla
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
Why use it
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
Best for
homelab
Deployment options
compose · docker
Resource requirements
server
Alternative to
No mapping yet
Common setup stack
Reverse proxy · HTTPS certs · auth gateway · backups