Why use it

Open-source, lightweight self-hosted solution to run LLMs offline on a local device.

Best for

homelab

Deployment options

compose · docker

Resource requirements

server

Alternative to

No mapping yet

Common setup stack

Reverse proxy · HTTPS certs · auth gateway · backups