Why use it

Run open-source LLMs, such as DeepSeek and Llama, as OpenAI-compatible API endpoints in the cloud.

Best for

beginner

Deployment options

compose · docker

Resource requirements

server

Alternative to

No mapping yet

Common setup stack

Reverse proxy · HTTPS certs · auth gateway · backups