← Back to browse
Editor score 73
Tools
node-llama-cpp
Run AI models locally on your machine with Node.js bindings for llama.cpp, including enforcing a JSON schema on the model output during generation.
Why use it
Run AI models locally on your machine with Node.js bindings for llama.cpp, including enforcing a JSON schema on the model output during generation.
Best for
homelab
Deployment options
compose · docker
Resource requirements
server
Alternative to
No mapping yet
Common setup stack
Reverse proxy · HTTPS certs · auth gateway · backups