Why use it

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

Best for

beginner

Deployment options

compose · docker

Resource requirements

server

Alternative to

No mapping yet

Common setup stack

Reverse proxy · HTTPS certs · auth gateway · backups