Skip to main content

Otoroshi LLM ExtensionDocumentation

GitHub Cloud APIM Cloud APIM Blog

Overview
Install
LLM Gateway
💸 Cost optimization
📊 Reporting
🛡️ Guardrails
Prompt Engineering
Function calling (tools)
HTTP + LLM Plugins
Embeddings
Try Otoroshi LLM Extension

💸 Cost optimization
Semantic cache

Semantic cache

semantic cache uses an embedding datastore to find prompt with the same semantic

semantic-cache

Docs

Documentation

Community

Discord
Twitter
Youtube

More

Cloud APIM
Blog
GitHub

Copyright © 2025 Cloud APIM Built with Docusaurus.