Skip to main content

Otoroshi LLM ExtensionDocumentation

GitHub Cloud APIM Cloud APIM Blog

Overview
Install
LLM Gateway
💸 Cost optimization
📊 Reporting
🛡️ Guardrails
Prompt Engineering
Function calling (tools)
HTTP + LLM Plugins
Embeddings
Try Otoroshi LLM Extension

💸 Cost optimization
Simple cache

Simple cache

simple cache works on prompts word per word

simple-cache

💰 Cost tracking

Docs

Documentation

Community

Discord
Twitter
Youtube

More

Cloud APIM
Blog
GitHub

Copyright © 2025 Cloud APIM Built with Docusaurus.