Skip to main content

Otoroshi LLM ExtensionDocumentation

GitHub Cloud APIM Cloud APIM Blog

Overview
Install
Setup an LLM provider
Prompt context / pre-prompt
Prompt templating
Request validation
Enrich requests
Response cleanup
Generate responses
Websocket validation
Caching
Resilience
Provider validation
Try Otoroshi LLM Extension

Resilience

Resilience

Provider fallback

fallback

Provider loadbalancing

Provider validation

Provider fallback
Provider loadbalancing

Docs

Documentation

Community

Discord
Twitter
Youtube

More

Cloud APIM
Blog
GitHub

Copyright © 2024 Cloud APIM Built with Docusaurus.