Skip to main content

Otoroshi LLM ExtensionDocumentation

GitHub Cloud APIM Cloud APIM Blog

Overview
Install
Setup an LLM provider
Prompt context / pre-prompt
Prompt templating
Request validation
Enrich requests
Response cleanup
Generate responses
Websocket validation
Caching
Resilience
Provider validation
Try Otoroshi LLM Extension

Websocket validation

Websocket validation

Generate responses

Docs

Documentation

Community

Discord
Twitter
Youtube

More

Cloud APIM
Blog
GitHub

Copyright © 2024 Cloud APIM Built with Docusaurus.