Skip to main content

Otoroshi LLM ExtensionDocumentation

GitHub Cloud APIM Cloud APIM Blog

Overview
Install
Setup an LLM provider
Prompt context / pre-prompt
Prompt templating
Request validation
Enrich requests
Response cleanup
Generate responses
Websocket validation
Caching
Resilience
Provider validation
Try Otoroshi LLM Extension

Prompt templating

Prompt templating

Prompt context / pre-prompt

Request validation

Docs

Documentation

Community

Discord
Twitter
Youtube

More

Cloud APIM
Blog
GitHub

Copyright © 2024 Cloud APIM Built with Docusaurus.