Skip to main content

Otoroshi LLM ExtensionDocumentation

GitHub Cloud APIM Cloud APIM Blog

Overview
Install
Setup an LLM provider
Prompt context / pre-prompt
Prompt templating
Request validation
Enrich requests
Response cleanup
Generate responses
Websocket validation
Caching
Resilience
Provider validation
Try Otoroshi LLM Extension

Prompt context / pre-prompt

Prompt context / pre-prompt

Setup an LLM provider

Prompt templating

Docs

Documentation

Community

Discord
Twitter
Youtube

More

Cloud APIM
Blog
GitHub

Copyright © 2024 Cloud APIM Built with Docusaurus.