📄️ Overview
The Otoroshi LLM extension provides advanced function calling (tool calling) capabilities. The gateway can intercept LLM responses that request tool calls, execute the tools server-side, and send the results back to the LLM — all transparently to the consumer.
📄️ QuickJs and WASM Functions
The Otoroshi LLM extension supports two WASM-based backends for tool functions: QuickJs (JavaScript in WASM) and WasmPlugin (full WASM plugins).
📄️ Workflow Functions
Workflow functions allow you to use Otoroshi workflows as tool function backends. When the LLM decides to call a tool, the gateway executes the referenced workflow with the tool arguments as input and returns the workflow result to the LLM.
📄️ HTTP Functions
HTTP functions allow you to create tool functions that call external HTTP endpoints. When the LLM decides to call a tool, the gateway makes an HTTP request with the tool arguments and returns the response as the tool result.