Overview
The Otoroshi LLM extension provides advanced function calling (tool calling) capabilities. The gateway can intercept LLM responses that request tool calls, execute the tools server-side, and send the results back to the LLM — all transparently to the consumer.
QuickJs and WASM Functions
The Otoroshi LLM extension supports two WASM-based backends for tool functions: QuickJs (JavaScript in WASM) and WasmPlugin (full WASM plugins).
Workflow Functions
Workflow functions allow you to use Otoroshi workflows as tool function backends. When the LLM decides to call a tool, the gateway executes the referenced workflow with the tool arguments as input and returns the workflow result to the LLM.
HTTP Functions
HTTP functions allow you to create tool functions that call external HTTP endpoints. When the LLM decides to call a tool, the gateway makes an HTTP request with the tool arguments and returns the response as the tool result.