Search Engines
Otoroshi LLM Extension provides support for search engines, enabling real-time web search — and semantic search over your own data with RAG knowledge bases — through a unified, normalized API.
Search Engine Providers
Each Search Engine wraps a single provider. The provider is selected with the provider field, and configured through config.connection (endpoint and credentials) and config.options (provider-specific options).
Search API
A Search Engine can be re-exposed as a plain HTTP search API through the Cloud APIM - Search engine backend plugin.
Search as an LLM tool
Search Engines can be attached to an LLM provider or an AI Agent as tools. When you do, the model is given a search tool for each referenced engine and can call it autonomously to fetch fresh information — from the web, or from your own RAG knowledge base. This works exactly like WASM tool functions and MCP connectors: the gateway advertises the tool to the model, executes the call when the model asks for it, and feeds the normalized results back into the conversation — looping until the model produces its final answer.