Skip to main content

⚙️ Setup a new LLM Provider

Open your Otoroshi admin web UI on otoroshi.oto.tools:8080

In the categories section click on AI - LLM and then select LLM Providers

Click on Add item to create a new LLM provider.

Then, choose the provider you would like to use among this list

After choosing a provider, you can set up your secret API token and other settings if needed.

You can also choose to have a default context for this provider, or some possible contexts that will be usable by users (directly from the input payload). You can also provide restrictions on what models are usable or not with this provider

Now you can click on Create provider to save your changes and use it into an Otoroshi Route.

Create a new route

Demo