⚙️ Setup a new LLM Provider
Open your Otoroshi admin web UI on otoroshi.oto.tools:8080
In the categories
section click on AI - LLM
and then select LLM Providers
Click on Add item
to create a new LLM provider.
Then, choose the provider you would like to use among this list
After choosing a provider, you can set up your secret API token and other settings if needed.
You can also choose to have a default context for this provider, or some possible contexts that will be usable by users (directly from the input payload). You can also provide restrictions on what models are usable or not with this provider
Now you can click on Create provider
to save your changes and use it into an Otoroshi Route.