Skip to main content

Install

Download Otoroshi

Download

First, download the Otoroshi jar file:

curl -L -o otoroshi.jar 'https://github.com/MAIF/otoroshi/releases/download/v17.0.0/otoroshi.jar'

Download the LLM Extension

Download the latest release of the Otoroshi LLM Extension

Download the latest release of the Otoroshi LLM Extension from here.

curl -L -o otoroshi-llm-extension.jar 'https://github.com/cloud-apim/otoroshi-llm-extension/releases/download/0.0.43/otoroshi-llm-extension_2.12-0.0.43.jar'

Run Otoroshi with the LLM Extension

WARNING: the Otoroshi LLM Extension only run on JDK 17 and above

Run Otoroshi with the LLM extension by executing the following command :

java -cp "./otoroshi-llm-extension.jar:./otoroshi.jar" -Dotoroshi.adminLogin=admin -Dotoroshi.adminPassword=password -Dotoroshi.storage=file play.core.server.ProdServerStart

This will start the Otoroshi API Gateway.

You can access the Otoroshi UI by opening http://otoroshi.oto.tools:8080/ in your browser.

If you want to know more about Otoroshi configuration, just take a look at the documentation