Install
Download Otoroshi
First, download the Otoroshi jar file:
curl -L -o otoroshi.jar 'https://github.com/MAIF/otoroshi/releases/download/v17.0.0/otoroshi.jar'
Download the LLM Extension
Download the latest release of the Otoroshi LLM Extension
from here.
curl -L -o otoroshi-llm-extension.jar 'https://github.com/cloud-apim/otoroshi-llm-extension/releases/download/0.0.43/otoroshi-llm-extension_2.12-0.0.43.jar'
Run Otoroshi with the LLM Extension
WARNING: the Otoroshi LLM Extension only run on JDK 17 and above
Run Otoroshi with the LLM extension by executing the following command :
java -cp "./otoroshi-llm-extension.jar:./otoroshi.jar" -Dotoroshi.adminLogin=admin -Dotoroshi.adminPassword=password -Dotoroshi.storage=file play.core.server.ProdServerStart
This will start the Otoroshi API Gateway.
You can access the Otoroshi UI by opening http://otoroshi.oto.tools:8080/ in your browser.
If you want to know more about Otoroshi configuration, just take a look at the documentation