Skip to main content

Install

Download Otoroshi​

Download

First, download the Otoroshi jar file:

curl -L -o otoroshi.jar 'https://github.com/MAIF/otoroshi/releases/download/v17.13.0/otoroshi.jar'

Download the LLM Extension​

Download the latest release of the Otoroshi LLM Extension

Download the latest release of the Otoroshi LLM Extension from here.

curl -L -o otoroshi-llm-extension.jar \
  'https://github.com/cloud-apim/otoroshi-llm-extension/releases/download/0.0.73/otoroshi-llm-extension_2.12-0.0.73.jar'

Run Otoroshi with the LLM Extension​

WARNING: the Otoroshi LLM Extension only run on JDK 17 and above

Run Otoroshi with the LLM extension by executing the following command :

java -cp "./otoroshi-llm-extension.jar:./otoroshi.jar" \
  -Dotoroshi.adminLogin=admin \
  -Dotoroshi.adminPassword=password \
  -Dotoroshi.storage=file \
  play.core.server.ProdServerStart

This will start the Otoroshi API Gateway.

You can access the Otoroshi UI by opening http://otoroshi.oto.tools:8080/ in your browser.

If you want to know more about Otoroshi configuration, just take a look at the documentation

Use Docker​

alternatively you can use Docker instead of downloading otoroshi

docker run \
  -p 8080:8080 \
  -e APP_STORAGE=file \
  -e OTOROSHI_PLUGINS_DIR_PATH=/usr/app/plugins \
  -v "$(pwd)/otoroshi-llm-extension.jar:/usr/app/plugins/llm.jar" \
  -v "$(pwd)/otoroshi.db:/usr/app/filedb/state.ndjson" \
  maif/otoroshi:latest

This will start the Otoroshi API Gateway.

You can access the Otoroshi UI by opening http://otoroshi.oto.tools:8080/ in your browser.

If you want to know more about Otoroshi configuration, just take a look at the documentation