Try Otoroshi LLM Extension

If you want to try Otoroshi LLM Extension for free, you can test it for free on Cloud APIM Serverless.

You can use this project template. All the explainations are available on our blog