Skip to main content

Caching

you can activate caching on any provider

Simple cache​

simple cache works on prompts word per word

simple-cache

Semantic cache​

semantic cache uses an embedding datastore to find prompt with the same semantic

semantic-cache