To improve the accuracy in conversational AI applications, our semantic cache is aware of the context of the user query. For example, the developer sets the scope of the cache with the system prompt (default) or by designating the cache in the client headers.

Our semantic cache also strives to mimic the behavior of human conversations. For example, if you ask the same question over and over again, a human interlocutor will not respond the same way each time.

Please let us know what you think!