Features include multiple backends (in-memory LRU, LFU, FIFO, Redis), OpenAI embedding integration, vector similarity search with pluggable comparators, extensibility for custom backends and providers, type-safe generics, and batch operations.
You can cache responses or documents with semantic lookup, use custom similarity functions, and choose between in-memory or Redis persistence.