In-memory Semantic caching for LLMs written in Rust | Heykuki News