Hello everyone! I'm happy to announce chat-rs, another LLM inference provider written in rust with streaming capabilities, tool calling, and intuitive ergonomics. I was heavily inspired by vercel's ai-sdk react framework and I wanted to have a semi opinionated rust alternative. Aside from the basics, we support full on model routers, human-in-the-loop for stop and pause, and thanks to tools-rs (posted yesterday) your agents will be able to call python tools.
Show HN: Chat-rs, yet another LLM provider | Heykuki News