https://github.com/clarkmcc/chitchat
My main motivations were:
- Easy-of-use: Many models are supported out-of-the-box so users don't have to figure out how to download, where to save, etc.
- Intuitive: A clean interface
- Cross platform: The project is written in Rust and cross-compiled to other platforms. You don't have to have Python or the C++ toolchain installed to use.
- Chat-based experience: Model sessions are persisted so the model is contextually aware of your conversation.