Show HN: Panza: A personal email assistant, trained and running on-device

49 points

2 years ago

Tired of crafting well-polished emails and wish you had an assistant to take over the hard work while mimicking your writing style? Introducing Panza, a personalized LLM email assistant that runs entirely on your device! Choose between Llama-3 or Mistral, tailor it to your unique style, and let it write the emails for you. Take a look at our demo and give it a try on your emails at: https://github.com/IST-DASLab/PanzaMail

Some technical details about Panza:

- Panza is an automated email assistant customized to your writing style and past email history.

- Panza produces a fine-tuned LLM that matches your writing style, pairing it with a Retrieval-Augmented Generation (RAG) component which helps it produce relevant emails.

- Panza *can be trained and run entirely locally*. Currently, it requires a single GPU with 16-24 GiB of memory, but we also plan to release a CPU-only version.

- Training and execution are also quick - for a dataset on the order of 1000 emails, training Panza takes well under an hour, and generating a new email takes a few seconds at most.

5 comments