The Chrome extension uses Transformers.js to run models under the hood. I've integrated and tested these models so far.
* LLM: Llama 3, Phi 3.5, Qwen 2.5, SmolLM2
* Reasoning: DeepSeek R1 (On an M1 MacBook, DeepSeek R1 (1.5B) runs at ~30 tokens/sec)
* Multimodal LLM: Janus
* Speech-to-Text: Whisper
If you're interested in, you can download the extension from chrome web store or clone my github repository.
* chrome web store https://chromewebstore.google.com/detail/private-ai-assistan...
* github https://github.com/tantara/transformers.js-chrome
* demo https://www.youtube.com/watch?v=MSCDdFG5Lls
It's my first react project. Feedback is always welcome!