Show HN: Chrome extension to run GenAI models in browser

4 points

a year ago

Hi all, I open sourced my toy project that runs Generative AI models LOCALLY in the side panel of a Chrome extension.

The Chrome extension uses Transformers.js to run models under the hood. I've integrated and tested these models so far.

* LLM: Llama 3, Phi 3.5, Qwen 2.5, SmolLM2

* Reasoning: DeepSeek R1 (On an M1 MacBook, DeepSeek R1 (1.5B) runs at ~30 tokens/sec)

* Multimodal LLM: Janus

* Speech-to-Text: Whisper

If you're interested in, you can download the extension from chrome web store or clone my github repository.

It's my first react project. Feedback is always welcome!