This project was to explore that a small base model running in the browser as a Co Pilot-like writing assistant. You can check out the demo here: smol-complete.vercel.app.

Smal, on device models have a lot of advantages with low latency, cost, privacy (a big one), and being task specific. The demo will definitely repeat itself and hallucinate sometimes, but let me know what you think!