I originally made this as a smol menubar app that could quickly access ChatGPT from wherever I was on desktop. This necessitated writing an Electron app, rather than a Chrome extension. I also didn't have access to the GPT-4 API at the time, so I preferred to use GPT-4 via the full webapp.

Then Bing came out strong, and Bard, and Claude, and Llama, and Vicuna, and Falcon and on and on, and other people kept reporting amazing SOTA results on model after model and I felt hopelessly behind - either you just take benchmark results at face value, or you spend serious time copying and pasting chats just to get a feel for the practical differences between the various closed/open source LLMs.

The real value came when I started just running every query past 3-5 chats at once, and started getting a sense for what each was good at. Bing/You.com is (obviously) good at search, but so is Perplexity. Claude 2 wins about 30% of my code queries vs GPT4. GPT4 and Bard and Bing handle file uploads differently. Llama2 is surprisingly good sometimes but also hopelessly bad at others. And so on. But the answer isn't to pick one daily driver. It's to make it easy to just run them all at once, and swap in/out whenever necessary.

(I've taken to calling this Mixture of Mixture of Experts, akin to the GPT4 rumors geohot dropped on our podcast https://news.ycombinator.com/item?id=36413296)

As the app grew in screen real estate (ultrawide monitor people! this is your calling!) and I started needing to copy/paste things more, I realized what we were really building was a full-fledged secondary browser that does a slightly different job than your regular browser. It's nominal first purpose is to just harmonize all chat inputs, but more broadly, I can pipe any arbitrary input to any open/closed LLM without any api key using your own account, and use it to enhance your browsing experience generally without me ever seeing your data. What could you do if you could add intelligence features for ~free to any part of your browsing experience? MS Edge has shown a bit of this potential but why should we be limited to just the Edge browser, or just the sidebar? (you can see the beginnings of our thinking in the alpha PromptCritic feature we just added).

You can see our 1min launch video here: https://twitter.com/swyx/status/1692988634364871032

We've been hacking on this as a side project, and it's my first ever Electron app using a bunch of gnarly features. The UX has a lot of things to improve (see the open issues... help!) but just wanted to get this out there.

Feedback welcome!