I understand self-hosted models don't really compare to Copilot/Claude, but I have projects which rule out the use of external services, and I would appreciate having a solution which works offline and also allows tinkering with the models.

Most of the existing plugins seem to be thin shells over Ollama, which is nice and makes setup straightforward, but also means there are many options to choose from - which solutions do people like?

Continue.dev seems closest to the thing I want, but I ran into an issue with its Ollama integration where it would exhaust the TCP connection pool(?) on starting up the server :(