Ask HN: Browser-UI with multi-LLM for the team?

5 points

2 years ago

I'm looking to provide our 4-person team access to various LLMs, including OpenAI, Anthropic, Meta's Llama, and some others.

I want to have browser-based UI (like ChatGPT) to upload files, get Markdown-reponses and have price control to avoid unexpected high costs at the end of the month. My current plan is to purchase API keys from different LLM providers and use LiteLLM as a proxy to setup cost limits OR to use OpenRouter.ai (potentially still using LiteLLM).

LibreChat currently doesn't support "passing through" uploads, but this feature is expected to be implemented this week: https://github.com/danny-avila/LibreChat/discussions/3760#discussioncomment-10445600

My Questions:

1. Is my approach using LiteLLM or OpenRouter with a UI a viable solution? I believe this could be more cost-effective than purchasing monthly chat accounts for each of the four users.

2. Are there other UIs similar to ChatGPT and Anthropic's interfaces, for the case that the new LibreChat attachment feature is too instable?

Update: It would be great to run a self-hosted open source stack.

10 comments