Show HN: Chat with multiple LLMs: o1-high-effort, Sonnet 3.5, GPT-4o, and more

62 points by cr4zy 6 months ago

Hello HN! I was fed up switching between multiple UIs to ask GPT, Claude, etc… the same question and comparing the answers. So I built a way to ask multiple models the same question efficiently by having the LLM compare the responses and only show you new and valuable information from the 2nd model. This way you still get a fast response as normal from the 1st model, but also get any added value provided by the 2nd model.

Initially I built my own UI to use this, but stumbled upon Open WebUI (formerly Ollama WebUI) which is fantastic, but is made more for local access to LLMs. So I talked to its creator, Timothy Baek, and he mentioned that security needed to be shored up before production deployment. I did some scans with semgrep, and fixed some XSRF and CORS issues along with making sure the JWT tokens, passwords, etc… were secure. This was in addition to other folks' amazing security contributions. So now we build on Open WebUI! oss ftw

After launching privately a month or so ago and posting a few reddit links, I have about 100 users.

We also just got access to the o1 API and provide o1-high, medium, and low effort. o1 high effort is able to solve coding problems that only o1 pro can also solve, though pro can go further and has better formatting, o1 high effort is a nice option if you don't want to fork over $200/mo.

https://www.reddit.com/r/OpenAI/comments/1i0r867/comment/m70...

You can use o1 for free in PolyChat, which is the only place I've seen you can do so.

You can also ask multiple models the same question and stream the answers simultaneously side by side. https://imgur.com/a/ly5ZPh8

And you can have multiple chats going simultaneously and they will continue in the background and notify you when they're done.

Another cool feature that makes long chats way easier to navigate is the overview (three dots on top right of chat) https://imgur.com/a/PoB1phT

We give you full control, unlike most providers, to change the system prompt, temperature, etc.. in the chat settings in the "Controls" on the top right.

The formatting for code outputs and inputs is fantastic, using codemirror, and you can run code in the code blocks if it's python or JS using in-browser runtimes.

You can also share chats within polychat where other logged in users can see them:

e.g. https://polychat.co/s/ec163812-9323-4cb5-a429-7ddeaf3572c3

Or you can share it publicly to the OpenWeb UI community

https://openwebui.com/c/crizcraig/e1b2fff9-30a3-4ee7-8eed-b2...

Finally we allow you to search and organize your chats into folders which makes finding things super fast!

Infra: My custom backend that combines models and does things Open WebUI doesn't handle like token tracking is written in FastAPI and uses LiteLLM for easily accessing different model APIs. I host everything on GCP using Cloud Run for the backend and use PostGres for Open WebUI's db, along with BigQuery and Firestore for my FastAPI app's db.

Pricing: Our pricing makes it cheap to access top models. It's free at first, then we offer subscription tiers starting at $5/mo which allots about ~1 million tokens per month, enough for most people. But unlike Claude's UI for example, we don't shut you down with rate limits, but rather let heavy users upgrade beyond to $10, $20, $40, $80, etc... We also suggest a plan based on how quickly you used your free tokens, so you have an idea upfront of the monthly cost before you buy. And you can upgrade or downgrade at any time.

Thanks Show HN <3