#11
B
Rank #146
open-webui
A ChatGPT-style web UI for local and remote LLM backends (Ollama, OpenAI-compatible APIs). Standout trait is fully local operation with no forced external API dependency.
65.8
/ 100
⚙ Full Stack
Python/FastAPI backend, Svelte frontend, SQLite by default (Postgres supported) for chat history and users, connects out to Ollama or any OpenAI-compatible model endpoint.
📈 Scaling Analysis
SQLite default and in-process websocket streaming push it toward single-instance use; swapping to Postgres and running behind a sticky-session load balancer allows modest horizontal scaling, but the real bottleneck is the downstream model-serving capacity, not the UI layer.
🚀 Running on Nexlayer
Single open-webui pod, pointed at an ollama pod (ollama.pod:11434) for local inference or an external LLM endpoint via env var; add a postgres pod for durable multi-user chat history instead of the SQLite default. Official image is Docker Hub namespaced — mirror via mirror.gcr.io.