finds.dev

oobabooga/textgen

Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

View on GitHub

★ 47,588PythonAGPL-3.0updated Aug 2026

// compared · The Best Tools for Running LLMs LocallySee the alternatives →

// the take

This is the rebrand/evolution of text-generation-webui, a long-running Gradio-based desktop app and API server for running local LLMs (GGUF, EXL3, Transformers, TensorRT-LLM). It targets people who want a self-hosted ChatGPT-style UI with an OpenAI/Anthropic-compatible API, without sending data anywhere.

Genuinely mature multi-backend support (llama.cpp, ik_llama.cpp, ExLlamaV3, Transformers, TensorRT-LLM) that most competing UIs don't bother maintaining. The portable builds with bundled CUDA/ROCm/Vulkan binaries actually solve the real pain point of local LLM setup hell. Tool-calling and MCP support plus an OpenAI/Anthropic-compatible API make it usable as a drop-in backend for other tools, not just a standalone chat window. Command-line flag surface is huge, meaning almost every sampler parameter and hardware quirk is configurable if you're willing to read the docs.

The flag list and installation matrix (conda vs portable vs docker vs full) signal real complexity under the hood; new users will hit friction picking the right requirements file for their GPU. Extensions are a grab-bag of scripts with inconsistent maintenance (some, like superboogav2, bundle their own nltk data and look stale). No mention of test coverage or CI beyond build workflows, so quality control for such a sprawling codebase is unclear. Being a years-old project with a huge accumulated flag surface means backward-compat cruft is baked in, and the constant renaming/rebranding (oobabooga/text-generation-webui -> textgen) suggests churn that could break saved configs or bookmarks.

We read the README, the directory tree and a key source file in August 2026. Nobody pays to be listed. How we judge →

// at a glance

Stars
47,588
Forks
5,982
Language
Python
License
AGPL-3.0
Last commit
17 Aug 2026

// nearby

If textgen isn't quite it.

All repos →