text-generation-webui
App : A product you use directly
Historic web interface for local LLMs, highly configurable.
Powerful for tinkerers, too complex for a beginner in 2026.
Security reflects where data goes, requested permissions and incidents on record at the verification date. It is not a guarantee of zero risk: check the deployment mode and the connections you enable.
What it does, concretely
text-generation-webui (also distributed as TextGen) addresses the need to run language models locally, without sending any data to a remote server. Everything stays on the user's machine, with zero telemetry or external resources.
In practice, the tool provides a graphical interface accessible from a browser or a desktop window. Users download a GGUF model file from Hugging Face, place it in the designated folder, and the interface detects it automatically. Several inference backends are available: llama.cpp, ExLlamaV3, Transformers, or TensorRT-LLM, and can be switched without restarting.
The tool is aimed at users comfortable with software installation, the command line, and fine-tuning parameters. It also suits developers who want a local API compatible with OpenAI and Anthropic formats to integrate a model into their own applications.
It is not suited for someone looking for a simple, immediate experience: the full installation requires around 10 GB of disk space, downloading PyTorch, and manually selecting the correct dependency file for one's hardware.
What it offers
- ·Multiple conversation modes: instruction mode (similar to ChatGPT), chat mode with custom characters, and a notebook tab for free-form generation.
- ·Multimodal vision: ability to attach images or files (PDF, text, .docx) to a message and discuss their contents with the model.
- ·Tool-calling and web search: models can call custom functions during conversation, including web search and page fetching.
- ·Local API compatible with OpenAI and Anthropic: allows using the tool as a local drop-in replacement for remote APIs, with tool-calling support.
- ·Multiple inference backends supported: llama.cpp, ik_llama.cpp, ExLlamaV3, Transformers, and TensorRT-LLM, switchable without restarting.
- ·LoRA training: fine-tune models on multi-turn chat or raw text datasets, with support for resuming interrupted runs.
- ·Built-in image generation: dedicated tab for diffusers models with 4-bit and 8-bit quantization and a persistent gallery.
- ·Community extensions: text-to-speech, voice input, translation, and other installable modules.
In practice
- Price
- Free
- Commercial use
- Commercial use: yes
- Available on
- windows, linux, macos
- Licence
- AGPL-3.0
Security and data
- Rating
- Security: one caveat, see the card
- Your data
- Data stays local
- Maintenance
- Active
- Last release
- 20 May 2026
Links and repository checked on 25 October 2026 · added on 1 January 2023
How to install text-generation-webui
python server.py --portable --api --auto-launch