Run locally
53 scored tools, ranked by overall score. Last checked on 25 October 2026. Refine with the Finder →
Looking for an open-source model to run (Wan, LTX, Flux, Whisper…)? Model Finder →
The three to remember
The de facto standard for running models locally and connecting them to other tools.
- · Utility 9.5/10, best of the selection
- · Free, no limits
- · No known security caveat
The go-to free tool for stem separation.
- · Utility 9/10
- · Free, no limits
- · No known security caveat
The best free option: everything stays on your machine.
- · Utility 8/10
- · Free, no limits
- · No known security caveat
| Tool | Price | Score | Sec. |
|---|---|---|---|
| OllamaRun an open-weight model in one command, with a local OpenAI-compatible API. | Free | 9.7 | Security: nothing to flag |
| Ultimate Vocal RemoverRisingVoice and instrument separation running locally with multiple models (MDX, Demucs). | Free | 9.6 | Security: nothing to flag |
| JanRisingOpen-source alternative to LM Studio, with zero telemetry. | Free | 9.2 | Security: nothing to flag |
| Buzz (Whisper)RisingLocal transcription with Whisper, SRT and VTT export, no account or cloud required. | Free | 9.1 | Security: nothing to flag |
| UpscaylRisingEnlarges and restores images up to 16x locally, without watermark. | Free | 9.1 | Security: nothing to flag |
| vLLMRisingHigh-performance serving engine for running LLMs for multiple users in parallel. | Free | 9.1 | Security: nothing to flag |
| Docling (IBM)RisingLocal PDF and document parsing, tables and layout included. | Free | 9.0 | Security: nothing to flag |
| MeetilyMeeting assistant that records, transcribes (Whisper or Parakeet) and summarises your meetings on your machine, with no bot and no cloud. | Freemium | 9.0 | Security: nothing to flag |
| REAL Video EnhancerRisingFree interface to interpolate and upscale videos using RIFE and ESRGAN. | Free | 9.0 | Security: nothing to flag |
| llama.cppRisingThe C/C++ inference engine behind Ollama, LM Studio, and most local AI tools. | Free | 8.9 | Security: nothing to flag |
| Home AssistantOpen source home automation with local voice assistant Assist. | Free | 8.7 | Security: nothing to flag |
| SGLangRisingA serving engine competing with vLLM, very fast thanks to the RadixAttention prefix cache. | Free | 8.7 | Security: nothing to flag |
| Krita AI DiffusionRisingPlugin that brings AI generation and inpainting locally into the free painting software Krita. | Free | 8.5 | Security: nothing to flag |
| Wan2GPRisingInterface to run Wan, Hunyuan and LTX on modest GPUs. | Free | 8.4 | Security: nothing to flag |
| ACE-Step 1.5RisingFull music generation (vocals, structure, style) running locally, open source. | Free | 8.3 | Security: nothing to flag |
| LocalAIRisingSelf-hosted OpenAI-compatible API covering text, image, audio and embeddings. | Free | 8.3 | Security: nothing to flag |
| MacWhisperLocal Whisper transcription on Mac, with a polished interface. | Freemium · from 59 € | 8.3 | Security: nothing to flag |
| MLX (mlx-lm)RisingApple framework for running LLMs on M-series chips using unified memory. | Free | 8.3 | Security: nothing to flag |
| Applio (RVC)RisingModern interface for RVC voice conversion, training and inference running locally. | Free | 8.2 | Security: one caveat, see the card |
| FrigateRisingLocal NVR for cameras with 100% local AI object detection. | Freemium | 8.2 | Security: nothing to flag |
| KoboldCppRisingSingle executable to run GGUF models with an interface oriented towards writing and roleplay. | Free | 8.2 | Security: nothing to flag |
| TRELLIS.2 (Microsoft)RisingMicrosoft image-to-3D model producing a PBR mesh in seconds, running locally. | Free | 8.1 | Security: nothing to flag |
| Open WebUIRisingSelf-hosted chat interface in the style of ChatGPT, connected to Ollama or any OpenAI API. | Free | 8.0 | Security: one caveat, see the card |
| InvokeAIRisingLocal generation studio with a retouching canvas, more accessible than ComfyUI. | Freemium | 7.9 | Security: nothing to flag |
| Video2XWatch outLocal video upscaling and frame interpolation (Real-ESRGAN, RIFE), open source. | Free | 7.9 | Security: nothing to flag |
| ComfyUIRisingA node-based workshop for running open-source image and video models locally. | Free | 7.8 | Security: one caveat, see the card |
| FooocusWatch outUltra-simplified local interface to generate high-quality SDXL images without technical adjustments. | Free | 7.7 | Security: nothing to flag |
| GPT-SoVITSVoice cloning and synthesis from a few seconds of audio, running locally. | Free | 7.7 | Security: one caveat, see the card |
| TripoSRImage to 3D in under one second, open source, runs locally. | Free | 7.7 | Security: nothing to flag |
| AnythingLLMRisingAll-in-one application to chat with your documents, locally or via API, with built-in agents. | Freemium | 7.6 | Security: one caveat, see the card |
| LM StudioA graphical interface to download and chat with open-weight models on your own PC. | Freemium | 7.5 | Security: one caveat, see the card |
| Postshot (Jawset)Watch outLocal Gaussian splat training on NVIDIA GPU. | Freemium | 7.5 | Security: nothing to flag |
| LLM Guard (Protect AI)Watch outOpen source input and output scanners: injection, personal data, toxicity. | Free | 7.4 | Security: nothing to flag |
| whisper.cppRisingC/C++ implementation of Whisper, very fast on CPU and Apple Silicon. | Free | 7.4 | Security: nothing to flag |
| F5-TTSRisingSpeech synthesis and voice cloning via flow matching, fast and local. | Free | 7.3 | Security: one caveat, see the card |
| FramePackWatch outLocal long video generation with only 6 GB of VRAM. | Free | 7.3 | Security: nothing to flag |
| LivePortraitAnimates a portrait from a reference video, locally. | Free | 7.3 | Security: one caveat, see the card |
| Crawl4AIRisingOpen source crawler optimized for LLMs, running locally. | Free | 7.1 | Security: one caveat, see the card |
| YuERisingGenerate complete songs with lyrics, locally, open source. | Free | 7.1 | Security: one caveat, see the card |
| GPT4AllWatch outLocal public chat client by Nomic, with document discussion support. | Free | 7.0 | Security: nothing to flag |
| Browser UseRisingLLM-driven browser control, open source. | Freemium | 6.7 | Security: serious reservations |
| MstyA polished desktop client that combines local models and cloud APIs in a single interface. | Freemium | 6.7 | Security: one caveat, see the card |
| text-generation-webuiRisingHistoric web interface for local LLMs, highly configurable. | Free | 6.7 | Security: one caveat, see the card |
| DeepFilterNetWatch outReal-time noise suppression, lightweight, works even on CPU. | Free | 6.6 | Security: nothing to flag |
| Hunyuan3D 2.1 (Tencent)Watch outTextured PBR 3D generation from an image, running locally. | Free | 6.6 | Security: one caveat, see the card |
| Real-ESRGANWatch outLocal image and video upscaling, the backbone of many tools. | Free | 6.6 | Security: nothing to flag |
| RIFEWatch outAI-based video frame interpolation, running locally. | Free | 6.6 | Security: nothing to flag |
| Mira-SceneNewReconstructs an editable 3D scene from a single photo: each object is modelled separately then placed back at its position and scale. | Free | 6.4 | Security: one caveat, see the card |
| Resemble EnhanceWatch outSpeech denoising and enhancement, open source. | Free | 6.4 | Security: nothing to flag |
| DiffRhythmWatch outGenerate complete tracks in seconds, locally. | Free | 6.1 | Security: one caveat, see the card |
| LatentSync (ByteDance)Watch outHigh-quality diffusion-based lip sync, running locally. | Free | 6.0 | Security: one caveat, see the card |
| MuseTalkWatch outReal-time lip-sync running locally. | Free | 6.0 | Security: one caveat, see the card |
| MusicGen (Meta)Watch outMeta's text-to-music generation model with open weights. | Free | 5.9 | Security: one caveat, see the card |
App : A product you use directly · Tool : A precise action the AI can call · MCP : Standardises the connection between an AI application and systems that expose tools or data · Built-in mode : A feature to switch on inside an assistant you already use (ChatGPT, Claude, Gemini): nothing to install · Skill : A reusable method: instructions, procedures, sometimes scripts or templates · Plugin : A set of capabilities installed into an AI application or a host
Method
Overall score = utility (rated by the editorial team), reliability (GitHub activity, official publisher, reachable site), security (where data goes, permissions, known incidents) and accessibility (install, required level, price), weighted per category. A tool inactive for over six months is flagged and leaves the recommendations. No ranking is sold.
Missing a tool? A score looks wrong?
Write to the editors