AI tools

Run locally

53 scored tools, ranked by overall score. Last checked on 25 October 2026. Refine with the Finder →

Looking for an open-source model to run (Wan, LTX, Flux, Whisper…)? Model Finder →

The three to remember

Most powerful

Ollama

AppSecurity: nothing to flag

9.7

The de facto standard for running models locally and connecting them to other tools.

· Utility 9.5/10, best of the selection
· Free, no limits
· No known security caveat

Free1 clickSite ↗

Simplest

Ultimate Vocal Remover

AppRisingSecurity: nothing to flag

9.6

The go-to free tool for stem separation.

· Utility 9/10
· Free, no limits
· No known security caveat

Free1 clickSite ↗

The alternative

Docling (IBM)

ToolRisingSecurity: nothing to flag

9.0

The best free option: everything stays on your machine.

· Utility 8/10
· Free, no limits
· No known security caveat

Free5 min

TypeApp Tool MCP Built-in mode Skill PluginPriceFree Freemium Paid

Tool	Type	What it does	Price	Install	Score	Sec.
OllamaRun an open-weight model in one command, with a local OpenAI-compatible API.	App	Run an open-weight model in one command, with a local OpenAI-compatible API.	Free	1 click	9.7	Security: nothing to flag
Ultimate Vocal RemoverRisingVoice and instrument separation running locally with multiple models (MDX, Demucs).	App	Voice and instrument separation running locally with multiple models (MDX, Demucs).	Free	1 click	9.6	Security: nothing to flag
JanRisingOpen-source alternative to LM Studio, with zero telemetry.	App	Open-source alternative to LM Studio, with zero telemetry.	Free	1 click	9.2	Security: nothing to flag
Buzz (Whisper)RisingLocal transcription with Whisper, SRT and VTT export, no account or cloud required.	App	Local transcription with Whisper, SRT and VTT export, no account or cloud required.	Free	1 click	9.1	Security: nothing to flag
UpscaylRisingEnlarges and restores images up to 16x locally, without watermark.	App	Enlarges and restores images up to 16x locally, without watermark.	Free	1 click	9.1	Security: nothing to flag
vLLMRisingHigh-performance serving engine for running LLMs for multiple users in parallel.	App	High-performance serving engine for running LLMs for multiple users in parallel.	Free	Technical	9.1	Security: nothing to flag
Docling (IBM)RisingLocal PDF and document parsing, tables and layout included.	Tool	Local PDF and document parsing, tables and layout included.	Free	5 min	9.0	Security: nothing to flag
REAL Video EnhancerRisingFree interface to interpolate and upscale videos using RIFE and ESRGAN.	App	Free interface to interpolate and upscale videos using RIFE and ESRGAN.	Free	1 click	9.0	Security: nothing to flag
llama.cppRisingThe C/C++ inference engine behind Ollama, LM Studio, and most local AI tools.	App	The C/C++ inference engine behind Ollama, LM Studio, and most local AI tools.	Free	Technical	8.9	Security: nothing to flag
Home AssistantOpen source home automation with local voice assistant Assist.	App	Open source home automation with local voice assistant Assist.	Free	Technical	8.7	Security: nothing to flag
SGLangRisingA serving engine competing with vLLM, very fast thanks to the RadixAttention prefix cache.	App	A serving engine competing with vLLM, very fast thanks to the RadixAttention prefix cache.	Free	Technical	8.7	Security: nothing to flag
Krita AI DiffusionRisingPlugin that brings AI generation and inpainting locally into the free painting software Krita.	Plugin	Plugin that brings AI generation and inpainting locally into the free painting software Krita.	Free	5 min	8.5	Security: nothing to flag
Wan2GPRisingInterface to run Wan, Hunyuan and LTX on modest GPUs.	App	Interface to run Wan, Hunyuan and LTX on modest GPUs.	Free	5 min	8.4	Security: nothing to flag
ACE-Step 1.5RisingFull music generation (vocals, structure, style) running locally, open source.	App	Full music generation (vocals, structure, style) running locally, open source.	Free	Technical	8.3	Security: nothing to flag
LocalAIRisingSelf-hosted OpenAI-compatible API covering text, image, audio and embeddings.	App	Self-hosted OpenAI-compatible API covering text, image, audio and embeddings.	Free	Technical	8.3	Security: nothing to flag
MLX (mlx-lm)RisingApple framework for running LLMs on M-series chips using unified memory.	App	Apple framework for running LLMs on M-series chips using unified memory.	Free	Technical	8.3	Security: nothing to flag
Applio (RVC)RisingModern interface for RVC voice conversion, training and inference running locally.	App	Modern interface for RVC voice conversion, training and inference running locally.	Free	5 min	8.2	Security: one caveat, see the card
KoboldCppRisingSingle executable to run GGUF models with an interface oriented towards writing and roleplay.	App	Single executable to run GGUF models with an interface oriented towards writing and roleplay.	Free	5 min	8.2	Security: nothing to flag
TRELLIS.2 (Microsoft)RisingMicrosoft image-to-3D model producing a PBR mesh in seconds, running locally.	App	Microsoft image-to-3D model producing a PBR mesh in seconds, running locally.	Free	Technical	8.1	Security: nothing to flag
Open WebUIRisingSelf-hosted chat interface in the style of ChatGPT, connected to Ollama or any OpenAI API.	App	Self-hosted chat interface in the style of ChatGPT, connected to Ollama or any OpenAI API.	Free	5 min	8.0	Security: one caveat, see the card
Video2XWatch outLocal video upscaling and frame interpolation (Real-ESRGAN, RIFE), open source.	App	Local video upscaling and frame interpolation (Real-ESRGAN, RIFE), open source.	Free	5 min	7.9	Security: nothing to flag
ComfyUIRisingA node-based workshop for running open-source image and video models locally.	App	A node-based workshop for running open-source image and video models locally.	Free	5 min	7.8	Security: one caveat, see the card
FooocusWatch outUltra-simplified local interface to generate high-quality SDXL images without technical adjustments.	App	Ultra-simplified local interface to generate high-quality SDXL images without technical adjustments.	Free	5 min	7.7	Security: nothing to flag
GPT-SoVITSVoice cloning and synthesis from a few seconds of audio, running locally.	App	Voice cloning and synthesis from a few seconds of audio, running locally.	Free	Technical	7.7	Security: one caveat, see the card
TripoSRImage to 3D in under one second, open source, runs locally.	App	Image to 3D in under one second, open source, runs locally.	Free	Technical	7.7	Security: nothing to flag
LLM Guard (Protect AI)Watch outOpen source input and output scanners: injection, personal data, toxicity.	Tool	Open source input and output scanners: injection, personal data, toxicity.	Free	Technical	7.4	Security: nothing to flag
whisper.cppRisingC/C++ implementation of Whisper, very fast on CPU and Apple Silicon.	App	C/C++ implementation of Whisper, very fast on CPU and Apple Silicon.	Free	Technical	7.4	Security: nothing to flag
F5-TTSRisingSpeech synthesis and voice cloning via flow matching, fast and local.	App	Speech synthesis and voice cloning via flow matching, fast and local.	Free	Technical	7.3	Security: one caveat, see the card
FramePackWatch outLocal long video generation with only 6 GB of VRAM.	App	Local long video generation with only 6 GB of VRAM.	Free	5 min	7.3	Security: nothing to flag
LivePortraitAnimates a portrait from a reference video, locally.	App	Animates a portrait from a reference video, locally.	Free	Technical	7.3	Security: one caveat, see the card
Crawl4AIRisingOpen source crawler optimized for LLMs, running locally.	Tool	Open source crawler optimized for LLMs, running locally.	Free	Technical	7.1	Security: one caveat, see the card
YuERisingGenerate complete songs with lyrics, locally, open source.	App	Generate complete songs with lyrics, locally, open source.	Free	Technical	7.1	Security: one caveat, see the card
GPT4AllWatch outLocal public chat client by Nomic, with document discussion support.	App	Local public chat client by Nomic, with document discussion support.	Free	1 click	7.0	Security: nothing to flag
text-generation-webuiRisingHistoric web interface for local LLMs, highly configurable.	App	Historic web interface for local LLMs, highly configurable.	Free	Technical	6.7	Security: one caveat, see the card
DeepFilterNetWatch outReal-time noise suppression, lightweight, works even on CPU.	App	Real-time noise suppression, lightweight, works even on CPU.	Free	Technical	6.6	Security: nothing to flag
Hunyuan3D 2.1 (Tencent)Watch outTextured PBR 3D generation from an image, running locally.	App	Textured PBR 3D generation from an image, running locally.	Free	Technical	6.6	Security: one caveat, see the card
Real-ESRGANWatch outLocal image and video upscaling, the backbone of many tools.	App	Local image and video upscaling, the backbone of many tools.	Free	Technical	6.6	Security: nothing to flag
RIFEWatch outAI-based video frame interpolation, running locally.	App	AI-based video frame interpolation, running locally.	Free	Technical	6.6	Security: nothing to flag
Mira-SceneNewReconstructs an editable 3D scene from a single photo: each object is modelled separately then placed back at its position and scale.	App	Reconstructs an editable 3D scene from a single photo: each object is modelled separately then placed back at its position and scale.	Free	Technical	6.4	Security: one caveat, see the card
Resemble EnhanceWatch outSpeech denoising and enhancement, open source.	App	Speech denoising and enhancement, open source.	Free	Technical	6.4	Security: nothing to flag
DiffRhythmWatch outGenerate complete tracks in seconds, locally.	App	Generate complete tracks in seconds, locally.	Free	Technical	6.1	Security: one caveat, see the card
LatentSync (ByteDance)Watch outHigh-quality diffusion-based lip sync, running locally.	App	High-quality diffusion-based lip sync, running locally.	Free	Technical	6.0	Security: one caveat, see the card
MuseTalkWatch outReal-time lip-sync running locally.	App	Real-time lip-sync running locally.	Free	Technical	6.0	Security: one caveat, see the card
MusicGen (Meta)Watch outMeta's text-to-music generation model with open weights.	App	Meta's text-to-music generation model with open weights.	Free	Technical	5.9	Security: one caveat, see the card

App : A product you use directly · Tool : A precise action the AI can call · MCP : Standardises the connection between an AI application and systems that expose tools or data · Built-in mode : A feature to switch on inside an assistant you already use (ChatGPT, Claude, Gemini): nothing to install · Skill : A reusable method: instructions, procedures, sometimes scripts or templates · Plugin : A set of capabilities installed into an AI application or a host

Method

Overall score = utility (rated by the editorial team), reliability (GitHub activity, official publisher, reachable site), security (where data goes, permissions, known incidents) and accessibility (install, required level, price), weighted per category. A tool inactive for over six months is flagged and leaves the recommendations. No ranking is sold.

Missing a tool? A score looks wrong?

Write to the editors