Which model for RTX 4060 · 8 Go?
8 GB usable for the model. 49 open-weight models fit in memory.
The margin goes to context: count ~1 GB per 8k tokens for a 7B model. A small margin means a short context.
| Model | Elo | Quantization | RAM required | Margin | Speed | Run |
|---|---|---|---|---|---|---|
| Gemma 3n E4BGoogle · 8B | 1317 | Q4_K_M | 7 Go | +1 Go | tight | ollama run gemma3n:e4b |
| Granite 4.1 8BIBM · 8B | 1306 | Q4_K_M | 7 Go | +1 Go | tight | Hugging Face ↗ |
| Gemma 3 4BGoogle · 4B | 1303 | Q8_0 | 7 Go | +1 Go | tight | ollama run gemma3:4b |
| Ministral 8BMistral AI · 8.02B | 1237 | Q4_K_M | 7 Go | +1 Go | tight | Hugging Face ↗ |
| Llama 3.1 8BMeta · 8.03B | 1211 | Q4_K_M | 7 Go | +1 Go | tight | ollama run llama3.1:8b |
| Llama 3.2 3BMeta · 3.21B | 1166 | Q8_0 | 6 Go | +2 Go | tight | ollama run llama3.2:3b |
| Llama 3.2 1BMeta · 1.24B | 1111 | FP16 | 5 Go | +3 Go | comfortable | ollama run llama3.2:1b |
| Mistral 7BMistral AI · 7.25B | 1110 | Q4_K_M | 7 Go | +1 Go | tight | ollama run mistral:7b |
| Kokoro-82MHexgrad · 0.08B | — | FP16 | 2 Go | +6 Go | comfortable | Hugging Face ↗ |
| ChatterboxResemble AI · 0.5B | — | FP16 | 3 Go | +5 Go | comfortable | Hugging Face ↗ |
| Parakeet TDT 0.6B v3NVIDIA · 0.6B | — | FP16 | 3 Go | +5 Go | comfortable | Hugging Face ↗ |
| Qwen3 0.6BAlibaba · 0.6B | — | FP16 | 3 Go | +5 Go | comfortable | ollama run qwen3:0.6b |
| TripoSRStability AI · 0.5B | — | FP16 | 3 Go | +5 Go | comfortable | Hugging Face ↗ |
| Gemma 3 1BGoogle · 1B | — | FP16 | 4 Go | +4 Go | comfortable | ollama run gemma3:1b |
| Stable Fast 3DStability AI · 1B | — | FP16 | 4 Go | +4 Go | comfortable | Hugging Face ↗ |
| TRELLISMicrosoft · 1.2B | — | FP16 | 5 Go | +3 Go | comfortable | Hugging Face ↗ |
| Whisper large-v3OpenAI · 1.55B | — | FP16 | 5 Go | +3 Go | comfortable | Hugging Face ↗ |
| Dia 1.6BNari Labs · 1.6B | — | FP16 | 6 Go | +2 Go | tight | Hugging Face ↗ |
| Gemma 4 E2BGoogle · 2B | — | FP16 | 6 Go | +2 Go | tight | Hugging Face ↗ |
| Granite 4.1 3BIBM · 3B | — | Q8_0 | 6 Go | +2 Go | tight | Hugging Face ↗ |
| Hunyuan3D 2.1Tencent · 3B | — | Q8_0 | 6 Go | +2 Go | tight | Hugging Face ↗ |
| Lucie 7BOpenLLM France · 6.7B | — | Q4_K_M | 6 Go | +2 Go | tight | Hugging Face ↗ |
| Ministral 3 3BMistral AI · 3B | — | Q8_0 | 6 Go | +2 Go | tight | Hugging Face ↗ |
| OLMo 3 7BAllen AI · 7B | — | Q4_K_M | 6 Go | +2 Go | tight | Hugging Face ↗ |
| Orpheus 3BCanopy Labs · 3B | — | Q8_0 | 6 Go | +2 Go | tight | Hugging Face ↗ |
| SmolLM3 3BHugging Face · 3.1B | — | Q8_0 | 6 Go | +2 Go | tight | Hugging Face ↗ |
| Voxtral Mini 3BMistral AI · 3B | — | Q8_0 | 6 Go | +2 Go | tight | Hugging Face ↗ |
| Z-Image TurboAlibaba · 6B | — | Q4_K_M | 6 Go | +2 Go | tight | Hugging Face ↗ |
| Apertus 8BSwiss AI · 8B | — | Q4_K_M | 7 Go | +1 Go | tight | Hugging Face ↗ |
| CodeGemma 7BGoogle · 8.5B | — | Q4_K_M | 7 Go | +1 Go | tight | ollama run codegemma |
| Command R7BCohere · 8B | — | Q4_K_M | 7 Go | +1 Go | tight | ollama run command-r7b |
| DeepSeek-R1 Distill 8BDeepSeek · 8.03B | — | Q4_K_M | 7 Go | +1 Go | tight | ollama run deepseek-r1:8b |
| FLUX.2 [klein] 4BBlack Forest Labs · 4B | — | Q8_0 | 7 Go | +1 Go | tight | Hugging Face ↗ |
| Gemma 4 E4BGoogle · 4B | — | Q8_0 | 7 Go | +1 Go | tight | Hugging Face ↗ |
| Granite 3.3 8BIBM · 8.1B | — | Q4_K_M | 7 Go | +1 Go | tight | ollama run granite3.3:8b |
| Hermes 3 8BNous Research · 8.03B | — | Q4_K_M | 7 Go | +1 Go | tight | ollama run hermes3:8b |
| HunyuanVideo 1.5Tencent · 8.3B | — | Q4_K_M | 7 Go | +1 Go | tight | Hugging Face ↗ |
| InternLM3 8BShanghai AI Lab · 8.8B | — | Q4_K_M | 7 Go | +1 Go | tight | Hugging Face ↗ |
| Ministral 3 8BMistral AI · 8B | — | Q4_K_M | 7 Go | +1 Go | tight | Hugging Face ↗ |
| Phi-4 MiniMicrosoft · 3.8B | — | Q8_0 | 7 Go | +1 Go | tight | ollama run phi4-mini |
| Qwen3 4BAlibaba · 4.02B | — | Q8_0 | 7 Go | +1 Go | tight | ollama run qwen3:4b |
| Qwen3 8BAlibaba · 8.2B | — | Q4_K_M | 7 Go | +1 Go | tight | ollama run qwen3:8b |
| TRELLIS.2Microsoft · 4B | — | Q8_0 | 7 Go | +1 Go | tight | Hugging Face ↗ |
| CogVideoX 5BZhipu AI · 5B | — | Q8_0 | 8 Go | +0 Go | tight | Hugging Face ↗ |
| EuroLLM 9BUTTER Project · 9.15B | — | Q4_K_M | 8 Go | +0 Go | tight | Hugging Face ↗ |
| Falcon 3 10BTII · 10.3B | — | Q4_K_M | 8 Go | +0 Go | tight | ollama run falcon3:10b |
| GLM-ImageZhipu AI · 9B | — | Q4_K_M | 8 Go | +0 Go | tight | Hugging Face ↗ |
| Mochi 1Genmo · 10B | — | Q4_K_M | 8 Go | +0 Go | tight | Hugging Face ↗ |
| Wan 2.2 5BAlibaba · 5B | — | Q8_0 | 8 Go | +0 Go | tight | Hugging Face ↗ |