24 Go
Best local LLM for 24 GB VRAM
Open-weight models that fit a single 24 GB card (RTX 3090/4090 class) in Q4 quantisation, ranked by LMArena Elo. This is the tier where a workstation runs a genuinely useful model for document analysis, code and RAG without any data leaving the machine.
| # | Model | Arena Elo | RAM (Q4) | Hosting | Licence |
|---|---|---|---|---|---|
| 1 | 🇺🇸Gemma 4 31B Google | 1452 | 21 Go | Self-hostable | apache-2.0 |
| 2 | 🇺🇸Gemma 4 26B-A4B Google | 1438 | 18 Go | Self-hostable | apache-2.0 |
| 3 | 🇨🇳Qwen3.8 27B Alibaba | 1438 | 19 Go | Self-hostable | apache-2.0 |
| 4 | 🇺🇸Gemma 3 27B Google | 1365 | 19 Go | Self-hostable | gemma |
| 5 | 🇫🇷Mistral Small 3.2 Mistral AI | 1356 | 17 Go | Self-hostable | apache-2.0 |
| 6 | 🇨🇳Qwen3 32B Alibaba | 1347 | 23 Go | Self-hostable | apache-2.0 |
| 7 | 🇺🇸Gemma 3 12B Google | 1342 | 9 Go | Self-hostable | gemma |
| 8 | 🇨🇳QwQ 32B Alibaba | 1336 | 23 Go | Self-hostable | apache-2.0 |
| 9 | 🇺🇸Gemma 3n E4B Google | 1318 | 5 Go | Self-hostable | gemma |
| 10 | 🇺🇸Nemotron 3 Nano 30B-A3B NVIDIA | 1314 | 21 Go | Self-hostable | nvidia-open-model |
Data verified on 19 October 2026Open in the comparator
Method
Deterministic ranking on comparator data: LMArena Elo (style control) first, HuggingFace downloads second for models without an Elo. Prices and licences are verified at the official source and dated. No model is ranked by an LLM.