Which model runs on my machine?
Pick your configuration. For each: the open-weight models that fit in memory, the quantization level, the remaining margin and the command to run them. Computed from actual weight sizes, not from promises.
Graphics cards
RTX 4060 · 8 Go
49 models8 usable GB · Entry level
See the list
RTX 3060 · 12 Go
59 models12 usable GB · Good VRAM per euro
See the list
RTX 4070 · 12 Go
59 models12 usable GB
See the list
RTX 4060 Ti · 16 Go
64 models16 usable GB
See the list
RTX 4070 Ti Super · 16 Go
64 models16 usable GB
See the list
RTX 5080 · 16 Go
64 models16 usable GB
See the list
RTX 3090 · 24 Go
82 models24 usable GB · Second-hand: best GB per euro
See the list
RTX 4090 · 24 Go
82 models24 usable GB
See the list
AMD RX 7900 XTX · 24 Go
82 models24 usable GB · ROCm / Vulkan
See the list
RTX 5090 · 32 Go
83 models32 usable GB
See the list
2 × RTX 4090 · 48 Go
86 models48 usable GB · Tensor parallelism
See the list
RTX 6000 Ada · 48 Go
86 models48 usable GB · Workstation
See the list
NVIDIA L40S · 48 Go
86 models48 usable GB · Inference server
See the list
NVIDIA A100 · 40 Go
83 models40 usable GB
See the list
NVIDIA A100 · 80 Go
92 models80 usable GB
See the list
NVIDIA H100 · 80 Go
92 models80 usable GB
See the list
4 × RTX 4090 · 96 Go
92 models96 usable GB
See the list
2 × H100 · 160 Go
93 models160 usable GB
See the list
Mac Apple Silicon
Mac Apple Silicon 16 Go
59 models12 usable GB · Unified memory
See the list
Mac Apple Silicon 24 Go
69 models18 usable GB · Unified memory
See the list
Mac Apple Silicon 32 Go
82 models24 usable GB · Unified memory
See the list
Mac Apple Silicon 48 Go
83 models36 usable GB · Unified memory
See the list
Mac Apple Silicon 64 Go
86 models48 usable GB · Unified memory
See the list
Mac Apple Silicon 96 Go
90 models72 usable GB · Unified memory
See the list
Mac Apple Silicon 128 Go
92 models96 usable GB · Unified memory
See the list
Mac Studio 192 Go
92 models144 usable GB · Unified memory
See the list