Ministral 8B
A solid pick for self-hosting and full data control.
Overview
Ministral 8B is a dense 8-billion-parameter transformer from Mistral AI, designed to run locally on laptops or edge servers with a 128k-token context window. On the benchmarks provided it outperforms Llama 3.1 8B and Gemma 2 9B on code, math and multilingual tasks (French, German, Spanish), and natively supports function calling. The real catch: the Mistral Research License bars commercial use without a separate agreement, and current vLLM support caps context at 32k despite the 128k training window. Open weights make fully local deployment possible, keeping data on European-controlled infrastructure.
Skill profile
Not disclosed
Three independent measures
What people prefer, what the model can do, what the market uses. Each source has its biases and none is enough on its own: we show them side by side, never blended.
Strengths
- Open-source and self-hostable
Limitations
- API pricing not disclosed
Who is it for
- you want to control cost or self-host
- your data must stay in the EU
Ideal use cases
- On-device laptop assistants
- Local document processing
- Edge function calling
- Multilingual FR/DE/ES prototyping
- Secure edge deployment
Access & availability
Key specifications
What it costs per month
Estimate from sourced API prices and a hardware tier for self-hosting. Assumptions are editable.
Assumptions: 36-month amortisation, 0.25 €/kWh, 22 days/month, 1 $ = 0.92 €. Excludes labour, software licences, redundancy.
nAIvigate Trust Index
What the vendor offers and documents for professional use in Europe. An undocumented criterion counts as zero and stays visible: the score rises when the vendor publishes, not when we assume.
19/19 criteria documented · 100 % · 12 of them set by rule
See the criteria▾
Trust Index badge
Show this score in your docs, README or security page. It updates automatically.
[](https://naivigate.com/en/model/ministral-8b)Data & compliance
What we know, line by line, with source and date. These lines feed the Data and Enterprise families of the Trust Index above. GDPR compliance depends on your processing, not on the model alone.
| EU data residency | Yes |
| Data processing agreement (DPA) | N/A· self-hosted: data never leaves |
| Transfer outside the EU | No |
| Training on your data | No |
| Configurable retention | N/A· self-hosted: data never leaves |
| Zero Data Retention | N/A· self-hosted: data never leaves |
| Self-hostable | Yes |
| Declared hosting | self |
Quality of this card’s data
This score measures the quality of the data on this card: price, context, Elo, licence, documented, sourced and fresh. It measures neither the model nor its compliance: for that, see the Trust Index above.
6/8 documented · 3/8 primary sources
Run it locally
| Quantization | Disk | RAM / VRAM | Typical hardware |
|---|---|---|---|
| Q4 · recommended | 4.6 GB | 7 GB | 16GB PC / M1+ Mac / 8GB GPU |
| Q8 · balanced | 8.6 GB | 11 GB | 32GB PC / 24GB Mac / RTX 4070 Ti+ |
| FP16 · max quality | 16 GB | 20 GB | 32GB Mac / RTX 3090-4090 |
Estimates for a moderate context. Long contexts need more RAM (KV cache).
Deploy
Copy-ready commands generated from this card. Adjust context length and GPU count to your hardware.
OpenAI-compatible server for production on NVIDIA GPUs.
pip install vllm
vllm serve mistralai/Ministral-8B-Instruct-2410 \
--max-model-len 32768 \
--tensor-parallel-size 1 \
--dtype autoAdvanced data · for expertsArchitecture, modalities, detailed cost, full benchmarks▾
| Arena Elo | 1238 |
| MMLU | — |
| GPQA | — |
| HumanEval | — |
| SWE-Bench | — |
| MATH | — |