🇫🇷 France generalistReleased May 2024
Mistral 7B
Mistral AI
Open-sourceSelf-host
Verdict
A solid pick for self-hosting and full data control.
Skill profile
Not disclosed
Strengths
- Open-source and self-hostable
Limitations
- No native GDPR guarantee
- API pricing not disclosed
Who is it for
A good fit if…
- you want to control cost or self-host
Skip it if…
- you handle sensitive EU data
Access & availability
Self-hostable (open weights)
Key specifications
Context
32K
Input price
—
Output price
—
Speed
—
Price not auditedBenchmarks not audited
Privacy
Not GDPR-compliant
Run it locally
Runs on a laptop4.1M3k
| Quantization | Disk | RAM / VRAM | Typical hardware |
|---|---|---|---|
| Q4 · recommended | 4.1 GB | 7 GB | 16GB PC / M1+ Mac / 8GB GPU |
| Q8 · balanced | 7.8 GB | 11 GB | 32GB PC / 24GB Mac / RTX 4070 Ti+ |
| FP16 · max quality | 14.5 GB | 18 GB | 32GB PC / 24GB Mac / RTX 4070 Ti+ |
Estimates for a moderate context. Long contexts need more RAM (KV cache).
🤗 Hugging Face
ollama run mistral:7b
Advanced data · for expertsArchitecture, modalities, detailed cost, full benchmarks▾
Advanced data · for experts
Architecture, modalities, detailed cost, full benchmarks
Architecture
—
Size
7.25B
Cutoff date
—
Inputs
text
Outputs
text
License
apache-2.0
Hosting
—
Hallucination score
—
Estimated cost (API)
Typical exchange (~3k in / 1k out)
Not disclosed
1M in + 1M out
Not disclosed
All benchmarks
| Arena Elo | — |
| MMLU | — |
| GPQA | — |
| HumanEval | — |
| SWE-Bench | — |
| MATH | — |