🇫🇷 France generalistReleased December 2023
Mixtral 8x7B
Mistral AI
Open-sourceSelf-host
Verdict
A solid pick for self-hosting and full data control.
Skill profile
Not disclosed
Strengths
- Open-source and self-hostable
Limitations
- No native GDPR guarantee
- API pricing not disclosed
Who is it for
A good fit if…
- you want to control cost or self-host
Skip it if…
- you handle sensitive EU data
Access & availability
Self-hostable (open weights)
Key specifications
Context
32K
Input price
—
Output price
—
Speed
—
Price not auditedBenchmarks not audited
Privacy
Not GDPR-compliant
Run it locally
Workstation (64GB+)631k5k
| Quantization | Disk | RAM / VRAM | Typical hardware |
|---|---|---|---|
| Q4 · recommended | 26.6 GB | 31 GB | 64GB Mac / dual 24GB GPUs |
| Q8 · balanced | 50 GB | 57 GB | 96-128GB Mac Studio / 4× GPUs |
| FP16 · max quality | 93.4 GB | 105 GB | Server GPU infra (H100/A100…) |
Estimates for a moderate context. Long contexts need more RAM (KV cache).
🤗 Hugging Face
ollama run mixtral:8x7b
Advanced data · for expertsArchitecture, modalities, detailed cost, full benchmarks▾
Advanced data · for experts
Architecture, modalities, detailed cost, full benchmarks
Architecture
—
Size
46.7B (MoE, 12.9B actifs)
Cutoff date
—
Inputs
text
Outputs
text
License
apache-2.0
Hosting
—
Hallucination score
—
Estimated cost (API)
Typical exchange (~3k in / 1k out)
Not disclosed
1M in + 1M out
Not disclosed
All benchmarks
| Arena Elo | — |
| MMLU | — |
| GPQA | — |
| HumanEval | — |
| SWE-Bench | — |
| MATH | — |