EuroLLM 9B
A solid pick for self-hosting and full data control.
Overview
EuroLLM 9B is a multilingual model built under the EU-funded UTTER project, released under an Apache 2.0 licence with commercial use allowed. At 9.15B parameters it stays light enough for on-premise deployment, down to a laptop at Q4 quantisation, making it a credible open option for teams wary of sending data abroad. Its 4000-token context window is notably short, though, which caps it for longer documents or extended sessions. Backed by European public funding, it fits well into sovereignty-minded, GDPR-conscious setups.
Skill profile
Not disclosed
Three independent measures
What people prefer, what the model can do, what the market uses. Each source has its biases and none is enough on its own: we show them side by side, never blended.
Strengths
- Open-source and self-hostable
Limitations
- API pricing not disclosed
Who is it for
- you want to control cost or self-host
- your data must stay in the EU
Ideal use cases
- Internal multilingual chatbot
- EU document translation
- Local on-device assistant
- Sovereign rapid prototyping
- Multilingual EU customer support
Access & availability
Key specifications
What it costs per month
Estimate from sourced API prices and a hardware tier for self-hosting. Assumptions are editable.
Assumptions: 36-month amortisation, 0.25 €/kWh, 22 days/month, 1 $ = 0.92 €. Excludes labour, software licences, redundancy.
nAIvigate Trust Index
What the vendor offers and documents for professional use in Europe. An undocumented criterion counts as zero and stays visible: the score rises when the vendor publishes, not when we assume.
19/19 criteria documented · 100 % · 12 of them set by rule
See the criteria▾
Trust Index badge
Show this score in your docs, README or security page. It updates automatically.
[](https://naivigate.com/en/model/eurollm-9b)Data & compliance
What we know, line by line, with source and date. These lines feed the Data and Enterprise families of the Trust Index above. GDPR compliance depends on your processing, not on the model alone.
| EU data residency | Yes |
| Data processing agreement (DPA) | N/A· self-hosted: data never leaves |
| Transfer outside the EU | No |
| Training on your data | No |
| Configurable retention | N/A· self-hosted: data never leaves |
| Zero Data Retention | N/A· self-hosted: data never leaves |
| Self-hostable | Yes |
| Declared hosting | self |
Quality of this card’s data
This score measures the quality of the data on this card: price, context, Elo, licence, documented, sourced and fresh. It measures neither the model nor its compliance: for that, see the Trust Index above.
5/8 documented · 1/8 primary sources
Run it locally
| Quantization | Disk | RAM / VRAM | Typical hardware |
|---|---|---|---|
| Q4 · recommended | 5.2 GB | 8 GB | 16GB PC / M1+ Mac / 8GB GPU |
| Q8 · balanced | 9.8 GB | 13 GB | 32GB PC / 24GB Mac / RTX 4070 Ti+ |
| FP16 · max quality | 18.3 GB | 22 GB | 32GB Mac / RTX 3090-4090 |
Estimates for a moderate context. Long contexts need more RAM (KV cache).
Deploy
Copy-ready commands generated from this card. Adjust context length and GPU count to your hardware.
OpenAI-compatible server for production on NVIDIA GPUs.
pip install vllm
vllm serve utter-project/EuroLLM-9B-Instruct \
--max-model-len 4000 \
--tensor-parallel-size 1 \
--dtype autoAdvanced data · for expertsArchitecture, modalities, detailed cost, full benchmarks▾
| Arena Elo | — |
| MMLU | — |
| GPQA | — |
| HumanEval | — |
| SWE-Bench | — |
| MATH | — |