Qwen3.5 397B-A17B
A solid pick for self-hosting and full data control.
Overview
Qwen3.5 397B-A17B is a generalist MoE model (512 experts, 17B active parameters) released as open weights under Apache-2.0. It performs strongly on tool-using agent benchmarks (BFCL-V4, TAU2-Bench, web search) and covers 201 languages with a native 262k-token window extendable to 1M. Its weak spot: on the hardest expert-level reasoning questions (HLE) it trails well behind top closed models. Open weights make on-premise European deployment possible, though the 397B total parameter count still demands substantial server-grade GPU infrastructure despite sparse activation.
Skill profile
Not disclosed
Three independent measures
What people prefer, what the model can do, what the market uses. Each source has its biases and none is enough on its own: we show them side by side, never blended.
Strengths
- World-class on Arena
- Open-source and self-hostable
Limitations
- API pricing not disclosed
Who is it for
- you want to control cost or self-host
- your data must stay in the EU
Ideal use cases
- tool-using agent orchestration
- multilingual document processing
- sovereign on-premise deployment
- very long context analysis
- web research assistants
Access & availability
Key specifications
What it costs per month
Estimate from sourced API prices and a hardware tier for self-hosting. Assumptions are editable.
Assumptions: 36-month amortisation, 0.25 €/kWh, 22 days/month, 1 $ = 0.92 €. Excludes labour, software licences, redundancy.
nAIvigate Trust Index
What the vendor offers and documents for professional use in Europe. An undocumented criterion counts as zero and stays visible: the score rises when the vendor publishes, not when we assume.
19/19 criteria documented · 100 % · 12 of them set by rule
See the criteria▾
Trust Index badge
Show this score in your docs, README or security page. It updates automatically.
[](https://naivigate.com/en/model/qwen3-5-397b-a17b)Data & compliance
What we know, line by line, with source and date. These lines feed the Data and Enterprise families of the Trust Index above. GDPR compliance depends on your processing, not on the model alone.
| EU data residency | Yes |
| Data processing agreement (DPA) | N/A· self-hosted: data never leaves |
| Transfer outside the EU | No |
| Training on your data | No |
| Configurable retention | N/A· self-hosted: data never leaves |
| Zero Data Retention | N/A· self-hosted: data never leaves |
| Self-hostable | Yes |
| Declared hosting | self |
Quality of this card’s data
This score measures the quality of the data on this card: price, context, Elo, licence, documented, sourced and fresh. It measures neither the model nor its compliance: for that, see the Trust Index above.
6/8 documented · 2/8 primary sources
Run it locally
| Quantization | Disk | RAM / VRAM | Typical hardware |
|---|---|---|---|
| Q4 · recommended | 226.3 GB | 251 GB | Server GPU infra (H100/A100…) |
| Q8 · balanced | 424.8 GB | 469 GB | Server GPU infra (H100/A100…) |
| FP16 · max quality | 794 GB | 875 GB | Server GPU infra (H100/A100…) |
Estimates for a moderate context. Long contexts need more RAM (KV cache).
Deploy
Copy-ready commands generated from this card. Adjust context length and GPU count to your hardware.
OpenAI-compatible server for production on NVIDIA GPUs.
pip install vllm
vllm serve Qwen/Qwen3.5-397B-A17B \
--max-model-len 32768 \
--tensor-parallel-size 2 \
--dtype autoAdvanced data · for expertsArchitecture, modalities, detailed cost, full benchmarks▾
| Arena Elo | 1442 |
| MMLU | — |
| GPQA | — |
| HumanEval | — |
| SWE-Bench | — |
| MATH | — |