What can the 4× H200 NVL run?
| Text models: 59 | Visual models: 0 | Strongest first |
- Memory
- 564 GB
- Bandwidth
- 4,800 GB/s each
- Maker
- NVIDIA
Open the calculator on this machineH200 NVL in our inventory
Text models that run on it
| Model | Best fit | Context | Speed | Strongest at |
|---|---|---|---|---|
| MiMo V2.6 Pro | FP4 + FP8 | 112K | 71 tok/s | Chat, Coding, Agents, Docs |
| DeepSeek V4.1 Flash | FP4 + FP8 | 1M | 135 tok/s | Chat, Coding, Agents, Docs |
| GLM-5.3 | 5-bit | 352K | 76 tok/s | Chat, Coding, Agents, Docs |
| GLM-5.3 Flash | FP8 | 1M | 122 tok/s | Chat, Coding, Agents, Docs |
| Qwen3.8 2.4T A95B | 1.6-bit | 256K | 87 tok/s | Chat, Coding, Agents |
| Qwen3.8 Flash-Next | 8-bit | 256K | 208 tok/s | Chat, Coding, Agents |
| Muse Spark Open 816B A42B | 4-bit | 1M | 89 tok/s | Chat, Docs |
| MiMo V2.6 Flash | FP4 + FP8 | 1M | 164 tok/s | Coding, Agents |
| MiniMax M3 | 8-bit | 928K | 92 tok/s | Docs |
| DeepSeek V4 Flash | FP4 + FP8 | 1M | 122 tok/s | Docs |
| DeepSeek V4 Pro | 1.6-bit | 1M | 150 tok/s | Chat, Coding, Agents, Docs |
| Kimi K2.6 | 3-bit | 256K | 120 tok/s | Chat, Coding, Agents, Docs |
| Hy3 | 8-bit | 256K | 87 tok/s | Chat, Coding, Agents, Docs |
| Nemotron 3 Ultra 550B A55B | 6-bit | 256K | 50 tok/s | Chat, Coding, Docs |
| Qwen3.5 397B A17B | 8-bit | 256K | 111 tok/s | Agents, Docs |
| MiniMax M2.7 | FP8 | 200K | 149 tok/s | Coding, Agents |
| DeepSeek V3.2 | 6-bit | 160K | 79 tok/s | Chat, Coding, Agents, Docs |
| Inkling | 4-bit | 4K | 88 tok/s | Text and images |
| DeepSeek R1 | 6-bit | 144K | 74 tok/s | Not rated |
| DeepSeek V3 | 6-bit | 144K | 74 tok/s | Not rated |
| GLM 5 | 5-bit | 198K | 73 tok/s | Not rated |
| Inkling Small | 8-bit | 4K | 163 tok/s | Text and images |
| MiniMax M2.5 | FP8 | 192K | 139 tok/s | Not rated |
| GLM 5.1 | 5-bit | 198K | 73 tok/s | Not rated |
| Laguna M.1 | 8-bit | 256K | 86 tok/s | Not rated |
| Qwen3 VL 235B A22B Instruct | 8-bit | 256K | 79 tok/s | Text and images |
| GLM 5.2 | 5-bit | 352K | 74 tok/s | Not rated |
| Qwen3 235B A22B | 8-bit | 40K | 79 tok/s | Not rated |
| Kimi K2 Instruct | 3-bit | 128K | 103 tok/s | Not rated |
| Ornith 1.5 397B | 8-bit | 256K | 88 tok/s | Not rated |
| Ornith 1.0 397B | 8-bit | 256K | 108 tok/s | Not rated |
| Step 3.5 Flash | 8-bit | 256K | 176 tok/s | Not rated |
| DeepSeek V3 0324 | 6-bit | 144K | 74 tok/s | Not rated |
| DeepSeek R1 0528 | 6-bit | 144K | 74 tok/s | Not rated |
| GLM 4.5 | 8-bit | 128K | 60 tok/s | Not rated |
| MiniMax M2 | FP8 | 192K | 139 tok/s | Not rated |
| MiMo V2.5 | FP8 | 1M | 123 tok/s | Not rated |
| GLM 5.3 Flash BF16 | 8-bit | 1M | 117 tok/s | Text and images |
| Qwen3 VL 235B A22B Thinking | 8-bit | 256K | 79 tok/s | Text and images |
| Qwen3 235B A22B Instruct 2507 | 8-bit | 256K | 79 tok/s | Not rated |
| Hy3 Preview | 8-bit | 256K | 88 tok/s | Not rated |
| Qwen3 Coder 480B A35B Instruct | 8-bit | 232K | 68 tok/s | Coding |
| GLM 4.7 | 8-bit | 198K | 60 tok/s | Not rated |
| GLM 5.3 BF16 | 5-bit | 352K | 74 tok/s | Not rated |
| GLM 4.6 | 8-bit | 198K | 61 tok/s | Not rated |
| DeepSeek V2 Chat | 8-bit | 160K | 97 tok/s | Not rated |
| MiMo V2 Flash | FP8 | 256K | 128 tok/s | Not rated |
| Le Triomphant ECE TW3 | 8-bit | 32K | 40 tok/s | Not rated |
| TW3 JRGL V2 | 8-bit | 32K | 40 tok/s | Not rated |
| Command A Plus 05 2026 Bf16 | 8-bit | 195K | 100 tok/s | Text and images |
| K EXAONE 2.0 750B A37B | 5-bit | 256K | 80 tok/s | Not rated |
| MiniMax M2.1 | FP8 | 192K | 139 tok/s | Not rated |
| Beam 1.0 501B A23B | 8-bit | 1M | 96 tok/s | Not rated |
| Hy4 Preview | 5-bit | 168K | 66 tok/s | Not rated |
| Qwen1.5 72B | 8-bit | 32K | 40 tok/s | Not rated |
| WizardLM 2 8x22B | 8-bit | 64K | 64 tok/s | Not rated |
| Intern S1 | 8-bit | 64K | 69 tok/s | Text and images |
| Step 3.7 Flash | 8-bit | 256K | 175 tok/s | Text and images |
| K2 Horizon 375B A23B | 8-bit | 512K | 91 tok/s | Not rated |
Best fit is the highest quality, up to 8-bit, that leaves the use case’s context. Ranked by our use-case scores, then by Hugging Face downloads. Speeds are rough, plus or minus 25%.
Only just too big
These need up to a quarter more memory than the 4× H200 NVL has. Spilling into system RAM or a lower precision can get them running, slowly.
Questions
What is the best LLM for the 4× H200 NVL?
Of the open models we track, the strongest that run well on the 4× H200 NVL are MiMo V2.6 Pro, DeepSeek V4.1 Flash, GLM-5.3. 59 text models fit it in all.
Calculated from published specs, not benchmarked. All machines