What can the 8× H200 NVL run?
| Text models: 38 | Visual models: 0 | Strongest first |
- Memory
- 1128 GB
- Bandwidth
- 4,800 GB/s each
- Maker
- NVIDIA
Open the calculator on this machineH200 NVL in our inventory
Text models that run on it
| Model | Best fit | Context | Speed | Strongest at |
|---|---|---|---|---|
| Kimi K3 | 2-bit | 1M | 58 tok/s | Chat, Coding, Agents, Docs |
| MiMo V2.6 Pro | FP4 + FP8 | 1M | 71 tok/s | Chat, Coding, Agents, Docs |
| DeepSeek V4.1 Flash | FP4 + FP8 | 1M | 135 tok/s | Chat, Coding, Agents, Docs |
| GLM-5.3 | FP8 | 1M | 60 tok/s | Chat, Coding, Agents, Docs |
| GLM-5.3 Flash | FP8 | 1M | 122 tok/s | Chat, Coding, Agents, Docs |
| Qwen3.8 2.4T A95B | 2-bit | 256K | 61 tok/s | Chat, Coding, Agents |
| Muse Spark Open 816B A42B | 8-bit | 1M | 59 tok/s | Chat, Docs |
| MiniMax M3 | 8-bit | 1M | 92 tok/s | Docs |
| DeepSeek V4 Pro | FP4 + FP8 | 1M | 64 tok/s | Chat, Coding, Agents, Docs |
| Kimi K2.6 | INT4 | 256K | 58 tok/s | Chat, Coding, Agents, Docs |
| Hy3 | 8-bit | 256K | 87 tok/s | Chat, Coding, Agents, Docs |
| Nemotron 3 Ultra 550B A55B | 8-bit | 256K | 42 tok/s | Chat, Coding, Docs |
| Qwen3.5 397B A17B | 8-bit | 256K | 111 tok/s | Agents, Docs |
| DeepSeek V3.2 | FP8 | 160K | 67 tok/s | Chat, Coding, Agents, Docs |
| Inkling | 8-bit | 4K | 59 tok/s | Text and images |
| DeepSeek R1 | FP8 | 160K | 64 tok/s | Not rated |
| DeepSeek V3 | FP8 | 160K | 64 tok/s | Not rated |
| GLM 5 | 8-bit | 198K | 55 tok/s | Not rated |
| GLM 5.1 | 8-bit | 198K | 55 tok/s | Not rated |
| GLM 5.2 | 8-bit | 1M | 56 tok/s | Not rated |
| Kimi K2 Instruct | FP8 | 128K | 62 tok/s | Not rated |
| Ornith 1.5 397B | 8-bit | 256K | 88 tok/s | Not rated |
| Ornith 1.0 397B | 8-bit | 256K | 108 tok/s | Not rated |
| DeepSeek V3 0324 | FP8 | 160K | 64 tok/s | Not rated |
| DeepSeek R1 0528 | FP8 | 160K | 64 tok/s | Not rated |
| GLM 4.5 | 8-bit | 128K | 60 tok/s | Not rated |
| MiMo V2.5 | FP8 | 1M | 123 tok/s | Not rated |
| GLM 5.3 Flash BF16 | 8-bit | 1M | 117 tok/s | Text and images |
| Hy3 Preview | 8-bit | 256K | 88 tok/s | Not rated |
| Qwen3 Coder 480B A35B Instruct | 8-bit | 256K | 68 tok/s | Coding |
| GLM 4.7 | 8-bit | 198K | 60 tok/s | Not rated |
| GLM 5.3 BF16 | 8-bit | 1M | 56 tok/s | Not rated |
| GLM 4.6 | 8-bit | 198K | 61 tok/s | Not rated |
| MiMo V2 Flash | FP8 | 256K | 128 tok/s | Not rated |
| K EXAONE 2.0 750B A37B | 8-bit | 256K | 61 tok/s | Not rated |
| Beam 1.0 501B A23B | 8-bit | 1M | 96 tok/s | Not rated |
| Hy4 Preview | 8-bit | 1M | 49 tok/s | Not rated |
| K2 Horizon 375B A23B | 8-bit | 512K | 91 tok/s | Not rated |
Best fit is the highest quality, up to 8-bit, that leaves the use case’s context. Ranked by our use-case scores, then by Hugging Face downloads. Speeds are rough, plus or minus 25%.
Questions
What is the best LLM for the 8× H200 NVL?
Of the open models we track, the strongest that run well on the 8× H200 NVL are Kimi K3, MiMo V2.6 Pro, DeepSeek V4.1 Flash. 38 text models fit it in all.
Calculated from published specs, not benchmarked. All machines