Skip to content

What can the 2× RTX 3090 run?

What fits on the 2× RTX 3090
Text models: 188Visual models: 0Strongest first
Memory
48 GB
Bandwidth
936 GB/s each
Maker
NVIDIA

Open the calculator on this machine

Text models that run on it

Text models that run on the 2× RTX 3090, best first
ModelBest fitContextSpeedStrongest at
Qwen3.8 27B8-bit256K22 tok/sChat, Coding, Agents, Docs
Muse Glimmer 30B8-bit128K21 tok/sDocs
Nemotron 3 Super 120B A12B2-bit96K81 tok/sChat, Coding, Agents, Docs
Nemotron 3.5 Bolt 74B A9B4-bit216K72 tok/sChat, Coding, Agents, Docs
Qwen3.6 35B A3B8-bit256K136 tok/sChat, Coding, Agents, Docs
Gemma 4 31B8-bit256K19 tok/sChat, Coding, Agents, Docs
Gemma 4 26B A4B8-bit256K126 tok/sChat, Coding, Agents, Docs
Qwen3.5 9B8-bit256K66 tok/sChat, Coding, Agents, Docs
GLM-4.7 Flash8-bit198K130 tok/sChat, Coding, Agents
Gemma 4 12B8-bit256K48 tok/sChat, Coding, Docs
Mistral Small 4 119B2-bit104K170 tok/sChat, Docs
gpt-oss 120B2-bit88K197 tok/sChat, Coding
Qwen3 Coder Next 80B3-bit256K191 tok/sCoding, Agents
Nemotron 3.5 Lightning 30B A3B8-bit256K124 tok/sAgents, Docs
Devstral Small 2 24BFP8128K25 tok/sCoding
LFM2.5 24B A2B8-bit128K177 tok/sAgents
Mistral Small 3.2 24B8-bit128K26 tok/sChat, Coding, Agents
Ministral 3 14B8-bit192K44 tok/sCoding, Agents, Docs
gpt-oss 20BMXFP4128K187 tok/sAgents
Ministral 3 8B8-bit256K68 tok/sDocs
Llama 3.3 70B3-bit36K18 tok/sChat, Coding, Agents, Docs
Olmo 3.1 32B8-bit64K19 tok/sChat, Coding, Agents, Docs
Llama 3.1 8B8-bit128K76 tok/sChat, Coding, Agents, Docs
Qwen3 14B8-bit40K42 tok/sNot rated
Qwen3 VL 8B Instruct8-bit248K70 tok/sText and images
Qwen3 8B8-bit40K75 tok/sNot rated
Qwen3 32B8-bit40K19 tok/sNot rated
Qwen3.6 27B8-bit256K22 tok/sText and images
Qwen2.5 Coder 14B Instruct8-bit32K41 tok/sCoding
Qwen3 Coder 30B A3B Instruct8-bit144K129 tok/sCoding
Qwen3.5 27B8-bit256K22 tok/sText and images
Qwen3.5 35B A3B8-bit256K136 tok/sText and images
NVIDIA Nemotron 3 Nano 30B A3B BF168-bit256K124 tok/sNot rated
Mistral 7B Instruct V0.28-bit32K80 tok/sNot rated
GLM 4.5 Air2-bit28K88 tok/sNot rated
Qwen3 30B A3B8-bit40K129 tok/sNot rated
Qwen3 30B A3B Instruct 25078-bit144K129 tok/sNot rated
Laguna XS.28-bit256K137 tok/sNot rated
OTel 2.0 LLM 31B IT8-bit256K19 tok/sNot rated
Qwen2.5 32B Instruct8-bit32K19 tok/sNot rated
MiniCPM V 4.7 35B A3B8-bit256K136 tok/sText and images
Qwen2.5 14B Instruct8-bit32K41 tok/sNot rated
Laguna XS 2.18-bit256K137 tok/sNot rated
Diffusiongemma 26B A4B IT8-bit256K121 tok/sText and images
Qwen2.5 VL 32B Instruct8-bit40K18 tok/sText and images
Qwen2.5 Coder 32B Instruct8-bit32K19 tok/sCoding
Laguna S 2.12-bit64K130 tok/sNot rated
Ornith 1.5 9B8-bit256K66 tok/sNot rated
Qwen3 VL 30B A3B Instruct8-bit136K129 tok/sText and images
EXAONE 3.5 7.8B Instruct8-bit32K77 tok/sNot rated
DeepSeek R1 0528 Qwen3 8B8-bit128K75 tok/sNot rated
Gemma 3 12B IT8-bit128K51 tok/sText and images
Phi 3.5 Mini Instruct8-bit104K143 tok/sNot rated
DeepSeek R1 Distill Qwen 32B8-bit44K19 tok/sNot rated
Gemma 3 27B IT8-bit128K23 tok/sText and images
Ornith 1.5 35B A3B8-bit256K136 tok/sNot rated
GPT Neox 20B8-bit2K29 tok/sNot rated
Apertus 8B Instruct 25098-bit64K76 tok/sNot rated
Phi 48-bit16K41 tok/sNot rated
Phi 3 Mini 128K Instruct8-bit104K143 tok/sNot rated

Best fit is the highest quality, up to 8-bit, that leaves the use case’s context. Ranked by our use-case scores, then by Hugging Face downloads. Speeds are rough, plus or minus 25%. The top 60 of 188 are shown.

Only just too big

These need up to a quarter more memory than the 2× RTX 3090 has. Spilling into system RAM or a lower precision can get them running, slowly.

Questions

What is the best LLM for the 2× RTX 3090?

Of the open models we track, the strongest that run well on the 2× RTX 3090 are Qwen3.8 27B, Muse Glimmer 30B, Nemotron 3 Super 120B A12B. 188 text models fit it in all.

Calculated from published specs, not benchmarked. All machines