Muse Glimmer 30B on RTX 3060 12 GB: VRAM, speed and fit
Muse Glimmer 30B at 4-bit needs 18.0 GB; the RTX 3060 12 GB can use 12.0 GB. The smallest machine we checked that runs it is the RTX 4000 SFF Ada.
Text generation · Chat · Ollama / LM Studio
Won’t fit · on RTX 3060 12 GB · 4-bit (Q4_K_M) · Ollama / LM Studio · Chat
- GPU memory
- 18.0 GB
- of 12.0 GB
- Context
- 8K
- auto
- Speed
- n/a
- First reply
- n/a
Where the memory goes
- Model
- 16.8 GB
- Context
- 182 MB
- Overhead
- 1.0 GB
- OS
- 0.0 GB
- Over by
- 6.0 GB
- Memory
- 18.0 GB of 12.0 GB
- Context
- 8K tokens · auto
- Speed
- Doesn’t run here
- Running cost
- Doesn’t run here · $30/mo on a cloud RTX A4500
Validation: Not validated
| Check | Target | Result | Status |
|---|---|---|---|
| Fits in GPU memory | 12.0 GB usable | 18.0 GB needed | Fails |
| Headroom | 5% free | none | Fails |
| Context for chat | 16K or more | – | Not run |
| Writing speed | 15 tok/s or more | – | Not run |
| First reply | under 3 s, 2K prompt | – | Not run |
Targets: a reply you can read along with, a first reply the use case tolerates, and 5% of memory left free. Calculated from published specs, not benchmarked.
The setup
- Model
- Muse Glimmer 30B
- Parameters
- 29.8B
- Precision
- 4-bit (Q4_K_M)
- Context
- 8K, auto
- Chats at once
- 1
- Use
- Chat
- Runs in
- Ollama / LM Studio
- Hardware
- RTX 3060 12 GB
- GPU can use
- 12.0 GB of 12.0 GB
Worth trying
- 2× RTX 3060 12 GB: Fits across the cards, 128K context
- Spill to RAM: Runs, slower, 5.4 tok/s
- RTX 4000 SFF Ada: Runs it with 80K context
- M5 Max · 36 GB: Runs it with 128K context
Running cost
- At home
- n/a
- Doesn’t run on this machine.
- Renting instead
- $30/mo
- RTX A4500 at $0.25/h
4 h a day, power at $0.18 per kWh, cloud at RunPod on-demand prices as of Nov 21, 2026.
How to run it
- Ollama
ollama run muse-glimmer:30b- llama.cpp
llama-server -hf unsloth/Muse-Glimmer-30B-GGUF- vLLM
vllm serve meta-models/Muse-Glimmer-30B- MLX (Mac)
mlx_lm.chat --model mlx-community/Muse-Glimmer-30B-4bit
Muse Glimmer 30B on similar machines
- RTX 4060Too big
- RTX 5060Too big
- RTX 3070Too big
- RTX 3080 10 GBToo big
- Arc B580Just misses
- RTX 4070Just misses
- RTX 4070 SuperJust misses
- RTX 5070Just misses
All machines: Muse Glimmer 30B VRAM requirements. Everything that runs here: what can the RTX 3060 12 GB run?
Other models that run on RTX 3060 12 GB
Questions
Can Muse Glimmer 30B run on RTX 3060 12 GB?
Muse Glimmer 30B at 4-bit needs 18.0 GB; the RTX 3060 12 GB can use 12.0 GB. The smallest machine we checked that runs it is the RTX 4000 SFF Ada.
Shown at the closest setup. Report VR-1LMP132, calculated Nov 22, 2026 from published specs, not benchmarked.