Dedicated GPU memory guides
These Windows/NVIDIA guide pages use dedicated GPU memory as the primary fit budget and keep partial offload separate from a full GPU fit.
DeepSeek · DeepSeek
DeepSeek-R1 Distill Qwen 32B local AI fit guide
Review available GGUF variants, quantization choices, and conservative memory-planning levels for running DeepSeek-R1 Distill Qwen 32Blocally.
- Parameters
- 32B
- Size class
- larger
- Use cases
- reasoning, coding, chat
- Catalog context
- 131,072 tokens
GGUF variants
| Variant | Quantization | Estimated file | Minimum load | Planning memory |
|---|---|---|---|---|
| DeepSeek-R1 Distill Qwen 32B · Q4_K_M | Q4_K_M | 20 GB | 23 GB | 27 GB |
| DeepSeek-R1 Distill Qwen 32B · Q8_0 | Q8_0 | 35 GB | 40.3 GB | 47.3 GB |
GPU compatibility
GPUs with a verified memory-fit path for DeepSeek-R1 Distill Qwen 32B
These pages compare this model's recorded GGUF variants against the dedicated VRAM of selected NVIDIA GPUs. They are deterministic memory-fit checks, not performance benchmarks.
Apple Silicon unified-memory guides
Apple Silicon pages use conservative unified-memory budgets and Metal-capable local inference terminology instead of treating the Mac as a CUDA workstation.
Fit caveats
These are deterministic memory-planning checks, not benchmark claims. Context length, runtime settings, offload behavior, and concurrent apps can change practical fit.