Skip to content
Home/Models/Kimi/Kimi K2 Instruct 0905

Moonshot AI · Kimi

Kimi K2 Instruct 0905 local AI fit guide

Review available GGUF variants, quantization choices, and conservative memory-planning levels for running Kimi K2 Instruct 0905locally.

Parameters
1000B
Size class
very-large
Use cases
chat, coding, reasoning
Catalog context
262,144 tokens

GGUF variants

VariantQuantizationEstimated fileMinimum loadPlanning memory
Kimi K2 Instruct 0905 · Q4_K_MQ4_K_M624.0 GB717.6 GB842.4 GB

Dedicated GPU memory guides

These Windows/NVIDIA guide pages use dedicated GPU memory as the primary fit budget and keep partial offload separate from a full GPU fit.

No conservative full-fit guide tier is available yet.

Apple Silicon unified-memory guides

Apple Silicon pages use conservative unified-memory budgets and Metal-capable local inference terminology instead of treating the Mac as a CUDA workstation.

No conservative Apple Silicon guide tier is available yet.

Fit caveats

These are deterministic memory-planning checks, not benchmark claims. Context length, runtime settings, offload behavior, and concurrent apps can change practical fit.