Home/RTX 4090 24GB/Mistral Small 3.2 24B

GPU × Model compatibility

Can the RTX 4090 24GB run Mistral Small 3.2 24B?

AIPCFit compares the model's recorded GGUF variants against the24GB of dedicated VRAM on the RTX 4090 24GB. The result is a deterministic memory-planning check, not a speed benchmark.

GPU
RTX 4090 24GB
Dedicated VRAM
24 GB
Model
Mistral Small 3.2 24B
Best recorded fit
Good fit

Quick answer

Mistral Small 3.2 24B has a memory-fit path on the RTX 4090 24GB

At least one recorded variant reaches AIPCFit's good-fit or fits threshold using this GPU's dedicated VRAM. Exact speed, context capacity, and runtime behavior are not predicted here.

Variant-by-variant fit

Mistral Small 3.2 24B variants on RTX 4090 24GB

Mistral Small 3.2 24B · Q4_K_M

GGUF · Q4_K_M

Good fit
Model-size signal
15 GB
Minimum load
17.3 GB
Planning memory
20.3 GB
GPU VRAM
24 GB

24 GB dedicated VRAM meets the 20.3 GB planning memory level for Mistral Small 3.2 24B · Q4_K_M.

This is a deterministic memory fit, not a speed or quality benchmark.

What this compatibility result does not claim

No speed estimate

AIPCFit does not invent tokens-per-second numbers.

No fake system RAM

This page does not assume how much RAM your full PC has, so partial offload is not ranked.

No universal context guarantee

Longer context and runtime settings can increase real memory pressure.

Explore related local AI guides

RTX 4090 24GB local AI guideMistral Small 3.2 24B model guide24GB VRAM modelsCheck my full PC