GPU × Model compatibility
AIPCFit compares the model's recorded GGUF variants against the24GB of dedicated VRAM on the RTX 4090 24GB. The result is a deterministic memory-planning check, not a speed benchmark.
Quick answer
At least one recorded variant reaches AIPCFit's good-fit or fits threshold using this GPU's dedicated VRAM. Exact speed, context capacity, and runtime behavior are not predicted here.
Variant-by-variant fit
GGUF · Q4_K_M
24 GB dedicated VRAM meets the 21.9 GB minimum-load planning level, but not the 25.7 GB recommended headroom.
Expect less room for long context or concurrent GPU work.
AIPCFit does not invent tokens-per-second numbers.
This page does not assume how much RAM your full PC has, so partial offload is not ranked.
Longer context and runtime settings can increase real memory pressure.