RigBench data 2026-10-22

Home › Models › Qwen3.5 27B

Qwen3.5 27B: VRAM needs and speed by GPU

At Q4_K_M, Qwen3.5 27B needs about 18.2 GB of VRAM. We have 4 measured speed results for it.

26.9B parameters · license: apache-2.0 · GGUF files on Hugging Face

Measured speeds

ChipGeneration tok/sPrompt tok/sQuantBackendTestSource
Intel Arc Pro B7020.4718Q4_K_MSYCL FA ontg128PMZFX intel-arc-pro-b70-benchmarks (MIT) details
Intel Arc Pro B7015.3776Q8_0SYCL FA ontg128PMZFX intel-arc-pro-b70-benchmarks (MIT) details
Intel Arc Pro B7015.1786Q6_KSYCL FA ontg128PMZFX intel-arc-pro-b70-benchmarks (MIT) details
Intel Arc Pro B706.3361IQ4_NLSYCL FA ontg128PMZFX intel-arc-pro-b70-benchmarks (MIT) details

Memory needed per quantization

QuantFile sizeNeeds (estimate)Smallest card it fits
UD-IQ2_XXS8.6 GB10.0 GB12 GB cards
UD-IQ2_M10.2 GB11.7 GB16 GB cards
UD-Q2_K_XL11.2 GB12.7 GB16 GB cards
UD-IQ3_XXS11.5 GB13.0 GB16 GB cards
Q3_K_S12.3 GB13.8 GB16 GB cards
Q3_K_M13.5 GB15.0 GB16 GB cards
UD-Q3_K_XL14.4 GB15.9 GB24 GB cards
IQ4_XS15.0 GB16.4 GB24 GB cards
IQ4_NL15.7 GB17.2 GB24 GB cards
Q4_015.7 GB17.2 GB24 GB cards
Q4_K_S15.8 GB17.2 GB24 GB cards
Q4_K_M16.7 GB18.2 GB24 GB cards
Q4_117.2 GB18.7 GB24 GB cards
UD-Q4_K_XL17.6 GB19.1 GB24 GB cards
Q5_K_S18.9 GB20.4 GB24 GB cards
Q5_K_M19.6 GB21.1 GB24 GB cards
UD-Q5_K_XL20.2 GB21.6 GB24 GB cards
Q6_K22.5 GB23.9 GB32 GB cards
UD-Q6_K_XL25.7 GB27.1 GB32 GB cards
Q8_028.6 GB30.1 GB32 GB cards
UD-Q8_K_XL35.5 GB37.0 GB48 GB cards
BF1653.8 GB55.3 GB96 GB cards

Expected speed on popular hardware

HardwareBest quant that fitsExpected tok/s
NVIDIA RTX 3060UD-IQ2_XXS35.9 estimate
NVIDIA RTX 4060 TiDoes not fit
NVIDIA RTX 3090Q5_K_M33.5 estimate
NVIDIA RTX 4090Q5_K_M44.4 estimate
NVIDIA RTX 5090Q8_040.2 estimate
AMD Radeon RX 7900 XTXQ5_K_M37.2 estimate
Apple M4 Pro (20-core GPU) (64 GB)Q8_08.1 estimate
Apple M3 Max (40-core GPU) (64 GB)Q8_011.8 estimate
AMD Ryzen AI Max+ 395 (Radeon 8060S)Q8_07.3 estimate

Check your own card

Too big for your card?

Run Qwen3.5 27B on a rented 24-80 GB GPU by the hour.

Rent a bigger GPU on RunPod

Affiliate link: if you sign up, RigBench may earn a referral credit. It never affects rankings or numbers.