RigBench data 2026-10-22

Home › Models › Qwen3.5 35B-A3B

Qwen3.5 35B-A3B: VRAM needs and speed by GPU

At Q4_K_M, Qwen3.5 35B-A3B needs about 23.7 GB of VRAM. We have 1 measured speed results for it.

34.66B parameters (mixture-of-experts, ~3.0B active) · license: apache-2.0 · GGUF files on Hugging Face

Measured speeds

ChipGeneration tok/sPrompt tok/sQuantBackendTestSource
Intel Arc Pro B7054.5618Q4_K_MSYCL FA ontg128PMZFX intel-arc-pro-b70-benchmarks (MIT) details

Memory needed per quantization

QuantFile sizeNeeds (estimate)Smallest card it fits
UD-IQ2_XXS10.7 GB12.3 GB16 GB cards
UD-IQ2_M11.4 GB13.1 GB16 GB cards
UD-Q2_K_XL12.2 GB13.8 GB16 GB cards
UD-IQ3_XXS13.1 GB14.8 GB16 GB cards
UD-IQ3_S13.6 GB15.3 GB16 GB cards
Q3_K_S15.3 GB16.9 GB24 GB cards
Q3_K_M16.4 GB18.0 GB24 GB cards
UD-Q3_K_XL16.6 GB18.3 GB24 GB cards
UD-IQ4_XS17.5 GB19.2 GB24 GB cards
UD-IQ4_NL17.8 GB19.5 GB24 GB cards
UD-Q4_K_L20.2 GB21.9 GB24 GB cards
Q4_K_S20.7 GB22.3 GB24 GB cards
MXFP4_MOE21.6 GB23.3 GB24 GB cards
Q4_K_M22.0 GB23.7 GB32 GB cards
UD-Q4_K_XL22.2 GB23.9 GB32 GB cards
Q5_K_S24.8 GB26.5 GB32 GB cards
Q5_K_M26.2 GB27.9 GB32 GB cards
UD-Q5_K_XL26.4 GB28.1 GB32 GB cards
UD-Q6_K_S28.5 GB30.2 GB32 GB cards
Q6_K28.9 GB30.5 GB32 GB cards
UD-Q6_K_XL32.1 GB33.7 GB48 GB cards
Q8_036.9 GB38.6 GB48 GB cards
UD-Q8_K_XL48.7 GB50.4 GB96 GB cards
BF1669.4 GB71.0 GB96 GB cards

Expected speed on popular hardware

HardwareBest quant that fitsExpected tok/s
NVIDIA RTX 3060Does not fit
NVIDIA RTX 4060 TiDoes not fit
NVIDIA RTX 3090Q4_K_S185 estimate
NVIDIA RTX 4090Q4_K_S246 estimate
NVIDIA RTX 5090Q6_K232 estimate
AMD Radeon RX 7900 XTXQ4_K_S206 estimate
Apple M4 Pro (20-core GPU) (64 GB)Q8_036.6 estimate
Apple M3 Max (40-core GPU) (64 GB)Q8_053.5 estimate
AMD Ryzen AI Max+ 395 (Radeon 8060S)Q8_032.9 estimate

Check your own card

Too big for your card?

Run Qwen3.5 35B-A3B on a rented 24-80 GB GPU by the hour.

Rent a bigger GPU on RunPod

Affiliate link: if you sign up, RigBench may earn a referral credit. It never affects rankings or numbers.