Models › Darwin-27B-RSI

Darwin-27B-RSI: VRAM needs and speed by GPU

At Q4_K_M, Darwin-27B-RSI needs about 18.7 GB of VRAM. No measured runs yet. Speeds below are estimates. Submit a run.

26.9B parameters · license: apache-2.0 · 262,144-token context · GGUF published Sep 30, 2026 · GGUF files on Hugging Face

Memory needed per quantization

QuantFile sizeNeeds (estimate)Smallest card it fits
IQ2_XXS8.6 GB10.1 GB12 GB cards
IQ2_XS8.8 GB10.3 GB12 GB cards
IQ2_S9.4 GB10.9 GB12 GB cards
IQ2_M10.3 GB11.8 GB16 GB cards
Q2_K10.6 GB12.1 GB16 GB cards
IQ3_XXS12.1 GB13.6 GB16 GB cards
Q3_K_S12.5 GB14.0 GB16 GB cards
IQ3_XS12.6 GB14.0 GB16 GB cards
Q3_K_M13.2 GB14.6 GB16 GB cards
Q3_K_L13.9 GB15.4 GB16 GB cards
IQ3_M14.6 GB16.1 GB24 GB cards
IQ4_XS15.2 GB16.7 GB24 GB cards
Q4_016.1 GB17.6 GB24 GB cards
Q4_K_S16.1 GB17.6 GB24 GB cards
IQ4_NL17.2 GB18.7 GB24 GB cards
Q4_K_M17.2 GB18.7 GB24 GB cards
Q4_117.6 GB19.1 GB24 GB cards
Q4_K_L18.6 GB20.1 GB24 GB cards
Q5_K_S19.3 GB20.8 GB24 GB cards
Q5_K_M20.7 GB22.2 GB24 GB cards
Q6_K_S22.6 GB24.1 GB32 GB cards
Q6_K23.6 GB25.1 GB32 GB cards
Q6_K_L24.7 GB26.2 GB32 GB cards
Q8_028.7 GB30.1 GB32 GB cards
BF1653.8 GB55.3 GB96 GB cards

Expected speed on popular hardware

HardwareBest quant that fitsExpected tok/s
NVIDIA RTX 3060IQ2_XXS35.7 estimate
NVIDIA RTX 4060 TiDoes not fit
NVIDIA RTX 3090Q5_K_M31.7 estimate
NVIDIA RTX 4090Q5_K_M35.1 estimate
NVIDIA RTX 5090Q8_040.1 estimate
AMD Radeon RX 7900 XTXQ5_K_M35.3 estimate
Apple M4 Pro (20-core GPU) (64 GB)Q8_08.1 estimate
Apple M3 Max (40-core GPU) (64 GB)Q8_011.8 estimate
AMD Ryzen AI Max+ 395 (Radeon 8060S)Q8_07.3 estimate

Check your own card

Too big for your card?

Run Darwin-27B-RSI on a rented 24-80 GB GPU by the hour.

Rent a bigger GPU on RunPod

Affiliate link: if you sign up, RigBench may earn a referral credit. It never affects rankings or numbers.