Models › MiMo-V2.6-Flash-RL
MiMo-V2.6-Flash-RL: VRAM needs and speed by GPU
At MXFP4, MiMo-V2.6-Flash-RL needs about 170.4 GB of VRAM. No measured runs yet. Speeds below are estimates. Submit a run.
308.78B parameters · license: mit · 1,048,576-token context · GGUF published Sep 22, 2026 · GGUF files on Hugging Face
Memory needed per quantization
| Quant | File size | Needs (estimate) | Smallest card it fits |
|---|---|---|---|
| Q2_K | 126.4 GB | 129.4 GB | multi-GPU / large unified memory |
| MXFP4 | 167.4 GB | 170.4 GB | multi-GPU / large unified memory |
Expected speed on popular hardware
| Hardware | Best quant that fits | Expected tok/s |
|---|---|---|
| NVIDIA RTX 3060 | Does not fit | |
| NVIDIA RTX 4060 Ti | Does not fit | |
| NVIDIA RTX 3090 | Does not fit | |
| NVIDIA RTX 4090 | Does not fit | |
| NVIDIA RTX 5090 | Does not fit | |
| AMD Radeon RX 7900 XTX | Does not fit | |
| Apple M4 Pro (20-core GPU) | Does not fit | |
| Apple M3 Max (40-core GPU) | Does not fit | |
| AMD Ryzen AI Max+ 395 (Radeon 8060S) | Does not fit | |
Too big for your card?
Run MiMo-V2.6-Flash-RL on a rented 24-80 GB GPU by the hour.
Rent a bigger GPU on RunPodAffiliate link: if you sign up, RigBench may earn a referral credit. It never affects rankings or numbers.