GPUs & Macs › NVIDIA CMP 170HX
NVIDIA CMP 170HX: local LLM speed
1 measured result for the NVIDIA CMP 170HX.
Measured results
| Model | Generate tok/s | Prompt tok/s | Quant | Backend | Test | Source |
|---|---|---|---|---|---|---|
| Qwen3.8 27B | 33.0 | – | Q4_K_M | CUDA | decode, llama-server, MTP off | qwen38-mtp details |
What fits on the NVIDIA CMP 170HX
Estimates for this chip are scaled from a measured run: Qwen3.8 27B Q4_K_M at 33.0 tok/s (CUDA, source). Fit assumes the whole model in GPU memory with ~8K context.
Memory size unknown for this device.
Similar hardware
Nvidia A100 · Nvidia Tesla T10 · Nvidia Tesla K40 · NVIDIA Quadro P620 · NVIDIA GT 1030 · NVIDIA MX150 · NVIDIA GTX 980 · NVIDIA GTX 1050 Ti