GPUs & Macs › NVIDIA RTX 3080 Ti Laptop

NVIDIA RTX 3080 Ti Laptop: local LLM speed

1 measured result for the NVIDIA RTX 3080 Ti Laptop.

Measured results

ModelGenerate
tok/s
Prompt
tok/s
QuantBackendTestSource
Qwen3.8 27B14.8–UD-Q3_K_XLCUDA decode, llama-server, MTP offqwen38-mtp details

What fits on the NVIDIA RTX 3080 Ti Laptop

Estimates for this chip are scaled from a measured run: Qwen3.8 27B UD-Q3_K_XL at 14.8 tok/s (CUDA, source). Fit assumes the whole model in GPU memory with ~8K context.

Memory size unknown for this device.

Open in the picker

Similar hardware

Nvidia GTX 1660 Ti Laptop · NVIDIA RTX 3050 Laptop · NVIDIA RTX 3050 Ti Laptop · NVIDIA RTX A1000 Laptop · NVIDIA RTX A2000 Laptop · NVIDIA RTX 500 Ada Laptop · NVIDIA T1200 Laptop · NVIDIA RTX 4050 Laptop