Home › GPUs & Macs › Apple M3 Pro (14-core GPU) vs Apple M5 (10-core GPU)

Apple M3 Pro (14-core GPU) vs Apple M5 (10-core GPU) for local LLMs

Across 5 tests measured on both, the two are about even (median ratio 0.96×).

On Llama 2 7B (Q4_0, llama-bench) the Apple M3 Pro (14-core GPU) generates 30.6 tokens/s and the Apple M5 (10-core GPU) 31.9 tokens/s (measured).

Same model, same quant, same test

ModelQuant / testM3 Pro (14-core GPU)
tok/s
M5 (10-core GPU)
tok/s
FasterSources and run details
Llama 2 7BQ4_0
llama-bench
30.6
Metal
31.9
Metal
M5 (10-core GPU) +4%llama.cpp #4167 M3 Pro (14-core GPU) · llama.cpp #4167 M5 (10-core GPU)
Llama 2 7BQ8_0
llama-bench
17.4
Metal
18.4
Metal
M5 (10-core GPU) +6%llama.cpp #4167 M3 Pro (14-core GPU) · llama.cpp #4167 M5 (10-core GPU)
Llama 3.1 8B InstructQ4_K_M
LocalScore
21.3
llamafile
20.2
llamafile
M3 Pro (14-core GPU) +5%LocalScore M3 Pro (14-core GPU) · LocalScore M5 (10-core GPU)
Llama 3.2 1B InstructQ4_K_M
LocalScore
87.9
llamafile
99.1
llamafile
M5 (10-core GPU) +13%LocalScore M3 Pro (14-core GPU) · LocalScore M5 (10-core GPU)
Qwen2.5 14B InstructQ4_K_M
LocalScore
11.9
llamafile
10.2
llamafile
M3 Pro (14-core GPU) +16%LocalScore M3 Pro (14-core GPU) · LocalScore M5 (10-core GPU)

Generation speed in tokens/s, best measured backend for each chip (shown under the number). Backends can differ between the two chips; check them before drawing conclusions. Measured results only, nothing estimated.

Specs

Apple M3 Pro (14-core GPU)Apple M5 (10-core GPU)
MemoryUnified memoryUnified memory
Memory bandwidth150 GB/s153.6 GB/s

All results for the Apple M3 Pro (14-core GPU) · All results for the Apple M5 (10-core GPU) · More comparisons