Home › GPUs & Macs › Apple M4 Pro (20-core GPU) vs Apple M4 Max (40-core GPU)

Apple M4 Pro (20-core GPU) vs Apple M4 Max (40-core GPU) for local LLMs

Across 6 tests measured on both, the Apple M4 Max (40-core GPU) is faster in 6 and generates a median 1.63× the tokens/s of the Apple M4 Pro (20-core GPU).

On Llama 2 7B (F16, llama-bench) the Apple M4 Pro (20-core GPU) generates 17.2 tokens/s and the Apple M4 Max (40-core GPU) 31.6 tokens/s (measured).

Same model, same quant, same test

ModelQuant / testM4 Pro (20-core GPU)
tok/s
M4 Max (40-core GPU)
tok/s
FasterSources and run details
Llama 2 7BF16
llama-bench
17.2
Metal
31.6
Metal
M4 Max (40-core GPU) +84%llama.cpp #4167 M4 Pro (20-core GPU) · llama.cpp #4167 M4 Max (40-core GPU)
Llama 2 7BQ4_0
llama-bench
50.7
Metal
83.1
Metal
M4 Max (40-core GPU) +64%llama.cpp #4167 M4 Pro (20-core GPU) · llama.cpp #4167 M4 Max (40-core GPU)
Llama 2 7BQ8_0
llama-bench
30.7
Metal
54.0
Metal
M4 Max (40-core GPU) +76%llama.cpp #4167 M4 Pro (20-core GPU) · llama.cpp #4167 M4 Max (40-core GPU)
Llama 3.1 8B InstructQ4_K_M
LocalScore
32.7
llamafile
52.9
llamafile
M4 Max (40-core GPU) +62%LocalScore M4 Pro (20-core GPU) · LocalScore M4 Max (40-core GPU)
Llama 3.2 1B InstructQ4_K_M
LocalScore
119
llamafile
180
llamafile
M4 Max (40-core GPU) +52%LocalScore M4 Pro (20-core GPU) · LocalScore M4 Max (40-core GPU)
Qwen2.5 14B InstructQ4_K_M
LocalScore
18.0
llamafile
28.9
llamafile
M4 Max (40-core GPU) +61%LocalScore M4 Pro (20-core GPU) · LocalScore M4 Max (40-core GPU)

Generation speed in tokens/s, best measured backend for each chip (shown under the number). Backends can differ between the two chips; check them before drawing conclusions. Measured results only, nothing estimated.

Specs

Apple M4 Pro (20-core GPU)Apple M4 Max (40-core GPU)
MemoryUnified memoryUnified memory
Memory bandwidth273 GB/s546 GB/s

All results for the Apple M4 Pro (20-core GPU) · All results for the Apple M4 Max (40-core GPU) · More comparisons