cpu-inference articles, tutorials & guides

Gemma 4 26B CPU Inference Benchmark: 5 tok/s Production Math [2026]

A $300 Xeon from 2013 runs Gemma 4 26B at 5 tok/s with no GPU. Here's the memory bandwidth math, quantization tradeoffs, and production decision framework nobody else is covering.

Keep exploring

Close to this topic, not on this page.

Gemma 4 12B vs GPT-4o Mini vs Claude Haiku: Is Google's Local LLM Good Enough to Replace API Calls? [2026] I ran Gemma's 12B model locally via Ollama and compared it against GPT-4o Mini and Claude Haiku on real dev tasks — here's when the free… 7 min read
Qwen 4 27B? Why Alibaba Skipped It [2026 Benchmark] You searched for a Qwen 4 27B local LLM benchmark — but there's no Qwen 4. 10 min read
How to Run Qwen 35B on 16GB VRAM [2026]: Flags + Quants A reproducible 16GB recipe for “Qwen 35B”: which Qwen2.5-32B quants fit, how to budget KV cache, and the exact serving flags that stop OOMs. 8 min read

#cpu-inference

Gemma 4 26B CPU Inference Benchmark: 5 tok/s Production Math [2026]

Keep exploring