Skip to content
KG.
  • Blog
  • Hire me, or see what I ship.

    • ProjectsCase studies & shipped work
    • ServicesWork with me
    • SponsorSponsor the blog
  • Essays and references on AI engineering.

    • BlogEssays on AI engineering
    • Learning PathsGuided curricula
    • Topic PillarsDeep-dive hubs
    • GlossaryAI & dev terms, defined
    • CheatsheetsQuick references
    • ComparisonsX vs Y, decided
  • Things to click, play, and take apart.

    • Tools29 dev & AI utilities
    • Games16 browser games
    • DemosInteractive explainers
    • ChallengesDaily coding puzzles
  • Me

    • AboutWho I am
    • UsesMy gear & setup
    • ResumeCV (PDF)

    Shelf

    • BookshelfBooks I recommend
    • Reading ListWhat I'm reading
  • Subscribe
  • Let's talk
  1. Home
  2. ›
  3. Blog
  4. ›
  5. Local Inference

Local Inference

2 posts tagged #local-inference

Llama 3 70B vs Qwen 3 32B (2026): Which Local LLM Actually Wins for Coding? AI and Machine Learning

Llama 3 70B vs Qwen 3 32B: Which Local LLM Wins for Coding?

Qwen 3 32B wins for coding tasks and hardware-constrained setups; Llama 3 70B wins for ecosystem maturity, English-first workloads, and production integrations. Here's how to choose.

May 10, 2026 13 min read
Read more
Phi-3 vs Gemma 3 in 2026: Which Small LLM Wins for Edge Inference? AI and Machine Learning

Phi-3 vs Gemma 3: Which Small LLM Fits Edge Inference?

Phi-3 wins for ultra-constrained edge devices and Windows/Azure pipelines; Gemma 3 wins for multimodal tasks, Raspberry Pi deployments, and open-ecosystem flexibility. Here's the definitive breakdown.

May 10, 2026 8 min read
Read more

Keep exploring

Close to this topic, not on this page.

  • Gemma 12B vs GPT-4o Mini vs Claude Haiku: Local or API? I ran Gemma's 12B model locally via Ollama and compared it against GPT-4o Mini and Claude Haiku on real dev tasks — here's when the free… 7 min read
  • Mixtral 8x22B vs Llama 3 70B: MoE vs Dense for Production Mixtral 8x22B wins for throughput-hungry, cost-sensitive production APIs where sparse MoE compute matters. 11 min read
  • Gemma 3 vs Llama 3: Which Open Model Fits Your Hardware? Llama 3 wins for ecosystem depth, community tooling, and large-scale deployments; Gemma 3 wins for hardware efficiency, multimodal tasks… 12 min read

Content

  • Blog
  • Topic Pillars
  • Learning Paths
  • Games
  • Demos

Resources

  • Tools
  • Glossary
  • Cheatsheets
  • Comparisons
  • LLM Prices
  • Embedding Prices

About Me

  • About
  • Uses
  • Bookshelf
  • Reading List

Meta

  • Subscribe
  • Changelog
  • Sitemap
  • Privacy
  • Terms
  • RSS
KG

Building intelligent systems. Still chasing those sour icecreams.

Made with coffee and curiosity in Toronto. 2026.