Skip to content
KG.
  • Blog
  • Hire me, or see what I ship.

    • ProjectsCase studies & shipped work
    • ServicesWork with me
    • SponsorSponsor the blog
  • Essays and references on AI engineering.

    • BlogEssays on AI engineering
    • Learning PathsGuided curricula
    • Topic PillarsDeep-dive hubs
    • GlossaryAI & dev terms, defined
    • CheatsheetsQuick references
    • ComparisonsX vs Y, decided
  • Things to click, play, and take apart.

    • Tools29 dev & AI utilities
    • Games16 browser games
    • DemosInteractive explainers
    • ChallengesDaily coding puzzles
  • Me

    • AboutWho I am
    • UsesMy gear & setup
    • ResumeCV (PDF)

    Shelf

    • BookshelfBooks I recommend
    • Reading ListWhat I'm reading
  • Subscribe
  • Let's talk
  1. Home
  2. ›
  3. Blog
  4. ›
  5. AI Engineering

AI Engineering

2 posts tagged #ai-engineering

A digital dashboard displaying marketing metrics including CTR and quality score on a screen AI and Machine Learning

How to Test Non-Deterministic AI Systems and LLMs

A release-gating playbook for LLMs and agents: golden sets, metamorphic tests, variance control, tolerance bands, cohort diffs, and eval-regression postmortems.

September 16, 2026 10 min read
Read more
black laptop computer turned on on table AI and Machine Learning

Fine-Tuning vs RAG vs Prompt Engineering: Decision Framework

Stop guessing which LLM technique to use. A 2026-updated decision matrix with real cost figures, concrete examples, and a clear flowchart for when fine-tuning beats RAG, when RAG beats both, and when prompt engineering alone is the right answer.

July 11, 2026 14 min read
Read more

Keep exploring

Close to this topic, not on this page.

  • Agent Evaluation Roadmap for Small Teams: 30 Min a Week A pragmatic map of offline vs online vs HITL evals, what to measure beyond “response quality,” and the smallest program that actually… 8 min read
  • How to Build Synthetic Data for RAG Evaluation A leakage-first, adversarial-negative pipeline to generate, label, and validate a synthetic RAG evaluation set without building a… 8 min read
  • RAG Evaluation Metrics for Retrieval Quality: My Production Playbook If your RAG app got worse after an embeddings or chunking change, grading answers won’t tell you why. 11 min read

Content

  • Blog
  • Topic Pillars
  • Learning Paths
  • Games
  • Demos

Resources

  • Tools
  • Glossary
  • Cheatsheets
  • Comparisons
  • LLM Prices
  • Embedding Prices

About Me

  • About
  • Uses
  • Bookshelf
  • Reading List

Meta

  • Subscribe
  • Changelog
  • Sitemap
  • Privacy
  • Terms
  • RSS
KG

Building intelligent systems. Still chasing those sour icecreams.

Made with coffee and curiosity in Toronto. 2026.