Skip to content
KG.
  • Blog
  • Hire me, or see what I ship.

    • ProjectsCase studies & shipped work
    • ServicesWork with me
    • SponsorSponsor the blog
  • Essays and references on AI engineering.

    • BlogEssays on AI engineering
    • Learning PathsGuided curricula
    • Topic PillarsDeep-dive hubs
    • GlossaryAI & dev terms, defined
    • CheatsheetsQuick references
    • ComparisonsX vs Y, decided
  • Things to click, play, and take apart.

    • Tools29 dev & AI utilities
    • Games16 browser games
    • DemosInteractive explainers
    • ChallengesDaily coding puzzles
  • Me

    • AboutWho I am
    • UsesMy gear & setup
    • ResumeCV (PDF)

    Shelf

    • BookshelfBooks I recommend
    • Reading ListWhat I'm reading
  • Subscribe
  • Let's talk
  1. Home
  2. ›
  3. Blog
  4. ›
  5. Agent Evaluation

Agent Evaluation

1 post tagged #agent-evaluation

developer monitoring dashboard laptop screen metrics — illustration for article on Evaluate AI Agents in Production: AI and Machine Learning

Evaluate AI Agents in Production: 3-Level Framework

Most AI agent failures trace back to missing evals. Here's the 3-level framework — unit tests, LLM-as-judge, and online evaluation — that actually works in production.

July 12, 2026 16 min read
Read more

Keep exploring

Close to this topic, not on this page.

  • Context Engineering for AI Agents: 4 Pillars Beyond Prompts Context engineering — the systematic management of what an AI agent knows, remembers, and can access at each step — is the discipline… 10 min read
  • Generative AI vs Agentic AI vs AI Agents, Explained Everyone's told to 'go agentic', but nobody agrees on what that means. 13 min read
  • Start an AI Agent Evaluation Program: A 5-Task Scorecard Ship agents with a regression safety net: pick 5 real tasks, define pass/fail, run evals weekly in CI, and publish a scorecard that forces… 9 min read

Content

  • Blog
  • Topic Pillars
  • Learning Paths
  • Games
  • Demos

Resources

  • Tools
  • Glossary
  • Cheatsheets
  • Comparisons
  • LLM Prices
  • Embedding Prices

About Me

  • About
  • Uses
  • Bookshelf
  • Reading List

Meta

  • Subscribe
  • Changelog
  • Sitemap
  • Privacy
  • Terms
  • RSS
KG

Building intelligent systems. Still chasing those sour icecreams.

Made with coffee and curiosity in Toronto. 2026.