Reliability

6 posts tagged #reliability

6 posts on Reliability, spread across AI Agents (2), AI in Production (1), Dev Tools & AI Workflow (1) — most read: “Webhook Delivery Design: Retries, Ordering, Idempotency” and “Agent Tool Call Failure Testing: A Deterministic CI Harness”.

a laptop computer sitting on top of a desk Developer Tools

Webhook Delivery Design: Retries, Ordering, Idempotency

A practical 10M events/day webhook delivery architecture: partition keys, retry storm control, per-tenant isolation, idempotency storage, replay UX, and reliability SLOs.

a computer screen with a blue background AI and Machine Learning

Agent Tool Call Failure Testing: A Deterministic CI Harness

Build a deterministic CI harness that breaks your agent’s tools on purpose: timeouts, 429s, partial writes, retries, and stuck loops. Then regress it with golden traces.

a laptop computer sitting on top of a wooden desk Cloud and DevOps

ChatGPT Down? 8 Fallback Patterns for API Outages

When ChatGPT goes down, your app shouldn’t. A production playbook for detection, retries with jitter, circuit breakers, bulkheads, throttling, and multi-provider failover.

a computer screen with a bar chart on it AI and Machine Learning

AI Agent Evaluation Framework: 8 Metrics Beyond Task Success

If your agent eval is just “did it finish the task?”, you’re flying blind. Here’s a 2026-ready scorecard for tool correctness, recovery, safety, and cost-per-success—plus a regression suite blueprint you can actually run in CI.

black hp laptop computer turned on displaying desktop AI and Machine Learning

Agent Evaluation Harness: Replay, Rubrics, CI Gates

Most agent failures aren’t “bad prompts”. They’re multi-step tool cascades. Here’s how I build an agent evaluation harness that actually prevents regressions.

Hand drawing a diagram on a whiteboard. AI and Machine Learning

AI Agent Control Flow Patterns: Retries, HITL, Checkpoints

A practical catalog of ai agent control flow patterns that actually ship: bounded retries, idempotent tools, durable checkpoints, human approvals, and debuggable replays.

Keep exploring

Close to this topic, not on this page.