Reliability Patterns for AI Agents: Bulkhead, Retry, Cache
In a simulation, one busy agent left the support agent with one call served out of twenty.
Video #243 ยท Enterprise architecture and AI agents
Steps in the video
Files
- compare.py (45 lines)
- patterns.py (55 lines)
Tested with
Python 3.12.15
What this does not show
Simulated faults on a counted clock with settings I chose; in the shared pool the reporting agent always asks first; the retry has no delay or backoff; the breaker has no half-open state and its pause is counted in calls; the cache counts requests, not time.
Sources
Learning IT by Example.