learning-it by example

Back to the video

SLOs and Error Budgets for an AI Feature, Explained

Both promises were kept. One afternoon burned the budget at 57 times the allowed rate.

Video #322 ยท Forward deployed engineer interviews

Steps in the video

  1. 0:00 One bad afternoon burned the budget at 57 times the allowed rate
  2. 0:36 The idea
  3. 1:14 Setup
  4. 1:45 A month of traffic
  5. 2:06 Budget and burn rate
  6. 2:34 Ask three questions
  7. 3:25 What this does not show
  8. 4:06 Mistakes to avoid
  9. 4:33 My take and next steps
  10. 5:02 Recap

Files

  • run.py (21 lines)
  • slo.py (20 lines)
  • traffic.py (20 lines)

Download the code (zip)

Tested with

Python 3.12.15

What this does not show

Made-up traffic with one clean three-hour outage; a single window, not the multi-window alerting real systems use; the quality check is only a label.

Sources

Learning IT by Example.