learning-it by example

Back to the video

Red-Team Your AI Agent With a Checklist

Four of six test attacks worked on my demo agent; two were plain delete and send requests.

Video #102 ยท AI security and governance

Steps in the video

  1. 0:00 Four of six attacks worked, and two of them were just polite requests
  2. 0:30 The idea
  3. 1:05 Setup
  4. 1:27 Notes and a vault
  5. 1:50 Guards in code
  6. 2:16 The checklist
  7. 3:12 What this does not show
  8. 3:37 Mistakes to avoid
  9. 4:04 My take and next steps
  10. 4:30 Recap

Files

  • agent.py (64 lines)
  • compare.py (29 lines)
  • shelf.py (15 lines)

Download the code (zip)

Tested with

Python 3.12.15 | ollama==0.6.3

What this does not show

Six attacks I chose, one local model (llama3.2), one seed and one run each, on made-up notes in a temporary folder; says nothing about attacks that are not on the list.

Sources

Learning IT by Example.