Indirect Prompt Injection: A Note That Gave Orders
A sentence I planted in a made-up note told my assistant what to say, and it said it.
Video #88 ยท AI security and governance
Steps in the video
Files
- assist.py (28 lines)
- compare.py (21 lines)
- notes.py (18 lines)
Tested with
Python 3.12.15 | ollama==0.6.3
What this does not show
Six attacks I wrote, one question, one seed and one small local model (llama3.2); a reply counts as obeyed if it contains a marker word and as answered if it contains the word Thursday; the assistant has no tools; none obeyed with the fence here does not make a fence safe.
Sources
Learning IT by Example.