Agent Gateway: One Front Door for Models, Tools, Agents
I sent eight requests through one gateway, and five were stopped at the door.
Video #230 ยท Enterprise architecture and AI agents
Steps in the video
Files
- compare.py (31 lines)
- gateway.py (41 lines)
- upstreams.py (32 lines)
Tested with
Python 3.12.15 | fastapi==0.161.1, starlette==1.9.0, httpx==0.28.1
What this does not show
Two made-up callers with keys in a dictionary, and services called in the same process. Only the prompt field is size-checked, a body that is not a JSON object fails with no audit line, and the audit records the gateway's verdict, not the reply.
Sources
Learning IT by Example.