learning-it by example

Back to the video

Multi-Agent Debate: Do Two Agents Beat One? A Test

Two agents argued, and did no better than a plain vote, for more calls.

Video #36 ยท AI agents and MCP

Steps in the video

  1. 0:00 Two agents argued, and they did no better than a vote
  2. 0:25 The idea
  3. 0:59 Setup
  4. 1:31 Six tricky questions
  5. 1:59 Three ways to ask
  6. 2:27 Count right answers and calls
  7. 3:13 What this does not show
  8. 3:54 Mistakes to avoid
  9. 4:16 My take and next steps
  10. 4:44 Recap

Files

  • agents.py (40 lines)
  • compare.py (12 lines)
  • questions.py (12 lines)

Download the code (zip)

Tested with

Python 3.12.15 | ollama==0.6.3

What this does not show

Six questions, one small model (llama3.2), one fixed set of seeds; a difference of one question proves nothing about debate against a vote. Replies are capped at 90 tokens, and a reply with no final number counts as wrong. Only the call counts are firm.

Sources

Learning IT by Example.