SOURCE-LINKED INTELLIGENCE

A Layered Analysis of Disagreement And Answer Quality in Multi-Agent LLM Debate

arXiv · AI, language, vision and robotics · article · Sep 7, 2026 · UTC

Multi-agent debate, in which several LLMs exchange arguments before answering, is widely assumed to improve answer quality by surfacing genuine disagreement. That mechanism is rarely checked. We introduce four measurements: (A) the agreement a debater reports; (B) whether its reply text actually pushes back; (C) whether the position persists once the eliciting instruction is removed; and (D) for open-weight models, the stance response in the debater's own token log-probabilities. We evaluate three-model committees debating open-ended GlobalOpinionQA across 750 debates under three tones: friend

Read original source ↗ Open in workspace

recordType

paper

region

Global