SOURCE-LINKED INTELLIGENCE

MUDDLE: Measuring Understanding of Documents under Distractor and Length Effects

arXiv · AI, language, vision and robotics · article · Aug 30, 2026 · UTC

Document question-answering systems increasingly answer questions over collections of retrieved documents rather than one clean source, so robustness to distracting context matters as much as reading ability. When such systems fail, it is often unclear whether the context was too long or the distractors were too close to the topic, because prior work tends to conflate these two effects. We present MUDDLE, a controlled benchmark that separates them. MUDDLE uses 270 human-annotated questions, each tied to a single source document, and instantiates every question in five conditions: the source al

Read original source ↗ Open in workspace

recordType

paper

region

Global