SOURCE-LINKED INTELLIGENCE

FramingQA: Does the Question Shape the Answer? Measuring the Compositional Framing Effect

arXiv · AI, language, vision and robotics · article · Sep 7, 2026 · UTC

We introduce FramingQA, a benchmark that measures the model sensitivity to question framing across law, medicine, finance, and robotic simulations. Large language models (LLMs) often change their responses to subtle rephrasings that align with an implied stance by users. This can leave users with advice tainted by how they happened to phrase a question rather than by the underlying facts, and the consequences are highly costly in high-stakes domains. Because in the realistic scenarios, both expert practitioners and non-expert users frequently ask LLMs questions containing incomplete or mislead

Read original source ↗ Open in workspace

recordType

paper

region

Global