AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Deep and shallow biases in language models

arXiv · AI, language, vision and robotics · article · Sep 9, 2026 · UTC

Large language models often repeatedly select the same answer even when many alternatives are plausible. Prior work treats this concentration as bias, but it does not distinguish stable model preferences from responses that depend on a particular prompt wording. We introduce a bias depth score that measures both how strongly a model prefers its top answer under direct prompting and whether that answer survives scenario reframing. Across 4,442 opinion prompts and four large language models, only about a quarter of the concentrated preferences survive reframing. We call these persistent cases De

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-09-20T19:32:24.350Z. This is not the publication date.