SOURCE-LINKED INTELLIGENCE

Investigating Assistant Bias in LLM User Simulators Using a Role Vector

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

LLM-based user simulators are increasingly used to evaluate autonomous agents at scale, in place of costly human evaluations. Despite this promise, these simulators exhibit "assistant bias," a tendency to cooperate and pursue task goals. They rarely reproduce the frustration or disengagement that real users exhibit, compromising evaluation validity. Prior work outlines that this bias is baked in during model training, which role-playing prompts fail to override. We analyze this bias from model activations, extracting a user role vector by contrasting how the model represents user versus assist

Read original source ↗ Open in workspace

recordType

paper

region

Global