SOURCE-LINKED INTELLIGENCE

AcCoRD: Evaluating User-Agent Collaboration Under Realistic User Preference Dynamics

arXiv · AI, language, vision and robotics · article · Aug 28, 2026 · UTC

User preferences in user-agent collaboration are rarely static and fully-specified upfront: preferences are formed, revealed, adjusted, and relaxed during interaction. Existing benchmarks for evaluating user-agent collaboration focus almost exclusively on resolving underspecified preferences, thereby failing to capture the richer dynamics of real-world interaction. We introduce AcCoRD, a user-agent collaboration benchmark requiring agents to handle diverse user preference dynamics in two domains: online shopping and travel planning. We evaluate five frontier LLMs under two prompting strategies

Read original source ↗ Open in workspace

recordType

paper

region

Global