SOURCE-LINKED INTELLIGENCE

AgentWorld: Personality-Aware Reliability Evaluation for Agentic Information Retrieval

arXiv · AI, language, vision and robotics · article · Aug 25, 2026 · UTC

Evaluation of agentic information retrieval remains limited to scripted interactions with uniform users, missing both natural personality diversity and adversarial brittleness. We present AgentWorld, a simulation framework combining (i)Big Five (OCEAN) personality-driven user populations with stateful tool-use environments; (ii)the pass$^k$ consistency metric with structured fault classification, partial-credit scoring, and dual-control handoff verification; (iii)score-thresholded training-data export in six fine-tuning formats; and (iv)an adversarial Risk Analyser that snapshots required-inte

Read original source ↗ Open in workspace

recordType

paper

region

Global