SOURCE-LINKED INTELLIGENCE

CoArena: Evaluating Computer-Use and Multi-Agent Systems in Real Time

arXiv · AI, language, vision and robotics · article · Sep 13, 2026 · UTC

Static benchmarks for computer-use agents fix a task set at release and score every system against it once. That makes them reproducible, and it lets them drift from what they should measure: a fixed task set ages, leaks into training corpora, and cannot follow how people actually use agents from week to week. CoArena measures use directly. Real users submit tasks; two systems, each a single model or a multi-agent pipeline behind the same tool interface, execute the same task concurrently in identical sandboxed desktops; users judge the two outcomes without knowing which system produced them;

Read original source ↗ Open in workspace

recordType

paper

region

Global