SOURCE-LINKED INTELLIGENCE

Qiushi Engine on AstaBench E2E-Bench-Hard

arXiv · AI, language, vision and robotics · article · Sep 8, 2026 · UTC

This report analyzes Qiushi Engine v0.8 across all 40 test tasks in AstaBench E2E-Bench-Hard, a benchmark that requires autonomous agents to carry a research question through experimental design, code implementation, actual execution, result analysis, and report delivery. Qiushi Engine is model-configurable; this evaluation selected DeepSeek deepseek-v4pro-preview as the model backend. The official AstaBench leaderboard records a score of 0.816 and an average benchmark cost of USD 15.209 per task, while the full-precision local recomputation is $81.59 \pm 1.87$. Four tasks satisfied every rubr

Read original source ↗ Open in workspace

recordType

paper

region

Global