SOURCE-LINKED INTELLIGENCE

Measuring the Creativity of Frontier LLMs in Automated Research

arXiv · AI, language, vision and robotics · article · Sep 12, 2026 · UTC

Frontier LLMs are increasingly capable of conducting automated research, yet their creativity in this setting has not been systematically evaluated. In this paper, we propose a set of metrics to evaluate creativity along the two dimensions of valueness and novelty. Valueness assesses whether each proposed idea is useful, while novelty is evaluated from three perspectives: whether the same idea has appeared before (Exact-Match P-Novelty), whether a previously unexplored variable or variable combination is explored (Variable-level P-Novelty), and whether the idea directly follows retrieved exter

Read original source ↗ Open in workspace

recordType

paper

region

Global