SOURCE-LINKED INTELLIGENCE

Can LLM Agents Discover? Evaluating Creativity on ML Engineering Tasks

arXiv · AI, language, vision and robotics · article · Aug 30, 2026 · UTC

Recent AI systems promise autonomous scientific discovery, claiming to discover algorithms and produce research papers, yet understanding whether they exhibit creativity, the capacity to produce solutions that are both novel and useful, remains an open question. We present a framework for evaluating multi-turn LLM research agents' creativity using ML engineering tasks as a testbed, through three dimensions: P-Creativity (psychological novelty: novel relative to the agent's own prior solutions within a run), H-Creativity (historical novelty: novel relative to the corpus of human solutions), and

Read original source ↗ Open in workspace

recordType

paper

region

Global