SOURCE-LINKED INTELLIGENCE

Benchmarking Language Models for Statistical Problem Formulation

arXiv · AI, language, vision and robotics · article · Sep 2, 2026 · UTC

Large language models (LLMs) are increasingly used as assistants for statistical and data science work, yet existing evaluations largely assume the analysis target is already specified. In practice, users arrive with informal goals and heterogeneous data, leaving the model to decide what statistical task is implied and which data are relevant. We first formalize this upstream step as Statistical Problem Formulation and decompose it into two subtasks: (1) Statistical Problem Classification and (2) Variable Identification & Role Assignment. We then introduce StatFormBench, a benchmark built from

Read original source ↗ Open in workspace

recordType

paper

region

Global