SOURCE-LINKED INTELLIGENCE

Probabilistic Model Checking of Autoregressive Neural Sequence Models

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Test-set accuracy is silent on two issues that matter when deploying autoregressive neural sequence models: how much probability mass the system under test (SUT) places on constraint-violating alternatives that are reachable under sampling and what fraction of the input population satisfies a domain requirement. We answer both with probabilistic model checking. The pipeline extracts a discrete-time Markov chain (DTMC) from the SUT's token-by-token generation, verifies formal PCTL specifications with the PRISM model checker, and aggregates the per-input verdicts into a coverage curve over the i

Read original source ↗ Open in workspace

recordType

paper

region

Global