AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Where the Verifier Fails: A Category-Level Audit of Reward Signals in RLVR

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Reinforcement learning with verifiable rewards (RLVR) and standard benchmark evaluation both rely on an automatic verifier that turns a free text answer into a binary reward. Prior work reports that one evaluation harness accepts only about 94% of its own ground truth answers, blaming LaTeX parsing. That is an aggregate: it does not say which answer forms consume the error budget. We supply the decomposition. We apply metamorphic testing to the verifier rather than the model, generating certified equivalent answer variants, that is, rewrites that preserve mathematical meaning by construction,

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-09-21T06:01:56.170Z. This is not the publication date.