SOURCE-LINKED INTELLIGENCE

Prefix Sliding for efficient test-time scaling

arXiv · AI, language, vision and robotics · article · Aug 26, 2026 · UTC

Test-time scaling uses extra test-time compute to improve performance, such as letting language models reason longer when solving a problem. As models keep the entire reasoning trace in memory via full attention, hard tasks that need long thinking can be prohibitively expensive. However, we find most intermediate reasoning tokens lose importance as the model continues reasoning. This calls into question whether retaining them is worth the cost. Based on this insight, we propose Prefix Sliding, which discards tokens during reasoning that are not part of the prefix or the window of the last few

Read original source ↗ Open in workspace

recordType

paper

region

Global