SOURCE-LINKED INTELLIGENCE

Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervision

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

We introduce S$^3$T (Self-Supervised Self-Distillation over Time), which, to the best of our knowledge, is the first fully self-contained framework for continuous video state tracking. Our method treats temporal sampling density as privileged information, based on the hypothesis that a denser view of the same clip recovers the running state more accurately. This view serves as the teacher, while a sparse-view student with the same weights learns to match its next-token distribution. The model generates its own target, so training requires no labels, separate teacher, or reward signal, and adds

Read original source ↗ Open in workspace

recordType

paper

region

Global