SOURCE-LINKED INTELLIGENCE

PROVIA: Procedure State Tracking for Online Mistake Detection in Egocentric Videos

arXiv · AI, language, vision and robotics · article · Sep 17, 2026 · UTC

An assistant watching egocentric video should notice a mistake from past frames alone, before the next step begins, and keep working once the person recovers. A mistake changes the state of the work, so every later step has to be read against what was done rather than against the plan. The first-mistake protocol that current online methods report on cuts each recording at its first mistake, so a fixed-time rule that never looks at the video is right on every case. We evaluate on complete trials, where mistakes and recoveries arise naturally, under a validation false-alarm budget and against co

Read original source ↗ Open in workspace

recordType

paper

region

Global