SOURCE-LINKED INTELLIGENCE

Social Intuition vs. Machine Reasoning: Anticipating Human-Robot Interaction from multiple modalities

arXiv · AI, language, vision and robotics · article · Sep 7, 2026 · UTC

Anticipating whether a person will interact from one's own perspective is a highly intuitive task for humans, that relies on a combination of cues. We investigate how humans perform at predicting a person's intention to interact from a service robot's point of view, using pose-only or full video input, then benchmark different lightweight pose-based models and state-of-the-art vision-language models. We conducted our benchmark on the HUI360 dataset on a fixed pilot subset of 100 test tracks (25 positive, 75 negative). We found that with pose-only input, human annotators outperform lightweight

Read original source ↗ Open in workspace

recordType

paper

region

Global