SOURCE-LINKED INTELLIGENCE

Occlusion-Robust Multimodal Emotion Recognition in VR via Fusion of Facial Images and EMG

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

Head-mounted displays (HMDs) fundamentally limit emotion recognition in virtual reality (VR): by occluding the upper face, they render conventional image-based facial expression analysis incomplete, particularly for applications requiring real-time affective assessment. We address this challenge by fusing lower-face video with facial electromyography (EMG) from the occluded upper face to classify seven emotional categories (six basic emotions plus neutral). We introduce a synchronized multimodal dataset from 20 participants, pairing lower-face video with seven-channel upper-face EMG elicited b

Read original source ↗ Open in workspace

recordType

paper

region

Global