AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Audio-Visual Turn-taking Prediction in Cocktail Party Scenarios

arXiv · AI, language, vision and robotics · article · Sep 15, 2026 · UTC

Current predictive turn-taking models (PTTMs) achieve strong performance on benchmarks with controlled acoustic conditions and clean audio signals. Their generalisation to conversations with overlapping speech and background interference remains underexplored. In this research, we evaluate audio-visual PTTMs trained with clean data on a challenging cocktail-party testbed derived from the AVCocktail dataset, and analyse their adaptation behaviour to this new domain. Experimental results show consistent performance degradation across audio and visual modalities under noisy conditions, with up to

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-09-20T08:40:59.508Z. This is not the publication date.