SOURCE-LINKED INTELLIGENCE

Evaluating Communicative Success in Machine-Translated Conversation

arXiv · AI, language, vision and robotics · article · Sep 17, 2026 · UTC

Interpreter agents built on machine translation (MT) increasingly mediate live conversation between people who do not share a language, yet we still evaluate them with metrics built for isolated sentences, which measure fidelity rather than whether communication succeeds. We introduce a reusable three-layer checklist-and-judge framework that evaluates interpreter-mediated conversation across semantic, pragmatic, and cultural-social dimensions, covering the naturalness, intent, and social appropriateness that fidelity metrics leave unmeasured. It runs in both single-turn and interactive multi-t

Read original source ↗ Open in workspace

recordType

paper

region

Global