SOURCE-LINKED INTELLIGENCE

Improving Term Evaluation in Machine Translation: Variation Matters

arXiv · AI, language, vision and robotics · article · Sep 8, 2026 · UTC

Terminology evaluation in machine translation (MT) usually assumes a single correct target form per source term. However, human translators routinely introduce variation that current metrics penalize as inconsistency. We examine how to account for this variation in document-level MT evaluation of English-French scientific translation, combining glossary-based accuracy, translation consistency, and a new cross-term variation (CTV) diagnostic measure that tests whether variation relationships are preserved across languages. Based on analyses of two parallel corpora, translated by four MT systems

Read original source ↗ Open in workspace

recordType

paper

region

Global