SOURCE-LINKED INTELLIGENCE

Online Language Adaptive Sampling for Better Distributed Cross-lingual Gains

arXiv · AI, language, vision and robotics · article · Sep 14, 2026 · UTC

Realignment is a promising approach for improving the cross-lingual transfer ability of multilingual language models, particularly for extremely low-resource languages (LRLs). However, existing realignment methods rely on uniform and random sampling of parallel sentences across languages, which may be suboptimal under limited batch sizes. In practice, models may benefit from seeing certain languages more frequently, especially those that are poorly aligned, and the optimal distribution can evolve throughout training. In this work, we propose a simple yet effective adaptive sampling strategy th

Read original source ↗ Open in workspace

recordType

paper

region

Global