SOURCE-LINKED INTELLIGENCE

Investigating Temporal Motion Features for Pose-to-Text Indian Sign Language Translation

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

We investigate the effect of pretrained T5 model scale and explicit motion features on pose-to-text Indian Sign Language Translation (SLT) for the WSLP 2026 Shared Task. Pose sequences are projected into the embedding space of T5 through a lightweight pose encoder, with the complete model fine-tuned to generate English text. The shared task data used for this work consists of a test set with 5,334 examples and a validation set with 5,257 examples. We compare T5-small, T5-base, and T5-large, and additionally introduce a motion-augmented variant, T5-small + Motion, that adds explicit frame-to-fr

Read original source ↗ Open in workspace

recordType

paper

region

Global