SOURCE-LINKED INTELLIGENCE

SeRV: Semantic-Aligned Residual Vector Quantization for American Sign Language Generation

arXiv · AI, language, vision and robotics · article · Sep 4, 2026 · UTC

American Sign Language (ASL) generation remains challenging due to limited paired text-ASL motion data and the difficulty of learning motion representations both precise for reconstruction and predictable from linguistic input. Existing methods rely on motion tokenizers optimized for reconstruction, without explicit semantic supervision from paired text. As a result, the learned tokens remain limited in supporting semantically consistent and fine-grained ASL motion generation. To address this limitation, we propose SeRV (Semantic-Aligned Residual Vector Quantization), a semantic-aligned RVQ to

Read original source ↗ Open in workspace

recordType

paper

region

Global