SOURCE-LINKED INTELLIGENCE

Dense to MoE Adaptation for Compact Vision Language Action Policies

arXiv · AI, language, vision and robotics · article · Sep 15, 2026 · UTC

Vision language action (VLA) policies continue to grow in parameter count, making deployment on resource-constrained robot platforms difficult. The central goal is to reduce the number of LLM-side parameters retained in the deployed policy while preserving downstream task performance. Our approach, AdaDE, adapts selected dense feed forward blocks into mixture of experts (MoE) layers and derives expert retention masks from router statistics during fine tuning. The Dense2MoE conversion preserves the original dense FFN function at initialization, so expert deactivation can start without a separat

Read original source ↗ Open in workspace

recordType

paper

region

Global