SOURCE-LINKED INTELLIGENCE

ViBe: Visual Behavior Adaptation for Perceptive Humanoid Whole-Body Control

arXiv · AI, language, vision and robotics · article · Sep 9, 2026 · UTC

Motion tracking provides a scalable recipe for humanoid whole-body control. By design, the resulting trackers lack exteroceptive feedback hence reacting to the environment remains the responsibility of a higher-level planner. Existing perceptive controllers train geometry-only encoders from scratch, trading semantics for sim-to-real ease, and typically rely on teacher-student distillation for a task of interest. We present ViBe, a post-training framework for adapting motion trackers to perceptive control tasks. We leverage pre-trained visual encoders with a multi-query extractor module to lear

Read original source ↗ Open in workspace

recordType

paper

region

Global