SOURCE-LINKED INTELLIGENCE

Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Monocular videos record 3D scenes as sequences of 2D image-plane projections, obscuring depth and spatial relationships. Multi-object trackers localize and associate objects primarily using appearance and geometry observed only in the image plane, inheriting these ambiguities. To address this limitation, we introduce PLANET, an end-to-end multi-object tracker designed to move beyond the image plane. As an enabling step, we lift existing 2D tracking datasets into 3D. We then form world-grounded queries by embedding reconstructed 3D scene geometry into the features and positional encodings used

Read original source ↗ Open in workspace

recordType

paper

region

Global