SOURCE-LINKED INTELLIGENCE

Visual Token Coding for Video Multimodal Large Language Models

arXiv · AI, language, vision and robotics · article · Aug 28, 2026 · UTC

In this paper, we propose a new token compression paradigm for video Multimodal Large Language Models (MLLMs), termed Visual Token Coding (VTC). Inspired by classical video coding principles, e.g., HEVC, VTC performs structured compression by predicting the I/P frames of a video and measuring their frame-wise residuals to estimate token redundancy. Based on this baseline framework, we also enhance VTC with a set of novel dynamic designs, such as Dynamic Resolution Input (DyRSO), Dynamic Token Allocation (DyTA), and Spatial Coverage Top-K (SC-TopK), and term this new approach $VTC_{Dy}$. To val

Read original source ↗ Open in workspace

recordType

paper

region

Global