SOURCE-LINKED INTELLIGENCE

Long-Context Demonstration Selection Using State Space Models

arXiv · AI, language, vision and robotics · article · Sep 15, 2026 · UTC

We study the problem of demonstration selection, which involves selecting a subset of examples for prepending to a query to a language model. This problem is closely related to in-context learning and language model inference. Since the inference cost of a transformer model scales quadratically with sequence length, the selection problem becomes especially challenging in a long-context scenario. In this paper, we tackle this problem by building on state space models (SSMs), which require only linear inference time given the input. Our approach involves two algorithms. The first learns a small

Read original source ↗ Open in workspace

recordType

paper

region

Global