SOURCE-LINKED INTELLIGENCE

Selection Is Retrieval, Abstention Is Not: On-Device Tool Routing over 70 Korean-English Actions

arXiv · AI, language, vision and robotics · article · Sep 16, 2026 · UTC

An AI assistant that calls tools makes two decisions on every request: which tool to invoke, and whether any available tool applies. In the usual design a single language model makes both, by emitting a call or by declining to emit one. On a device that has to answer without a server, the language model is what makes that design expensive, dominating both the latency and the memory of the router. The common alternative is to remove the model completely and rank the catalog of local actions with a retriever instead. That substitution is not symmetric across the two decisions. A retriever return

Read original source ↗ Open in workspace

recordType

paper

region

Global