SOURCE-LINKED INTELLIGENCE

Stochastic Estimation of Transduced Language Models

arXiv · AI, language, vision and robotics · article · Aug 27, 2026 · UTC

Transduced language models (TLMs) compose a pretrained \emph{source} language model with a functional finite-state transducer to induce a language model over \emph{target} strings. Computing the probability of a target prefix under a TLM amounts to summing the source-model probabilities of all source strings that the transducer maps to target strings beginning with that prefix. This set can be exponentially large or infinite. Prior work uses a computational shortcut based on source prefix probabilities, then approximates the resulting sum with threshold-pruned beam summing. This produces a low

Read original source ↗ Open in workspace

recordType

paper

region

Global