SOURCE-LINKED INTELLIGENCE

Technical Manual for a Toolkit for Measuring Contextual Individuation in Transformer Language Models

arXiv · AI, language, vision and robotics · article · Sep 4, 2026 · UTC

A transformer language model assigns a single, context-independent vector to a word type at its embedding layer, yet is widely believed to individuate that word's occurrences by context in its later layers. Testing this belief cleanly requires a construct that holds the word form fixed while its context and intended sense vary in a controlled, labeled way. This manual documents an open toolkit built around such a construct, which we call a bridge form: a single written word that recurs, unchanged, across two or more subject domains with a different sense in each. We describe, and justify, ever

Read original source ↗ Open in workspace

recordType

paper

region

Global