SOURCE-LINKED INTELLIGENCE

Beyond frequency measures: Can contextual embeddings capture meaning change in scientific texts?

arXiv · AI, language, vision and robotics · article · Sep 16, 2026 · UTC

Identifying technological trends is a core scientometric task, yet traditional frequency-based approaches struggle to capture substantial meaning shifts of domain-specific terms. We hypothesise that contextual embeddings can complement frequency dynamics to effectively track diachronic semantic change. We compare frequency and embedding-based approaches across Astrophysics and NLP corpora spanning from 2010 to 2024. Candidate terms are extracted using KeyBERT (utilizing SciBERT as its underlying language model) and filtered for significant frequency increases using Fisher's exact test. These t

Read original source ↗ Open in workspace

recordType

paper

region

Global