SOURCE-LINKED INTELLIGENCE

SPT: Skills as Pre-Training Data for Agentic Language Models

arXiv · AI, language, vision and robotics · article · Aug 27, 2026 · UTC

Agentic (tool-using) language models are mainly trained on tool-call traces and agent trajectories during post-training. These data provide direct behavioral supervision, but producing them requires task environments, execution, and verification, making broad tool and task coverage expensive. Publicly available skills offer another source of training data: they encode reusable tool semantics and workflows but are typically used only as inference-time context. We introduce Skill Pre-Training (SPT), a mid-training method that applies causal language modeling to SkillCorpus, a collection of publi

Read original source ↗ Open in workspace

recordType

paper

region

Global