SOURCE-LINKED INTELLIGENCE

A.X K2 Technical Report

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

We introduce A.X K2, a 688B-parameter Mixture-of-Experts (MoE) language model trained from scratch as a high-performance foundation for \emph{agentic} applications. Trained on approximately 8.5T tokens---fewer than its predecessor, A.X K1---on a smaller but higher-quality mixture with substantially expanded agentic and software-engineering data, it nonetheless improves over A.X K1 across the board, by over 30 percentage points on some benchmarks, reflecting large gains in token efficiency. To support long contexts efficiently, we introduce Sparse Gated Attention (SGA), which combines sparse at

Read original source ↗ Open in workspace

recordType

paper

region

Global