SOURCE-LINKED INTELLIGENCE

Measuring LLM Sycophancy under Sustained Multi-Turn Pressure

arXiv · AI, language, vision and robotics · article · Sep 8, 2026 · UTC

Large language models (LLMs) may abandon correct positions when users push back, exhibiting a failure mode known as sycophancy. Existing evaluations typically use short, pre-specified conversations and may therefore miss failures that emerge under sustained, adaptive disagreement. We introduce SPINE, a benchmark in which an LLM proxy plays a persistent but mistaken user and adaptively challenges a target model for up to 25 turns. We evaluate four production systems and three Olmo3-7b variants on 100 false-presupposition and 100 unethical-query items. Our experimental results show that collapse

Read original source ↗ Open in workspace

recordType

paper

region

Global