SOURCE-LINKED INTELLIGENCE

GEOSTEER: Geodesic Optimization for Activation Steering in Large Language Models

arXiv · AI, language, vision and robotics · article · Sep 9, 2026 · UTC

Activation steering provides a lightweight way to control large language models (LLMs) by modifying their hidden activations at inference time. Among these approaches, norm-preserving steering aims to change model behavior without altering the activation norm, reducing the risk of representation collapse and degradation. However, existing norm-preserving methods are limited by predefined steering trajectories and by their reliance on one-step updates, which may fail to capture the complex structure of activation distributions. We propose GeoSteer, an optimization-based method for norm-preservi

Read original source ↗ Open in workspace

recordType

paper

region

Global