English

EasySteer: A Unified Framework for High-Performance and Extensible LLM Steering

Computation and Language 2026-03-03 v2 Artificial Intelligence

Abstract

Large language model (LLM) steering has emerged as a promising paradigm for controlling model behavior at inference time through targeted manipulation of hidden states, offering a lightweight alternative to expensive retraining. However, existing steering frameworks suffer from critical limitations: computational inefficiency, limited extensibility, and restricted functionality that hinder both research progress and practical deployment. We present EasySteer, a unified framework for high-performance, extensible LLM steering built on vLLM. Our system features modular architecture with pluggable interfaces for both analysis-based and learning-based methods, fine-grained parameter control, pre-computed steering vectors for eight application domains, and an interactive demonstration system. Through deep integration with vLLM's optimized inference engine, EasySteer achieves 10.8-22.3×\times speedup over existing frameworks. Extensive experiments demonstrate its effectiveness in overthinking mitigation, hallucination reduction, and other key applications. EasySteer transforms steering from research technique to production-ready capability, establishing critical infrastructure for deployable, controllable language models.

Keywords

Cite

@article{arxiv.2509.25175,
  title  = {EasySteer: A Unified Framework for High-Performance and Extensible LLM Steering},
  author = {Haolei Xu and Xinyu Mei and Yuchen Yan and Rui Zhou and Wenqi Zhang and Weiming Lu and Yueting Zhuang and Yongliang Shen},
  journal= {arXiv preprint arXiv:2509.25175},
  year   = {2026}
}

Comments

Functionality upgrade. Code: https://github.com/ZJU-REAL/EasySteer Demo: https://www.youtube.com/watch?v=3rRGzZmhrXg

R2 v1 2026-07-01T06:05:27.293Z