English
Related papers

Related papers: RepIt: Steering Language Models with Concept-Speci…

200 papers

Safety alignment approaches in large language models (LLMs) often lead to the over-refusal of benign queries, significantly diminishing their utility in sensitive scenarios. To address this challenge, we introduce FalseReject, a…

Computation and Language · Computer Science 2025-07-16 Zhehao Zhang , Weijie Xu , Fanyou Wu , Chandan K. Reddy

Steering or intervening on model representations at inference time to correct predictions is essential for AI interpretability and safety, yet existing evaluation protocols are limited to ambiguous language modeling tasks. To address this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Vladimir Zaigrajew , Dawid Pludowski , Hubert Baniecki , Przemyslaw Biecek

As large language models (LLMs) become widely deployed, concerns about their safety and alignment grow. An approach to steer LLM behavior, such as mitigating biases or defending against jailbreaks, is to identify which parts of a prompt…

Computation and Language · Computer Science 2025-05-20 Kenza Amara , Rita Sevastjanova , Mennatallah El-Assady

This paper investigates how Large Language Models (LLMs) represent non-English tokens -- a question that remains underexplored despite recent progress. We propose a lightweight intervention method using representation steering, where a…

Computation and Language · Computer Science 2025-08-27 Omar Mahmoud , Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana

Multimodal adaptation equips large language models (LLMs) with perceptual capabilities, but often weakens the reasoning ability inherited from language-only pretraining. This trade-off is especially pronounced in video-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zihang Fu , Haonan Wang , Jian Kang , Kenji Kawaguchi , Jiaying Wu

Recent work has shown that LLMs can sometimes detect when steering vectors are injected into their residual stream and identify the injected concept -- a phenomenon termed "introspective awareness." We investigate the mechanisms underlying…

Machine Learning · Computer Science 2026-05-18 Uzay Macar , Li Yang , Atticus Wang , Peter Wallich , Emmanuel Ameisen , Jack Lindsey

Despite their capabilities, large foundation models (LFMs) remain susceptible to adversarial manipulation. Current defenses predominantly rely on the "locality hypothesis", suppressing isolated neurons or features. However, harmful…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Chuancheng Shi , Shangze Li , Wenjun Lu , Wenhua Wu , Cong Wang , Zifeng Cheng , Fei Shen , Tat-Seng Chua

While Large Language Models (LLMs) demonstrate remarkable capabilities, they remain susceptible to sophisticated, multi-step jailbreak attacks that circumvent conventional surface-level safety alignment by exploiting the internal generation…

Machine Learning · Computer Science 2026-05-21 Jiachen Ma , Jiawen Zhang , Xiangtian Li , Bo Zou , Chaochao Lu , Chao Yang

This study reveals a previously unexplored vulnerability in the safety alignment of Large Language Models (LLMs). Existing aligned LLMs predominantly respond to unsafe queries with refusals, which often begin with a fixed set of prefixes…

Cryptography and Security · Computer Science 2026-01-28 Yangyang Guo , Ziwei Xu , Si Liu , Zhiming Zheng , Mohan Kankanhalli

Knowledge Tracing (KT) models students' evolving knowledge states to predict future performance, serving as a foundation for personalized education. While traditional deep learning models achieve high accuracy, they often lack…

Computation and Language · Computer Science 2026-03-25 Runze Li , Kedi Chen , Guwei Feng , Mo Yu , Jun Wang , Wei Zhang

Pre-trained Language Models (PLMs) have achieved great success on Machine Reading Comprehension (MRC) over the past few years. Although the general language representation learned from large-scale corpora does benefit MRC, the poor support…

Computation and Language · Computer Science 2021-05-19 Fangkai Jiao , Yangyang Guo , Yilin Niu , Feng Ji , Feng-Lin Li , Liqiang Nie

Large language models (LLMs) are increasingly embedded in adolescent digital environments, mediating information seeking, advice, and emotionally sensitive interactions. Yet existing safety mechanisms remain largely grounded in…

Computation and Language · Computer Science 2026-05-22 Heajun An , Qi Zhang , Vedanth Achanta , Jin-Hee Cho

Large Language Models (LLMs) are vulnerable to jailbreak attacks that exploit weaknesses in traditional safety alignment, which often relies on rigid refusal heuristics or representation engineering to block harmful outputs. While they are…

Computation and Language · Computer Science 2025-10-01 Yuyou Zhang , Miao Li , William Han , Yihang Yao , Zhepeng Cen , Ding Zhao

As robotic technology rapidly develops, robots are being employed in an increasing number of fields. However, due to the complexity of deployment environments or the prevalence of ambiguous-condition objects, the practical application of…

Robotics · Computer Science 2025-03-11 Zhen Luo , Yixuan Yang , Yanfu Zhang , Feng Zheng

Large language models have transformed AI, yet reliably controlling their outputs remains a challenge. This paper explores activation engineering, where outputs of pre-trained LLMs are controlled by manipulating their activations at…

Neural and Evolutionary Computing · Computer Science 2025-05-13 Joris Postmus , Steven Abreu

Large Language Models (LLMs) trained for average correctness often exhibit mode collapse, producing narrow decision behaviors on tasks where multiple responses may be reasonable. This limitation is particularly problematic in ordinal…

Artificial Intelligence · Computer Science 2026-02-04 Eric Yang , Jong Ha Lee , Jonathan Amar , Elissa Ye , Yugang Jia

Steering has emerged as a promising approach in controlling large language models (LLMs) without modifying model parameters. However, most existing steering methods rely on large-scale datasets to learn clear behavioral information, which…

Machine Learning · Computer Science 2025-10-06 Anyi Wang , Xuansheng Wu , Dong Shu , Yunpu Ma , Ninghao Liu

Despite careful safety alignment, current large language models (LLMs) remain vulnerable to various attacks. To further unveil the safety risks of LLMs, we introduce a Safety Concept Activation Vector (SCAV) framework, which effectively…

Computation and Language · Computer Science 2024-12-03 Zhihao Xu , Ruixuan Huang , Changyu Chen , Xiting Wang

Large Language Models (LLMs) are powerful tools with profound societal impacts, yet their ability to generate responses to diverse and uncontrolled inputs leaves them vulnerable to adversarial attacks. While existing defenses often struggle…

Computation and Language · Computer Science 2025-12-30 Samuel Simko , Mrinmaya Sachan , Bernhard Schölkopf , Zhijing Jin

Uncontrollable autonomous replication of language model agents poses a critical safety risk. To better understand this risk, we introduce RepliBench, a suite of evaluations designed to measure autonomous replication capabilities. RepliBench…