English
Related papers

Related papers: Activation Steering for Bias Mitigation: An Interp…

200 papers

Recent advances in large language models (LLMs) have intensified the need to understand and reliably curb their harmful behaviours. We introduce a multidimensional framework for probing and steering harmful content in model internals. For…

Artificial Intelligence · Computer Science 2025-07-30 McNair Shah , Saleena Angeline , Adhitya Rajendra Kumar , Naitik Chheda , Kevin Zhu , Vasu Sharma , Sean O'Brien , Will Cai

Can large language models introspect, that is, accurately detect perturbations to their own internal states? We systematically investigate this question using activation steering in Meta-Llama-3.1-8B-Instruct. First, we show that the binary…

Artificial Intelligence · Computer Science 2026-03-03 Ely Hahami , Ishaan Sinha , Lavik Jain , Josh Kaplan , Jon Hahami

Recently, researchers have made considerable improvements in dialogue systems with the progress of large language models (LLMs) such as ChatGPT and GPT-4. These LLM-based chatbots encode the potential biases while retaining disparities that…

Computation and Language · Computer Science 2023-10-18 Hsuan Su , Cheng-Chu Cheng , Hua Farn , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Large language models (LLMs) are increasingly deployed in high-stakes hiring applications, making decisions that directly impact people's careers and livelihoods. While prior studies suggest simple anti-bias prompts can eliminate…

Machine Learning · Computer Science 2025-06-13 Adam Karvonen , Samuel Marks

Detecting biases in the outputs produced by generative models is essential to reduce the potential risks associated with their application in critical settings. However, the majority of existing methodologies for identifying biases in…

Computation and Language · Computer Science 2025-02-04 Erica Coppolillo , Giuseppe Manco , Luca Maria Aiello

Large Language Models (LLMs) are reported to hold undesirable attestation bias on inference tasks: when asked to predict if a premise P entails a hypothesis H, instead of considering H's conditional truthfulness entailed by P, LLMs tend to…

Computation and Language · Computer Science 2024-08-27 Tianyang Liu , Tianyi Li , Liang Cheng , Mark Steedman

Model steering represents a powerful technique that dynamically aligns large language models (LLMs) with human preferences during inference. However, conventional model-steering methods rely heavily on externally annotated data, not only…

Computation and Language · Computer Science 2025-07-15 Rongyi Zhu , Yuhui Wang , Tanqiu Jiang , Jiacheng Liang , Ting Wang

Controlling multiple behavioral attributes in large language models (LLMs) at inference time is a challenging problem due to interference between attributes and the limitations of linear steering methods, which assume additive behavior in…

Machine Learning · Computer Science 2026-04-07 Narmeen Oozeer , Luke Marks , Shreyans Jain , Fazl Barez , Amirali Abdullah

Large language models (LLMs) are trained on extensive text corpora, which inevitably include biased information. Although techniques such as Affective Alignment can mitigate some negative impacts of these biases, existing prompt-based…

Computation and Language · Computer Science 2024-08-21 Yongxin Deng , Xihe Qiu , Xiaoyu Tan , Jing Pan , Chen Jue , Zhijun Fang , Yinghui Xu , Wei Chu , Yuan Qi

The growing use of generative models in daily life calls for efficient mechanisms to control their generation, to e.g., produce safe content or provide users with tools to explore style changes. Ideally, such mechanisms should require low…

Computation and Language · Computer Science 2025-10-20 Pau Rodriguez , Michal Klein , Eleonora Gualdoni , Valentino Maiorca , Arno Blaas , Luca Zappella , Marco Cuturi , Xavier Suau

Recent studies have indicated that Large Language Models (LLMs) harbor an inherent understanding of truthfulness, yet often fail to consistently express it and generate false statements. This gap between "knowing" and "telling" poses a…

Computation and Language · Computer Science 2025-02-27 Tianlong Wang , Xianfeng Jiao , Yinghao Zhu , Zhongzhi Chen , Yifan He , Xu Chu , Junyi Gao , Yasha Wang , Liantao Ma

Warning: This paper contains content that may be offensive or upsetting. There has been a significant increase in the usage of large language models (LLMs) in various applications, both in their original form and through fine-tuned…

Computation and Language · Computer Science 2023-12-12 Jiaxu Zhao , Meng Fang , Shirui Pan , Wenpeng Yin , Mykola Pechenizkiy

The rapid advancement of Vision-Language models (VLMs) has raised growing concerns that their black-box reasoning processes could lead to unintended forms of social bias. Current debiasing approaches focus on mitigating surface-level bias…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Na Min An , Yoonna Jang , Yusuke Hirota , Ryo Hachiuma , Isabelle Augenstein , Hyunjung Shim

Vision Language Models (VLMs) have demonstrated impressive capabilities in integrating visual and textual information for understanding and reasoning, but remain highly vulnerable to adversarial attacks. While activation steering has…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Sihao Wu , Gaojie Jin , Wei Huang , Jianhong Wang , Xiaowei Huang

As large language models (LLMs) improve in their capacity to serve as personal AI assistants, their ability to output uniquely tailored, personalized responses that align with the soft preferences of their users is essential for enhancing…

Human-Computer Interaction · Computer Science 2025-05-15 Jessica Y. Bo , Tianyu Xu , Ishan Chatterjee , Katrina Passarella-Ward , Achin Kulshrestha , D Shin

Large Language Models (LLMs) have emerged as promising solutions for a variety of medical and clinical decision support applications. However, LLMs are often subject to different types of biases, which can lead to unfair treatment of…

Computation and Language · Computer Science 2024-08-23 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Precise control over language model generation is vital for ensuring both safety and reliability. Although prompt engineering and steering are commonly used to intervene in model behaviors, the vast number of parameters in models often…

Computation and Language · Computer Science 2025-06-04 Mengru Wang , Ziwen Xu , Shengyu Mao , Shumin Deng , Zhaopeng Tu , Huajun Chen , Ningyu Zhang

Large Language Models (LLMs) have advanced various Natural Language Processing (NLP) tasks, such as text generation and translation, among others. However, these models often generate texts that can perpetuate biases. Existing approaches to…

Computation and Language · Computer Science 2025-01-07 Shaina Raza , Oluwanifemi Bamgbose , Shardul Ghuge , Fatemeh Tavakol , Deepak John Reji , Syed Raza Bashir

Reliable behavior control is central to deploying large language models (LLMs) on the web. Activation steering offers a tuning-free route to align attributes (e.g., truthfulness) that ensure trustworthy generation. Prevailing approaches…

Artificial Intelligence · Computer Science 2025-11-19 Manjiang Yu , Hongji Li , Priyanka Singh , Xue Li , Di Wang , Lijie Hu

Although prior work on bias mitigation has focused on promoting social equality and demographic parity, less attention has been given to aligning LLM's outputs to desired distributions. For example, we might want to align a model with…

Computation and Language · Computer Science 2025-10-09 Ingroj Shrestha , Padmini Srinivasan