English
Related papers

Related papers: Debias your Large Multi-Modal Model at Test-Time v…

200 papers

Large language models (LLMs) are prone to capturing biases from training corpus, leading to potential negative social impacts. Existing prompt-based debiasing methods exhibit instability due to their sensitivity to prompt changes, while…

Computation and Language · Computer Science 2025-07-08 Yichen Li , Zhiting Fan , Ruizhe Chen , Xiaotang Gai , Luqi Gong , Yan Zhang , Zuozhu Liu

As large language models (LLMs) are increasingly deployed in real-world applications, ensuring their fair responses across demographics has become crucial. Despite many efforts, an ongoing challenge is hidden bias: LLMs appear fair under…

Computation and Language · Computer Science 2026-02-05 Kahee Lim , Soyeon Kim , Steven Euijong Whang

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This…

Machine Learning · Computer Science 2025-11-19 Fatima Kazi , Alex Young , Yash Inani , Setareh Rafatirad

Large Language Models (LLMs) are prone to inheriting and amplifying societal biases embedded within their training data, potentially reinforcing harmful stereotypes related to gender, occupation, and other sensitive categories. This issue…

Computation and Language · Computer Science 2024-08-28 Atmika Gorti , Manas Gaur , Aman Chadha

Frontier Large Language Models (LLMs) can be socially discriminatory or sensitive to spurious features of their inputs. Because only well-resourced corporations can train frontier LLMs, we need robust test-time strategies to control such…

Computation and Language · Computer Science 2024-10-08 Leonardo Cotta , Chris J. Maddison

Large Vision-Language Models (LVLMs) exhibit outstanding performance on vision-language tasks but struggle with hallucination problems. Through in-depth analysis of LVLM activation patterns, we reveal two key findings: 1) truthfulness and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Jianghao Yin , Qin Chen , Kedi Chen , Jie Zhou , Xingjiao Wu , Liang He

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Phillip Howard , Anahita Bhiwandiwalla , Kathleen C. Fraser , Svetlana Kiritchenko

While Vision-Language Models (VLMs) have achieved remarkable performance across diverse downstream tasks, recent studies have shown that they can inherit social biases from the training data and further propagate them into downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Tangzheng Lian , Guanyu Hu , Yijing Ren , Dimitrios Kollias , Oya Celiktutan

While large language models (LLMs) are trained to align with human values, their generations may still violate safety constraints. A growing line of work addresses this problem by modifying the model's sampling policy at decoding time using…

Machine Learning · Computer Science 2026-05-15 Bat-Sheva Einbinder , Hen Davidov , Yee Whye Teh , Yarin Gal , Yaniv Romano

Large Language Models (LLMs) such as Mistral and LLaMA have showcased remarkable performance across various natural language processing (NLP) tasks. Despite their success, these models inherit social biases from the diverse datasets on…

Computation and Language · Computer Science 2024-06-19 Nirmalendu Prakash , Lee Ka Wei Roy

Researchers have been studying approaches to steer the behavior of Large Language Models (LLMs) and build personalized LLMs tailored for various applications. While fine-tuning seems to be a direct solution, it requires substantial…

Computation and Language · Computer Science 2024-07-31 Yuanpu Cao , Tianrong Zhang , Bochuan Cao , Ziyi Yin , Lu Lin , Fenglong Ma , Jinghui Chen

Textual data used to train large language models (LLMs) exhibits multifaceted bias manifestations encompassing harmful language and skewed demographic distributions. Regulations such as the European AI Act require identifying and mitigating…

This paper addresses debiasing in news editing and evaluates the effectiveness of conversational Large Language Models in this task. We designed an evaluation checklist tailored to news editors' perspectives, obtained generated texts from…

Computation and Language · Computer Science 2024-04-10 Ipek Baris Schlicht , Defne Altiok , Maryanne Taouk , Lucie Flek

Self-Correction based on feedback improves the output quality of Large Language Models (LLMs). Moreover, as Self-Correction functions like the slow and conscious System-2 thinking from cognitive psychology's perspective, it can potentially…

Computation and Language · Computer Science 2025-03-11 Panatchakorn Anantaprayoon , Masahiro Kaneko , Naoaki Okazaki

Large Vision-Language Models (LVLMs) have achieved strong performance on vision-language tasks, particularly Visual Question Answering (VQA). While prior work has explored unimodal biases in VQA, the problem of selection bias in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Md. Atabuzzaman , Ali Asgarov , Chris Thomas

Large language models (LLMs) have transformed the way we access information. These models are often tuned to refuse to comply with requests that are considered harmful and to produce responses that better align with the preferences of those…

Computation and Language · Computer Science 2025-08-12 Hannah Cyberey , David Evans

Controlling multiple behavioral attributes in large language models (LLMs) at inference time is a challenging problem due to interference between attributes and the limitations of linear steering methods, which assume additive behavior in…

Machine Learning · Computer Science 2026-04-07 Narmeen Oozeer , Luke Marks , Shreyans Jain , Fazl Barez , Amirali Abdullah

Detecting biases in the outputs produced by generative models is essential to reduce the potential risks associated with their application in critical settings. However, the majority of existing methodologies for identifying biases in…

Computation and Language · Computer Science 2025-02-04 Erica Coppolillo , Giuseppe Manco , Luca Maria Aiello

Recent breakthroughs in self supervised training have led to a new class of pretrained vision language models. While there have been investigations of bias in multimodal models, they have mostly focused on gender and racial bias, giving…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Sepehr Janghorbani , Gerard de Melo

Debiasing techniques such as SentDebias aim to reduce bias in large language models (LLMs). Previous studies have evaluated their cross-lingual transferability by directly applying these methods to LLM representations, revealing their…

Computation and Language · Computer Science 2025-08-26 Qiwei Peng , Guimin Hu , Yekun Chai , Anders Søgaard