English
Related papers

Related papers: Debias your Large Multi-Modal Model at Test-Time v…

200 papers

Large language models(LLM) are pre-trained on extensive corpora to learn facts and human cognition which contain human preferences. However, this process can inadvertently lead to these models acquiring biases and stereotypes prevalent in…

Computation and Language · Computer Science 2024-03-22 Yuchen Cai , Ding Cao , Rongxi Guo , Yaqin Wen , Guiquan Liu , Enhong Chen

Large Language Models (LLMs) exhibit social biases, which can lead to harmful stereotypes and unfair outcomes. We propose \textbf{Multi-Persona Thinking (MPT)}, a simple inference-time framework that reduces social bias by encouraging…

Computation and Language · Computer Science 2026-04-22 Yuxing Chen , Guoqing Luo , Zijun Wu , Lili Mou

Large Language Models (LLMs) are increasingly deployed in high-stakes decision-making contexts. While prior work has shown that LLMs exhibit cognitive biases behaviorally, whether these biases correspond to identifiable internal…

Artificial Intelligence · Computer Science 2026-04-03 Fan Huang , Songheng Zhang , Haewoon Kwak , Jisun An

Pre-trained Large Language Models (LLMs) have significantly advanced natural language processing capabilities but are susceptible to biases present in their training data, leading to unfair outcomes in various applications. While numerous…

Computation and Language · Computer Science 2024-03-04 Sana Ebrahimi , Kaiwen Chen , Abolfazl Asudeh , Gautam Das , Nick Koudas

Machine learning models have been shown to inherit biases from their training datasets. This can be particularly problematic for vision-language foundation models trained on uncurated datasets scraped from the internet. The biases can be…

Machine Learning · Computer Science 2023-05-16 Ching-Yao Chuang , Varun Jampani , Yuanzhen Li , Antonio Torralba , Stefanie Jegelka

Societal biases are reflected in large pre-trained language models and their fine-tuned versions on downstream tasks. Common in-processing bias mitigation approaches, such as adversarial training and mutual information removal, introduce…

Machine Learning · Computer Science 2023-06-06 Lukas Hauzenberger , Shahed Masoudian , Deepak Kumar , Markus Schedl , Navid Rekabsaz

Large language models (LLMs) often encode cognitive behaviors unpredictably across prompts, layers, and contexts, making them difficult to diagnose and control. We present CBMAS, a diagnostic framework for continuous activation steering,…

Artificial Intelligence · Computer Science 2026-01-13 Ahmed H. Ismail , Anthony Kuang , Ayo Akinkugbe , Kevin Zhu , Sean O'Brien

The rapid advancement of Vision-Language models (VLMs) has raised growing concerns that their black-box reasoning processes could lead to unintended forms of social bias. Current debiasing approaches focus on mitigating surface-level bias…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Na Min An , Yoonna Jang , Yusuke Hirota , Ryo Hachiuma , Isabelle Augenstein , Hyunjung Shim

Large language models (LLMs) offer significant potential as tools to support an expanding range of decision-making tasks. Given their training on human (created) data, LLMs have been shown to inherit societal biases against protected…

Artificial Intelligence · Computer Science 2024-10-07 Jessica Echterhoff , Yao Liu , Abeer Alessa , Julian McAuley , Zexue He

Existing debiasing methods inevitably make unreasonable or undesired predictions as they are designated and evaluated to achieve parity across different social groups but leave aside individual facts, resulting in modified existing…

Computation and Language · Computer Science 2024-07-02 Ruizhe Chen , Yichen Li , Zikai Xiao , Zuozhu Liu

Large language models (LLMs) are known to perpetuate stereotypes and exhibit biases. Various strategies have been proposed to mitigate these biases, but most work studies biases as a black-box problem without considering how concepts are…

Computation and Language · Computer Science 2025-09-19 Hannah Cyberey , Yangfeng Ji , David Evans

Large Language Models (LLMs) can generate biased responses. Yet previous direct probing techniques contain either gender mentions or predefined gender stereotypes, which are challenging to comprehensively collect. Hence, we propose an…

Computation and Language · Computer Science 2024-02-20 Xiangjue Dong , Yibo Wang , Philip S. Yu , James Caverlee

Large language models are becoming the go-to solution for the ever-growing number of tasks. However, with growing capacity, models are prone to rely on spurious correlations stemming from biases and stereotypes present in the training data.…

Computation and Language · Computer Science 2024-05-30 Tomasz Limisiewicz , David Mareček , Tomáš Musil

Recently, researchers have made considerable improvements in dialogue systems with the progress of large language models (LLMs) such as ChatGPT and GPT-4. These LLM-based chatbots encode the potential biases while retaining disparities that…

Computation and Language · Computer Science 2023-10-18 Hsuan Su , Cheng-Chu Cheng , Hua Farn , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Phillip Howard , Kathleen C. Fraser , Anahita Bhiwandiwalla , Svetlana Kiritchenko

Large Language Models (LLMs) have demonstrated impressive zero-shot capabilities and versatility in NLP tasks, however they sometimes fail to maintain crucial invariances for specific tasks. One example is permutation sensitivity, where…

Computation and Language · Computer Science 2024-03-21 Adian Liusie , Yassir Fathullah , Mark J. F. Gales

Large language models (LLMs) have significantly advanced dialogue systems and role-playing agents through their ability to generate human-like text. While prior studies have shown that LLMs can exhibit distinct and consistent personalities,…

Computation and Language · Computer Science 2025-02-18 Shu Yang , Shenzhe Zhu , Liang Liu , Lijie Hu , Mengdi Li , Di Wang

This paper investigates how Large Language Models (LLMs) represent non-English tokens -- a question that remains underexplored despite recent progress. We propose a lightweight intervention method using representation steering, where a…

Computation and Language · Computer Science 2025-08-27 Omar Mahmoud , Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana

We address the challenge of societal bias in Large Language Models (LLMs), focusing on the Llama 2 7B Chat model. As LLMs are increasingly integrated into decision-making processes with substantial societal impact, it becomes imperative to…

Computation and Language · Computer Science 2024-02-02 Dawn Lu , Nina Rimsky

Advancements in Large Language Models (LLMs) have increased the performance of different natural language understanding as well as generation tasks. Although LLMs have breached the state-of-the-art performance in various tasks, they often…

Computation and Language · Computer Science 2025-05-28 Charaka Vinayak Kumar , Ashok Urlana , Gopichand Kanumolu , Bala Mallikarjunarao Garlapati , Pruthwik Mishra