English
Related papers

Related papers: Open-DeBias: Toward Mitigating Open-Set Bias in La…

200 papers

Large language models (LLMs) often exhibit strong biases, e.g, against women or in favor of the number 7. We investigate whether LLMs would be able to output less biased answers when allowed to observe their prior answers to the same…

Machine Learning · Computer Science 2025-05-27 An Vo , Mohammad Reza Taesiri , Daeyoung Kim , Anh Totti Nguyen

Large Language Models (LLMs) such as Mistral and LLaMA have showcased remarkable performance across various natural language processing (NLP) tasks. Despite their success, these models inherit social biases from the diverse datasets on…

Computation and Language · Computer Science 2024-06-19 Nirmalendu Prakash , Lee Ka Wei Roy

Open Large Language Model (LLM) benchmarks, such as HELM and BIG-Bench, provide standardized and transparent evaluation protocols that support comparative analysis, reproducibility, and systematic progress tracking in Language Model (LM)…

Computation and Language · Computer Science 2026-01-08 Md. Najib Hasan , Md Mahadi Hassan Sibat , Mohammad Fakhruddin Babar , Souvika Sarkar , Monowar Hasan , Santu Karmaker

Recent advances in large language models (LLMs) and medical LLMs (Med-LLMs) have demonstrated strong performance on general medical benchmarks. However, their capabilities in specialized medical fields, such as dentistry which require…

Computation and Language · Computer Science 2025-08-29 Hengchuan Zhu , Yihuan Xu , Yichen Li , Zijie Meng , Zuozhu Liu

Recent studies have demonstrated that some Large Language Models exhibit choice-supportive bias (CSB) when performing evaluations, systematically favoring their chosen options and potentially compromising the objectivity of AI-assisted…

Computation and Language · Computer Science 2025-12-04 Nan Zhuang , Wenshuo Wang , Lekai Qian , Yuxiao Wang , Boyu Cao , Qi Liu

Pre-trained Large Language Models (LLMs) have significantly advanced natural language processing capabilities but are susceptible to biases present in their training data, leading to unfair outcomes in various applications. While numerous…

Computation and Language · Computer Science 2024-03-04 Sana Ebrahimi , Kaiwen Chen , Abolfazl Asudeh , Gautam Das , Nick Koudas

Large Language Models (LLMs) are increasingly deployed across diverse domains but often exhibit disparities in how they handle real-life queries. To systematically investigate these effects within various disability contexts, we introduce…

Computation and Language · Computer Science 2025-09-30 Srikant Panda , Amit Agarwal , Hitesh Laxmichand Patel

Understanding biases and stereotypes encoded in the weights of Large Language Models (LLMs) is crucial for developing effective mitigation strategies. However, biased behaviour is often subtle and non-trivial to isolate, even when…

Computation and Language · Computer Science 2026-02-03 Sekh Mainul Islam , Nadav Borenstein , Siddhesh Milind Pawar , Haeun Yu , Arnav Arora , Isabelle Augenstein

Recently, there has been a trend of evaluating the Large Language Model (LLM) quality in the flavor of LLM-as-a-Judge, namely leveraging another LLM to evaluate the current output quality. However, existing judges are proven to be biased,…

Computation and Language · Computer Science 2024-09-26 Hongli Zhou , Hui Huang , Yunfei Long , Bing Xu , Conghui Zhu , Hailong Cao , Muyun Yang , Tiejun Zhao

Large Language Models (LLMs) are increasingly applied in various real-world scenarios due to their excellent generalization capabilities and robust generative abilities. However, they exhibit position bias, also known as "lost in the…

Computation and Language · Computer Science 2025-05-26 Yijiong Yu , Huiqiang Jiang , Xufang Luo , Qianhui Wu , Chin-Yew Lin , Dongsheng Li , Yuqing Yang , Yongfeng Huang , Lili Qiu

Large Language Models (LLMs) are prone to generating content that exhibits gender biases, raising significant ethical concerns. Alignment, the process of fine-tuning LLMs to better align with desired behaviors, is recognized as an effective…

Computation and Language · Computer Science 2024-12-17 Tao Zhang , Ziqian Zeng , Yuxiang Xiao , Huiping Zhuang , Cen Chen , James Foulds , Shimei Pan

Agents backed by large language models (LLMs) increasingly rely on external tools drawn from marketplaces where multiple providers offer functionally equivalent options. This raises a critical fairness concern: systematic bias in tool…

Artificial Intelligence · Computer Science 2026-03-12 Thierry Blankenstein , Jialin Yu , Zixuan Li , Vassilis Plachouras , Sunando Sengupta , Philip Torr , Yarin Gal , Alasdair Paren , Adel Bibi

Safety-aligned large language models (LLMs) are becoming increasingly widespread, especially in sensitive applications where fairness is essential and biased outputs can cause significant harm. However, evaluating the fairness of models is…

Computation and Language · Computer Science 2026-03-19 Rom Himelstein , Amit LeVi , Brit Youngmann , Yaniv Nemcovsky , Avi Mendelson

Large Language Models (LLMs) have emerged as powerful candidates to inform clinical decision-making processes. While these models play an increasingly prominent role in shaping the digital landscape, two growing concerns emerge in…

Computation and Language · Computer Science 2024-04-24 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Large language models (LLMs) have achieved impressive performance on various natural language generation tasks. Nonetheless, they suffer from generating negative and harmful contents that are biased against certain demographic groups (e.g.,…

Machine Learning · Computer Science 2024-06-05 Tianci Liu , Haoyu Wang , Shiyang Wang , Yu Cheng , Jing Gao

The emergence of Large Language Models (LLMs) in the medical domain has stressed a compelling need for standard datasets to evaluate their question-answering (QA) performance. Although there have been several benchmark datasets for medical…

Computation and Language · Computer Science 2025-03-18 Qian Zhang , Panfeng Chen , Jiali Li , Linkun Feng , Shuyu Liu , Heng Zhao , Mei Chen , Hui Li , Yanhao Wang

Stereotype biases in Large Multimodal Models (LMMs) perpetuate harmful societal prejudices, undermining the fairness and equity of AI applications. As LMMs grow increasingly influential, addressing and mitigating inherent biases related to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Vishal Narnaware , Ashmal Vayani , Rohit Gupta , Sirnam Swetha , Mubarak Shah

Multiple Choice Question (MCQ) answering is a widely used method for evaluating the performance of Large Language Models (LLMs). However, LLMs often exhibit selection bias in MCQ tasks, where their choices are influenced by factors like…

Computation and Language · Computer Science 2025-12-01 Blessed Guda , Lawrence Francis , Gabrial Zencha Ashungafac , Carlee Joe-Wong , Moise Busogi

Several works have proven that finetuning is an applicable approach for debiasing contextualized word embeddings. Similarly, discrete prompts with semantic meanings have shown to be effective in debiasing tasks. With unfixed mathematical…

Computation and Language · Computer Science 2025-05-27 Ke Yang , Charles Yu , Yi Fung , Manling Li , Heng Ji

Large language models (LLMs) have achieved promising results in tabular data generation. However, inherent historical biases in tabular datasets often cause LLMs to exacerbate fairness issues, particularly when multiple advantaged and…

Machine Learning · Computer Science 2025-09-23 Tianchun Li , Tianci Liu , Xingchen Wang , Rongzhe Wei , Pan Li , Lu Su , Jing Gao