English
Related papers

Related papers: A Group Fairness Lens for Large Language Models

200 papers

Large Language Models (LLMs) have been observed to exhibit bias in numerous ways, potentially creating or worsening outcomes for specific groups identified by protected attributes such as sex, race, sexual orientation, or age. To help…

Computation and Language · Computer Science 2025-01-30 Dylan Bouchard , Mohit Singh Chauhan , David Skarbrevik , Viren Bajaj , Zeya Ahmad

Large Language Models (LLMs) have emerged as promising solutions for a variety of medical and clinical decision support applications. However, LLMs are often subject to different types of biases, which can lead to unfair treatment of…

Computation and Language · Computer Science 2024-08-23 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

The growing use of large language model (LLM)-based chatbots has raised concerns about fairness. Fairness issues in LLMs can lead to severe consequences, such as bias amplification, discrimination, and harm to marginalized communities.…

Computation and Language · Computer Science 2025-06-11 Zhiting Fan , Ruizhe Chen , Tianxiang Hu , Zuozhu Liu

Large Language Models (LLMs) push the bound-aries in natural language processing and generative AI, driving progress across various aspects of modern society. Unfortunately, the pervasive issue of bias in LLMs responses (i.e., predictions)…

Computation and Language · Computer Science 2025-05-20 Isabela Pereira Gregio , Ian Pons , Anna Helena Reali Costa , Artur Jordão

The advancement of large language models (LLMs) has demonstrated strong capabilities across various applications, including mental health analysis. However, existing studies have focused on predictive performance, leaving the critical issue…

Computation and Language · Computer Science 2024-06-21 Yuqing Wang , Yun Zhao , Sara Alessandra Keller , Anne de Hond , Marieke M. van Buchem , Malvika Pillai , Tina Hernandez-Boussard

The rise of general-purpose artificial intelligence (AI) systems, particularly large language models (LLMs), has raised pressing moral questions about how to reduce bias and ensure fairness at scale. Researchers have documented a sort of…

Computation and Language · Computer Science 2025-06-06 Jacy Anthis , Kristian Lum , Michael Ekstrand , Avi Feller , Chenhao Tan

Existing fairness benchmarks for large language models (LLMs) primarily focus on simple tasks, such as multiple-choice questions, overlooking biases that may arise in more complex scenarios like long-text generation. To address this gap, we…

Computation and Language · Computer Science 2025-08-08 Wonje Jeung , Dongjae Jeon , Ashkan Yousefpour , Jonghyun Choi

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This…

Machine Learning · Computer Science 2025-11-19 Fatima Kazi , Alex Young , Yash Inani , Setareh Rafatirad

The integration of Large Language Models (LLMs) in information retrieval has raised a critical reevaluation of fairness in the text-ranking models. LLMs, such as GPT models and Llama2, have shown effectiveness in natural language…

Information Retrieval · Computer Science 2024-06-27 Yuan Wang , Xuyang Wu , Hsin-Tai Wu , Zhiqiang Tao , Yi Fang

Large Language Models (LLMs) are prone to generating content that exhibits gender biases, raising significant ethical concerns. Alignment, the process of fine-tuning LLMs to better align with desired behaviors, is recognized as an effective…

Computation and Language · Computer Science 2024-12-17 Tao Zhang , Ziqian Zeng , Yuxiang Xiao , Huiping Zhuang , Cen Chen , James Foulds , Shimei Pan

As Machine Learning technologies become increasingly used in contexts that affect citizens, companies as well as researchers need to be confident that their application of these methods will not have unexpected social implications, such as…

Machine Learning · Computer Science 2025-03-06 Simon Caton , Christian Haas

Increasing use of large language models (LLMs) demand performant guardrails to ensure the safety of inputs and outputs of LLMs. When these safeguards are trained on imbalanced data, they can learn the societal biases. We present a…

Computation and Language · Computer Science 2024-10-23 Olivia Sturman , Aparna Joshi , Bhaktipriya Radharapu , Piyush Kumar , Renee Shelby

People from different social and demographic groups express diverse perspectives and conflicting opinions on a broad set of topics such as product reviews, healthcare, law, and politics. A fair summary should provide a comprehensive…

Computation and Language · Computer Science 2024-04-02 Yusen Zhang , Nan Zhang , Yixin Liu , Alexander Fabbri , Junru Liu , Ryo Kamoi , Xiaoxin Lu , Caiming Xiong , Jieyu Zhao , Dragomir Radev , Kathleen McKeown , Rui Zhang

The rise of generative artificial intelligence, particularly Large Language Models (LLMs), has intensified the imperative to scrutinize fairness alongside accuracy. Recent studies have begun to investigate fairness evaluations for LLMs…

Information Retrieval · Computer Science 2024-08-31 Chandan Kumar Sah , Lian Xiaoli , Muhammad Mirajul Islam

Language models (LM) are becoming prevalent in many language-based application spaces globally. Although these LMs are improving our day-to-day interactions with digital products, concerns remain whether open-ended languages or text…

Computation and Language · Computer Science 2022-06-27 Akhter Al Amin , Kazi Sinthia Kabir

Recent advancements in Artificial Intelligence, particularly in Large Language Models (LLMs), have transformed natural language processing by improving generative capabilities. However, detecting biases embedded within these models remains…

Computation and Language · Computer Science 2025-03-11 Suvendu Mohanty

Recently, Large Language Models (LLMs) have demonstrated a superior ability to serve as ranking models. However, concerns have arisen as LLMs will exhibit discriminatory ranking behaviors based on users' sensitive attributes (\eg gender).…

Information Retrieval · Computer Science 2024-09-26 Chen Xu , Wenjie Wang , Yuxin Li , Liang Pang , Jun Xu , Tat-Seng Chua

Large language models (LLMs) often reflect real-world biases, leading to efforts to mitigate these effects and make the models unbiased. Achieving this goal requires defining clear criteria for an unbiased state, with any deviation from…

Computation and Language · Computer Science 2024-11-27 Changgeon Ko , Jisu Shin , Hoyun Song , Jeongyeon Seo , Jong C. Park

Large vision-language models (LVLMs) have recently achieved significant progress, demonstrating strong capabilities in open-world visual understanding. However, it is not yet clear how LVLMs address demographic biases in real life,…

Computation and Language · Computer Science 2025-09-23 Xuyang Wu , Yuan Wang , Hsin-Tai Wu , Zhiqiang Tao , Yi Fang

Large Language Models (LLMs) are powerful tools with the potential to benefit society immensely, yet, they have demonstrated biases that perpetuate societal inequalities. Despite significant advancements in bias mitigation techniques using…

Computation and Language · Computer Science 2024-09-24 Deonna M. Owens , Ryan A. Rossi , Sungchul Kim , Tong Yu , Franck Dernoncourt , Xiang Chen , Ruiyi Zhang , Jiuxiang Gu , Hanieh Deilamsalehy , Nedim Lipka