English
Related papers

Related papers: Augmenting Bias Detection in LLMs Using Topologica…

200 papers

With the rapid development of large language models (LLMs), they have significantly improved efficiency across a wide range of domains. However, recent studies have revealed that LLMs often exhibit gender bias, leading to serious social…

Computation and Language · Computer Science 2025-06-17 Xiaoqing Cheng , Hongying Zan , Lulu Kong , Jinwang Song , Min Peng

Bias in large language models (LLMs) has many forms, from overt discrimination to implicit stereotypes. Counterfactual bias evaluation is a widely used approach to quantifying bias and often relies on template-based probes that explicitly…

Computation and Language · Computer Science 2026-01-15 Farnaz Kohankhaki , D. B. Emerson , Jacob-Junqi Tian , Laleh Seyyed-Kalantari , Faiza Khan Khattak

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language…

Computation and Language · Computer Science 2023-09-04 Vishesh Thakur

Large Language Models (LLMs) are increasingly integrated into critical decision-making processes, such as loan approvals and visa applications, where inherent biases can lead to discriminatory outcomes. In this paper, we examine the nuanced…

Computation and Language · Computer Science 2024-05-30 Mina Arzaghi , Florian Carichon , Golnoosh Farnadi

Large language models (LLMs) acquire general linguistic knowledge from massive-scale pretraining. However, pretraining data mainly comprised of web-crawled texts contain undesirable social biases which can be perpetuated or even amplified…

Computation and Language · Computer Science 2025-09-04 Takuma Udagawa , Yang Zhao , Hiroshi Kanayama , Bishwaranjan Bhattacharjee

Recent advancements in Artificial Intelligence, particularly in Large Language Models (LLMs), have transformed natural language processing by improving generative capabilities. However, detecting biases embedded within these models remains…

Computation and Language · Computer Science 2025-03-11 Suvendu Mohanty

Large Language Models (LLMs) such as Mistral and LLaMA have showcased remarkable performance across various natural language processing (NLP) tasks. Despite their success, these models inherit social biases from the diverse datasets on…

Computation and Language · Computer Science 2024-06-19 Nirmalendu Prakash , Lee Ka Wei Roy

Large Language Models inherit stereotypes from their pretraining data, leading to biased behavior toward certain social groups in many Natural Language Processing tasks, such as hateful speech detection or sentiment analysis. Surprisingly,…

Computation and Language · Computer Science 2025-10-24 Anthony Dubreuil , Antoine Gourru , Christine Largeron , Amine Trabelsi

Recently, researchers have made considerable improvements in dialogue systems with the progress of large language models (LLMs) such as ChatGPT and GPT-4. These LLM-based chatbots encode the potential biases while retaining disparities that…

Computation and Language · Computer Science 2023-10-18 Hsuan Su , Cheng-Chu Cheng , Hua Farn , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Gender bias in artificial intelligence has become an important issue, particularly in the context of language models used in communication-oriented applications. This study examines the extent to which Large Language Models (LLMs) exhibit…

Computation and Language · Computer Science 2024-11-18 Michael Döll , Markus Döhring , Andreas Müller

Large Language Models (LLMs) have made substantial progress in the past several months, shattering state-of-the-art benchmarks in many domains. This paper investigates LLMs' behavior with respect to gender stereotypes, a known issue for…

Computation and Language · Computer Science 2023-08-30 Hadas Kotek , Rikker Dockum , David Q. Sun

As language models grow in popularity, it becomes increasingly important to clearly measure all possible markers of demographic identity in order to avoid perpetuating existing societal harms. Many datasets for measuring bias currently…

Computation and Language · Computer Science 2022-10-31 Eric Michael Smith , Melissa Hall , Melanie Kambadur , Eleonora Presani , Adina Williams

Large Language Models (LLMs) are increasingly integral to information dissemination and decision-making processes. Given their growing societal influence, understanding potential biases, particularly within the political domain, is crucial…

Machine Learning · Computer Science 2025-10-17 Konrad Löhr , Shuzhou Yuan , Michael Färber

Language models (LMs) exhibit and amplify many types of undesirable biases learned from the training data, including gender bias. However, we lack tools for effectively and efficiently changing this behavior without hurting general language…

Computation and Language · Computer Science 2023-10-20 Abhijith Chintam , Rahel Beloch , Willem Zuidema , Michael Hanna , Oskar van der Wal

Bias and stereotypes in language models can cause harm, especially in sensitive areas like content moderation and decision-making. This paper addresses bias and stereotype detection by exploring how jointly learning these tasks enhances…

Computation and Language · Computer Science 2025-07-03 Aditya Tomar , Rudra Murthy , Pushpak Bhattacharyya

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

Social bias is shaped by the accumulation of social perceptions towards targets across various demographic identities. To fully understand such social bias in large language models (LLMs), it is essential to consider the composite of social…

Computation and Language · Computer Science 2024-06-07 Jisu Shin , Hoyun Song , Huije Lee , Soyeong Jeong , Jong C. Park

A recent study has shown that large-scale visual datasets are very biased: they can be easily classified by modern neural networks. However, the concrete forms of bias among these datasets remain unclear. In this study, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Boya Zeng , Yida Yin , Zhuang Liu

Recent advances in large language models (LLMs) have substantially improved natural language processing (NLP) applications. However, these models often inherit and amplify biases present in their training data. Although several datasets…

Computation and Language · Computer Science 2026-02-20 Shaina Raza , Mizanur Rahman , Michael R. Zhang

The advancement of large language models (LLMs) has demonstrated strong capabilities across various applications, including mental health analysis. However, existing studies have focused on predictive performance, leaving the critical issue…

Computation and Language · Computer Science 2024-06-21 Yuqing Wang , Yun Zhao , Sara Alessandra Keller , Anne de Hond , Marieke M. van Buchem , Malvika Pillai , Tina Hernandez-Boussard