English
Related papers

Related papers: Dissecting Bias in LLMs: A Mechanistic Interpretab…

200 papers

Large language models (LLMs) have demonstrated impressive capabilities in natural language processing. However, their internal mechanisms are still unclear and this lack of transparency poses unwanted risks for downstream applications.…

Computation and Language · Computer Science 2023-11-30 Haiyan Zhao , Hanjie Chen , Fan Yang , Ninghao Liu , Huiqi Deng , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Mengnan Du

Machine learning models are trained to find patterns in data. NLP models can inadvertently learn socially undesirable patterns when training on gender biased text. In this work, we propose a general framework that decomposes gender bias in…

Computation and Language · Computer Science 2020-05-05 Emily Dinan , Angela Fan , Ledell Wu , Jason Weston , Douwe Kiela , Adina Williams

Large Language Models (LLMs) have demonstrated unprecedented capabilities across various natural language processing tasks. Their ability to process and generate viable text and code has made them ubiquitous in many fields, while their…

Machine Learning · Computer Science 2025-05-13 Stef De Sabbata , Stefano Mizzaro , Kevin Roitero

Large Language Models (LLMs) are increasingly used in decision-making, yet their susceptibility to cognitive biases remains a pressing challenge. This study explores how personality traits influence these biases and evaluates the…

Artificial Intelligence · Computer Science 2025-02-21 Jiangen He , Jiqun Liu

With the advance of Artificial Intelligence (AI), Large Language Models (LLMs) have gained prominence and been applied in diverse contexts. As they evolve into more sophisticated versions, it is essential to assess whether they reproduce…

Computation and Language · Computer Science 2025-08-15 Gustavo Bonil , Simone Hashiguti , Jhessica Silva , João Gondim , Helena Maia , Nádia Silva , Helio Pedrini , Sandra Avila

Large Language Models (LLMs) have been shown to exhibit various biases and stereotypes in their generated content. While extensive research has investigated biases in LLMs, prior work has predominantly focused on explicit bias, with minimal…

Computation and Language · Computer Science 2025-06-04 Yachao Zhao , Bo Wang , Yan Wang , Dongming Zhao , Ruifang He , Yuexian Hou

As modern Large Language Models (LLMs) shatter many state-of-the-art benchmarks in a variety of domains, this paper investigates their behavior in the domains of ethics and fairness, focusing on protected group bias. We conduct a two-part…

Computers and Society · Computer Science 2024-03-25 Hadas Kotek , David Q. Sun , Zidi Xiu , Margit Bowler , Christopher Klein

Large Language Models (LLMs) have fundamentally transformed the field of natural language processing; however, their vulnerability to biases presents a notable obstacle that threatens both fairness and trust. This review offers an extensive…

Computation and Language · Computer Science 2025-09-19 Kiana Kiashemshaki , Mohammad Jalili Torkamani , Negin Mahmoudi , Meysam Shirdel Bilehsavar

For subjective tasks such as hate detection, where people perceive hate differently, the Large Language Model's (LLM) ability to represent diverse groups is unclear. By including additional context in prompts, we comprehensively analyze…

Computation and Language · Computer Science 2024-10-04 Sarah Masud , Sahajpreet Singh , Viktor Hangya , Alexander Fraser , Tanmoy Chakraborty

This paper investigates the subtle and often concealed biases present in Large Language Models (LLMs), focusing on implicit biases that may remain despite passing explicit bias tests. Implicit biases are significant because they influence…

Computation and Language · Computer Science 2024-10-01 Serene Lim , María Pérez-Ortiz

Open-generation bias benchmarks evaluate social biases in Large Language Models (LLMs) by analyzing their outputs. However, the classifiers used in analysis often have inherent biases, leading to unfair conclusions. This study examines such…

Computation and Language · Computer Science 2025-01-22 Nathaniel Demchak , Xin Guan , Zekun Wu , Ziyi Xu , Adriano Koshiyama , Emre Kazim

Large Language Models (LLMs) are increasingly integral to information dissemination and decision-making processes. Given their growing societal influence, understanding potential biases, particularly within the political domain, is crucial…

Machine Learning · Computer Science 2025-10-17 Konrad Löhr , Shuzhou Yuan , Michael Färber

Large Language Models(LLMs) have revolutionized various applications in natural language processing (NLP) by providing unprecedented text generation, translation, and comprehension capabilities. However, their widespread deployment has…

Computation and Language · Computer Science 2024-09-26 Rajesh Ranjan , Shailja Gupta , Surya Narayan Singh

We examine whether large language models (LLMs) can predict biased decision-making in conversational settings, and whether their predictions capture not only human cognitive biases but also how those effects change under cognitive load. In…

Human-Computer Interaction · Computer Science 2026-02-06 Stephen Pilli , Vivek Nallur

Due to the implement of guardrails by developers, Large language models (LLMs) have demonstrated exceptional performance in explicit bias tests. However, bias in LLMs may occur not only explicitly, but also implicitly, much like humans who…

Computation and Language · Computer Science 2025-03-05 Xinru Lin , Luyang Li

Model collapse, a phenomenon characterized by performance degradation due to iterative training on synthetic data, has been widely studied. However, its implications for bias amplification, the progressive intensification of pre-existing…

Artificial Intelligence · Computer Science 2025-05-23 Ze Wang , Zekun Wu , Jeremy Zhang , Xin Guan , Navya Jain , Skylar Lu , Saloni Gupta , Adriano Koshiyama

Work on bias in pretrained language models (PLMs) focuses on bias evaluation and mitigation and fails to tackle the question of bias attribution and explainability. We propose a novel metric, the $\textit{bias attribution score}$, which…

Computation and Language · Computer Science 2025-06-10 Lance Calvin Lim Gamboa , Mark Lee

Large language models (LLMs) have been shown to internalize human-like biases during finetuning, yet the mechanisms by which these biases manifest remain unclear. In this work, we investigated whether the well-known Knobe effect, a moral…

Computation and Language · Computer Science 2025-12-08 Bianca Raimondi , Daniela Dalbagno , Maurizio Gabbrielli

Large Language Models (LLMs) have emerged as powerful candidates to inform clinical decision-making processes. While these models play an increasingly prominent role in shaping the digital landscape, two growing concerns emerge in…

Computation and Language · Computer Science 2024-04-24 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed