English
Related papers

Related papers: Towards Resource Efficient and Interpretable Bias …

200 papers

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

Computation and Language · Computer Science 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He

Biases in the dataset often enable the model to achieve high performance on in-distribution data, while poorly performing on out-of-distribution data. To mitigate the detrimental effect of the bias on the networks, previous works have…

Computation and Language · Computer Science 2023-12-07 Eojin Jeon , Mingyu Lee , Juhyeong Park , Yeachan Kim , Wing-Lam Mok , SangKeun Lee

Cheap-to-Build Very Large-Language Models (CtB-LLMs) with affordable training are emerging as the next big revolution in natural language processing and understanding. These CtB-LLMs are democratizing access to trainable Very Large-Language…

Computation and Language · Computer Science 2024-11-12 Leonardo Ranaldi , Elena Sofia Ruzzetti , Davide Venditti , Dario Onorati , Fabio Massimo Zanzotto

Large language models (LLMs) have achieved impressive performance on various natural language generation tasks. Nonetheless, they suffer from generating negative and harmful contents that are biased against certain demographic groups (e.g.,…

Machine Learning · Computer Science 2024-06-05 Tianci Liu , Haoyu Wang , Shiyang Wang , Yu Cheng , Jing Gao

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

Computation and Language · Computer Science 2024-04-16 Spencer M. Seals , Valerie L. Shalin

Large language models (LLMs) have garnered significant attention for their remarkable performance in a continuously expanding set of natural language processing tasks. However, these models have been shown to harbor inherent societal…

Computation and Language · Computer Science 2023-10-16 Abel Salinas , Louis Penafiel , Robert McCormack , Fred Morstatter

Many studies have shown various biases targeting different demographic groups in language models, amplifying discrimination and harming fairness. Recent parameter modification debiasing approaches significantly degrade core capabilities…

Computation and Language · Computer Science 2025-10-01 Dianqing Liu , Yi Liu , Guoqing Jin , Zhendong Mao

Societal biases present in pre-trained large language models are a critical issue as these models have been shown to propagate biases in countless downstream applications, rendering them unfair towards specific groups of people. Since…

Computation and Language · Computer Science 2023-06-08 Himanshu Thakur , Atishay Jain , Praneetha Vaddamanu , Paul Pu Liang , Louis-Philippe Morency

Humans are accustomed to reading and writing in a forward manner, and this natural bias extends to text understanding in auto-regressive large language models (LLMs). This paper investigates whether LLMs, like humans, struggle with reverse…

Computation and Language · Computer Science 2025-02-25 Sicheng Yu , Yuanchen Xu , Cunxiao Du , Yanying Zhou , Minghui Qiu , Qianru Sun , Hao Zhang , Jiawei Wu

Large language models pick up social biases from the data they are trained on and carry those biases into downstream applications, often reinforcing stereotypes around gender, race, religion, disability, age, and socioeconomic status. The…

Computation and Language · Computer Science 2026-05-05 Muneeb Ur Raheem Khan

The pervasive spread of misinformation and disinformation in social media underscores the critical importance of detecting media bias. While robust Large Language Models (LLMs) have emerged as foundational tools for bias prediction,…

Computers and Society · Computer Science 2024-12-11 Luyang Lin , Lingzhi Wang , Jinsong Guo , Kam-Fai Wong

Tabular machine learning problems often require time-consuming and labor-intensive feature engineering. Recent efforts have focused on using large language models (LLMs) to capitalize on their potential domain knowledge. At the same time,…

Machine Learning · Computer Science 2025-07-16 Jaris Küken , Lennart Purucker , Frank Hutter

As large language models (LLMs) become more integrated into societal systems, the risk of them perpetuating and amplifying harmful biases becomes a critical safety concern. Traditional methods for mitigating bias often rely on data…

Artificial Intelligence · Computer Science 2025-08-13 Shivam Dubey

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

Computation and Language · Computer Science 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

Generating fair and accurate predictions plays a pivotal role in deploying large language models (LLMs) in the real world. However, existing debiasing methods inevitably generate unfair or incorrect predictions as they are designed and…

Computation and Language · Computer Science 2025-02-28 Ruizhe Chen , Yichen Li , Jianfei Yang , Joey Tianyi Zhou , Jian Wu , Zuozhu Liu

This paper examines the role of cognitive biases in the decision-making processes of large language models (LLMs), challenging the conventional goal of eliminating all biases. When properly balanced, we show that certain cognitive biases…

Computation and Language · Computer Science 2025-04-15 Hanyang Zhong , Liman Wang , Wenting Cao , Zeyuan Sun

While preliminary findings indicate that multilingual LLMs exhibit reduced bias compared to monolingual ones, a comprehensive understanding of the effect of multilingual training on bias mitigation, is lacking. This study addresses this gap…

Large language models (LLMs) offer significant potential as tools to support an expanding range of decision-making tasks. Given their training on human (created) data, LLMs have been shown to inherit societal biases against protected…

Artificial Intelligence · Computer Science 2024-10-07 Jessica Echterhoff , Yao Liu , Abeer Alessa , Julian McAuley , Zexue He

Large Language Models (LLMs) are increasingly adopted in financial analysis for interpreting complex market data and trends. However, their use is challenged by intrinsic biases (e.g., risk-preference bias) and a superficial understanding…

Computation and Language · Computer Science 2024-07-02 Yuhang Zhou , Yuchen Ni , Yunhui Gan , Zhangyue Yin , Xiang Liu , Jian Zhang , Sen Liu , Xipeng Qiu , Guangnan Ye , Hongfeng Chai

As Large Language Models (LLMs) continue to evolve, they are increasingly being employed in numerous studies to simulate societies and execute diverse social tasks. However, LLMs are susceptible to societal biases due to their exposure to…

Computation and Language · Computer Science 2024-10-04 Angana Borah , Rada Mihalcea