English
Related papers

Related papers: BiasGym: A Simple and Generalizable Framework for …

200 papers

Large language models (LLMs) are increasingly deployed in high-stakes hiring applications, making decisions that directly impact people's careers and livelihoods. While prior studies suggest simple anti-bias prompts can eliminate…

Machine Learning · Computer Science 2025-06-13 Adam Karvonen , Samuel Marks

The integration of Large Language Models (LLMs) into various software applications raises concerns about their potential biases. Typically, those models are trained on a vast amount of data scrapped from forums, websites, social media and…

Software Engineering · Computer Science 2025-07-24 Sergio Morales , Robert Clarisó , Jordi Cabot

Large Language models (LLMs), such as ChatGPT, have gained popularity in recent years with the advancement of Natural Language Processing (NLP), with use cases spanning many disciplines and daily lives as well. LLMs inherit explicit and…

Computation and Language · Computer Science 2025-12-01 Fatima Kazi

Large language model (LLM)-based judges are widely adopted for automated evaluation and reward modeling, yet their judgments are often affected by judgment biases. Accurately evaluating these biases is essential for ensuring the reliability…

Computation and Language · Computer Science 2026-03-10 Hongli Zhou , Hui Huang , Rui Zhang , Kehai Chen , Bing Xu , Conghui Zhu , Tiejun Zhao , Muyun Yang

Cognitive biases, systematic deviations from rationality in judgment, pose significant challenges in generating objective content. This paper introduces a novel approach for real-time cognitive bias detection in user-generated text using…

Computers and Society · Computer Science 2025-03-10 Frederic Lemieux , Aisha Behr , Clara Kellermann-Bryant , Zaki Mohammed

Speech Integrated Large Language Models (SILLMs) combine large language models with speech perception to perform diverse tasks, such as emotion recognition to speaker verification, demonstrating universal audio understanding capability.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-22 Yi-Cheng Lin , Tzu-Quan Lin , Chih-Kai Yang , Ke-Han Lu , Wei-Chih Chen , Chun-Yi Kuan , Hung-yi Lee

We introduce LLM-Lasso, a novel framework that leverages large language models (LLMs) to guide feature selection in Lasso $\ell_1$ regression. Unlike traditional methods that rely solely on numerical data, LLM-Lasso incorporates…

Recent studies seek to provide Graph Neural Network (GNN) interpretability via multiple unsupervised learning models. Due to the scarcity of datasets, current methods easily suffer from learning bias. To solve this problem, we embed a Large…

Machine Learning · Computer Science 2024-07-24 Jiaxing Zhang , Jiayi Liu , Dongsheng Luo , Jennifer Neville , Hua Wei

Over the last year, Large Language Models (LLMs) like ChatGPT have become widely available and have exhibited fairness issues similar to those in previous machine learning systems. Current research is primarily focused on analyzing and…

Machine Learning · Computer Science 2024-04-04 Anna Kruspe

Large Multi-Modal Models (LMMs) have demonstrated impressive capabilities as general-purpose chatbots able to engage in conversations about visual inputs. However, their responses are influenced by societal biases present in their training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Neale Ratzlaff , Matthew Lyle Olson , Musashi Hinck , Estelle Aflalo , Shao-Yen Tseng , Vasudev Lal , Phillip Howard

While task-agnostic debiasing provides notable generalizability and reduced reliance on downstream data, its impact on language modeling ability and the risk of relearning social biases from downstream task-specific data remain as the two…

Computation and Language · Computer Science 2024-06-07 Guangliang Liu , Milad Afshari , Xitong Zhang , Zhiyu Xue , Avrajit Ghosh , Bidhan Bashyal , Rongrong Wang , Kristen Johnson

Large language models (LLMs) have shown remarkable adaptability to diverse tasks, by leveraging context prompts containing instructions, or minimal input-output examples. However, recent work revealed they also exhibit label bias -- an…

Computation and Language · Computer Science 2024-05-07 Yuval Reif , Roy Schwartz

Fine-tuned language models have been shown to exhibit biases against protected groups in a host of modeling tasks such as text classification and coreference resolution. Previous works focus on detecting these biases, reducing bias in data…

Computation and Language · Computer Science 2021-04-13 Xisen Jin , Francesco Barbieri , Brendan Kennedy , Aida Mostafazadeh Davani , Leonardo Neves , Xiang Ren

Although prior work on bias mitigation has focused on promoting social equality and demographic parity, less attention has been given to aligning LLM's outputs to desired distributions. For example, we might want to align a model with…

Computation and Language · Computer Science 2025-10-09 Ingroj Shrestha , Padmini Srinivasan

Large language models (LLMs) exhibit pronounced social biases. Output-level or data-optimization--based debiasing methods cannot fully resolve these biases, and many prior works have shown that biases are embedded in internal…

Computation and Language · Computer Science 2026-03-20 Zikang Ding , Junchi Yao , Junhao Li , Yi Zhang , Wenbo Jiang , Hongbo Liu , Lijie Hu

Pre-trained language models (LMs) have, over the last few years, grown substantially in both societal adoption and training costs. This rapid growth in size has constrained progress in understanding and mitigating their biases. Since…

Computation and Language · Computer Science 2026-01-16 Filip Trhlik , Andrew Caines , Paula Buttery

Despite significant progress, recent studies indicate that current large language models (LLMs) may still capture dataset biases and utilize them during inference, leading to the poor generalizability of LLMs. However, due to the diversity…

Computation and Language · Computer Science 2025-05-28 Zhouhao Sun , Xiao Ding , Li Du , Yunpeng Xu , Yixuan Ma , Yang Zhao , Bing Qin , Ting Liu

Large language models (LLMs) often inherit and amplify social biases embedded in their training data. A prominent social bias is gender bias. In this regard, prior work has mainly focused on gender stereotyping bias - the association of…

Computation and Language · Computer Science 2025-06-18 Erik Derner , Sara Sansalvador de la Fuente , Yoan Gutiérrez , Paloma Moreda , Nuria Oliver

Large Language Models (LLMs) possess general world knowledge but often struggle to generate precise predictions in structured, domain-specific contexts such as simulations. These limitations arise from their inability to ground their broad,…

Artificial Intelligence · Computer Science 2026-01-30 Guillaume Levy , Cedric Colas , Pierre-Yves Oudeyer , Thomas Carta , Clement Romac

Recent studies have shown that Machine Learning (ML) models can exhibit bias in real-world scenarios, posing significant challenges in ethically sensitive domains such as healthcare. Such bias can negatively affect model fairness, model…

Machine Learning · Computer Science 2025-09-05 Junyu Yan , Feng Chen , Yuyang Xue , Yuning Du , Konstantinos Vilouras , Sotirios A. Tsaftaris , Steven McDonagh