English
Related papers

Related papers: Bias Analysis and Mitigation through Protected Att…

200 papers

Fine-tuning Large Language Models (LLMs) is now a common approach for text classification in a wide range of applications. When labeled documents are scarce, active learning helps save annotation efforts but requires retraining of massive…

Machine Learning · Computer Science 2024-02-27 Artem Vysogorets , Achintya Gopal

Large language models (LLMs) exhibit cognitive biases -- systematic tendencies of irrational decision-making, similar to those seen in humans. Prior work has found that these biases vary across models and can be amplified by instruction…

Computation and Language · Computer Science 2025-07-15 Itay Itzhak , Yonatan Belinkov , Gabriel Stanovsky

As large language models (LLMs) become integral to recruitment processes, concerns about AI-induced bias have intensified. This study examines biases in candidate interview reports generated by Claude 3.5 Sonnet, GPT-4o, Gemini 1.5, and…

Artificial Intelligence · Computer Science 2024-10-23 Django Beatty , Kritsada Masanthia , Teepakorn Kaphol , Niphan Sethi

The ratio of outlier parameters in language pre-training models and vision pre-training models differs significantly, making cross-modality (language and vision) inherently more challenging than cross-domain adaptation. As a result, many…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Yaxin Luo , Zhiqiang Shen

Progress in natural language generation research has been shaped by the ever-growing size of language models. While large language models pre-trained on web data can generate human-sounding text, they also reproduce social biases and…

Computation and Language · Computer Science 2023-06-06 Celine Wald , Lukas Pfahler

Language serves as a powerful tool for the manifestation of societal belief systems. In doing so, it also perpetuates the prevalent biases in our society. Gender bias is one of the most pervasive biases in our society and is seen in online…

Computation and Language · Computer Science 2023-10-27 Rishav Hada , Agrima Seth , Harshita Diddee , Kalika Bali

Bias in large language models (LLMs) has many forms, from overt discrimination to implicit stereotypes. Counterfactual bias evaluation is a widely used approach to quantifying bias and often relies on template-based probes that explicitly…

Computation and Language · Computer Science 2026-01-15 Farnaz Kohankhaki , D. B. Emerson , Jacob-Junqi Tian , Laleh Seyyed-Kalantari , Faiza Khan Khattak

Large Language Models (LLMs) have been shown to exhibit various biases and stereotypes in their generated content. While extensive research has investigated biases in LLMs, prior work has predominantly focused on explicit bias, with minimal…

Computation and Language · Computer Science 2025-06-04 Yachao Zhao , Bo Wang , Yan Wang , Dongming Zhao , Ruifang He , Yuexian Hou

The use of Large Language Models (LLMs) has proven to be a tool that could help in the automatic detection of sexism. Previous studies have shown that these models contain biases that do not accurately reflect reality, especially for…

Computation and Language · Computer Science 2025-08-26 Judith Tavarez-Rodríguez , Fernando Sánchez-Vega , A. Pastor López-Monroy

Large Language Models (LLMs) have shown their impressive capabilities, while also raising concerns about the data contamination problems due to privacy issues and leakage of benchmark datasets in the pre-training phase. Therefore, it is…

Computation and Language · Computer Science 2024-06-04 Zhenhua Liu , Tong Zhu , Chuanyuan Tan , Haonan Lu , Bing Liu , Wenliang Chen

As the breadth and depth of language model applications continue to expand rapidly, it is increasingly important to build efficient frameworks for measuring and mitigating the learned or inherited social biases of these models. In this…

Computation and Language · Computer Science 2023-07-21 Omkar Dige , Jacob-Junqi Tian , David Emerson , Faiza Khan Khattak

As LLMs are increasingly integrated into user-facing applications, addressing biases that perpetuate societal inequalities is crucial. While much work has gone into measuring or mitigating biases in these models, fewer studies have…

Computation and Language · Computer Science 2026-05-13 Marion Thaler , Abdullatif Köksal , Alina Leidinger , Anna Korhonen , Hinrich Schütze

Human action recognition models often rely on background cues rather than human movement and pose to make predictions, a behavior known as background bias. We present a systematic analysis of background bias across classification models,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ellie Zhou , Jihoon Chung , Olga Russakovsky

Recent advances in artificial intelligence, including the development of highly sophisticated large language models (LLM), have proven beneficial in many real-world applications. However, evidence of inherent bias encoded in these LLMs has…

Computation and Language · Computer Science 2023-09-19 Vithya Yogarajan , Gillian Dobbie , Timothy Pistotti , Joshua Bensemann , Kobe Knowles

Large language models (LLMs) have become integral tool for users from various backgrounds. LLMs, trained on vast corpora, reflect the linguistic and cultural nuances embedded in their pre-training data. However, the values and perspectives…

Computation and Language · Computer Science 2025-07-17 Songyuan Liu , Ziyang Zhang , Runze Yan , Wei Wu , Carl Yang , Jiaying Lu

Language-image pre-training is an effective technique for learning powerful representations in general domains. However, when directly turning to person representation learning, these general pre-training methods suffer from unsatisfactory…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jialong Zuo , Jiahao Hong , Feng Zhang , Changqian Yu , Hanyu Zhou , Changxin Gao , Nong Sang , Jingdong Wang

While recent work has found that vision-language models trained under the Contrastive Language Image Pre-training (CLIP) framework contain intrinsic social biases, the extent to which different upstream pre-training features of the…

Artificial Intelligence · Computer Science 2025-06-11 Kshitish Ghate , Isaac Slaughter , Kyra Wilson , Mona Diab , Aylin Caliskan

Classifiers are biased when trained on biased datasets. As a remedy, we propose Learning to Split (ls), an algorithm for automatic bias detection. Given a dataset with input-label pairs, ls learns to split this dataset so that predictors…

Machine Learning · Computer Science 2022-07-22 Yujia Bao , Regina Barzilay

Language carries implicit human biases, functioning both as a reflection and a perpetuation of stereotypes that people carry with them. Recently, ML-based NLP methods such as word embeddings have been shown to learn such language biases…

Computation and Language · Computer Science 2022-01-26 Xavier Ferrer-Aran , Tom van Nuenen , Natalia Criado , Jose M. Such

The growing complexity and diversity of news coverage have made framing analysis a crucial yet challenging task in computational social science. Traditional approaches, including manual annotation and fine-tuned models, remain limited by…

Computation and Language · Computer Science 2026-05-22 Valeria Pastorino , Jasivan A. Sivakumar , Nafise Sadat Moosavi