English
Related papers

Related papers: Are Models Biased on Text without Gender-related L…

200 papers

Many studies have revealed that word embeddings, language models, and models for specific downstream tasks in NLP are prone to social biases, especially gender bias. Recently these techniques have been gradually applied to automatic…

Computation and Language · Computer Science 2022-10-18 Mingqi Gao , Xiaojun Wan

Pre-trained language models learn socially harmful biases from their training corpora, and may repeat these biases when used for generation. We study gender biases associated with the protagonist in model-generated stories. Such biases may…

Computation and Language · Computer Science 2021-09-15 Tenghao Huang , Faeze Brahman , Vered Shwartz , Snigdha Chaturvedi

It is well known that the usefulness of a machine learning model is due to its ability to generalize to unseen data. This study uses three popular cyberbullying datasets to explore the effects of data, how it's collected, and how it's…

Machine Learning · Computer Science 2024-12-03 Andrew Root , Liam Jakubowski , Mounika Vanamala

Biases in culture, gender, ethnicity, etc. have existed for decades and have affected many areas of human social interaction. These biases have been shown to impact machine learning (ML) models, and for natural language processing (NLP),…

Computation and Language · Computer Science 2022-09-21 Dhanasekar Sundararaman , Vivek Subramanian

Exposure bias describes the phenomenon that a language model trained under the teacher forcing schema may perform poorly at the inference stage when its predictions are conditioned on its previous predictions unseen from the training…

Computation and Language · Computer Science 2020-04-02 Yifan Xu , Kening Zhang , Haoyu Dong , Yuezhou Sun , Wenlong Zhao , Zhuowen Tu

Modern models for common NLP tasks often employ machine learning techniques and train on journalistic, social media, or other culturally-derived text. These have recently been scrutinized for racial and gender biases, rooting from inherent…

Computation and Language · Computer Science 2026-01-27 Scott Friedman , Sonja Schmer-Galunder , Anthony Chen , Jeffrey Rye

Large Vision-Language Models (LVLMs) have been widely adopted in various applications; however, they exhibit significant gender biases. Existing benchmarks primarily evaluate gender bias at the demographic group level, neglecting individual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yisong Xiao , Aishan Liu , QianJia Cheng , Zhenfei Yin , Siyuan Liang , Jiapeng Li , Jing Shao , Xianglong Liu , Dacheng Tao

Gender bias in large language models has primarily been investigated for English, while languages with grammatical or morphological gender remain comparatively understudied. This paper investigates how and when gender information emerges in…

Computation and Language · Computer Science 2026-05-11 Jonas Klein , Chiara Manna , Eva Vanmassenhove

Label-free model evaluation, or AutoEval, estimates model accuracy on unlabeled test sets, and is critical for understanding model behaviors in various unseen environments. In the absence of image labels, based on dataset representations,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Xiaoxiao Sun , Yunzhong Hou , Hongdong Li , Liang Zheng

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

Computation and Language · Computer Science 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He

Machine learning algorithms are optimized to model statistical properties of the training data. If the input data reflects stereotypes and biases of the broader society, then the output of the learning algorithm also captures these…

Computation and Language · Computer Science 2016-06-21 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

Advances in language modeling architectures and the availability of large text corpora have driven progress in automatic text generation. While this results in models capable of generating coherent texts, it also prompts models to…

Computation and Language · Computer Science 2020-10-09 Po-Sen Huang , Huan Zhang , Ray Jiang , Robert Stanforth , Johannes Welbl , Jack Rae , Vishal Maini , Dani Yogatama , Pushmeet Kohli

Gender bias in artificial intelligence (AI) has emerged as a pressing concern with profound implications for individuals' lives. This paper presents a comprehensive survey that explores gender bias in Transformer models from a linguistic…

Computation and Language · Computer Science 2023-06-21 Praneeth Nemani , Yericherla Deepak Joel , Palla Vijay , Farhana Ferdousi Liza

This work describes a large-scale analysis of sentiment associations in popular word embedding models along the lines of gender and ethnicity but also along the less frequently studied dimensions of socioeconomic status, age, sexual…

Computers and Society · Computer Science 2020-07-01 David Rozado

Speech Integrated Large Language Models (SILLMs) combine large language models with speech perception to perform diverse tasks, such as emotion recognition to speaker verification, demonstrating universal audio understanding capability.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-22 Yi-Cheng Lin , Tzu-Quan Lin , Chih-Kai Yang , Ke-Han Lu , Wei-Chih Chen , Chun-Yi Kuan , Hung-yi Lee

Unintended biases in machine learning (ML) models are among the major concerns that must be addressed to maintain public trust in ML. In this paper, we address process fairness of ML models that consists in reducing the dependence of models…

Machine Learning · Computer Science 2021-08-06 Guilherme Alves , Maxime Amblard , Fabien Bernier , Miguel Couceiro , Amedeo Napoli

With the proliferation of its applications in various industries, sentiment analysis by using publicly available web data has become an active research area in text classification during these years. It is argued by researchers that…

Computation and Language · Computer Science 2013-08-06 Jimmy SJ. Ren , Wei Wang , Jiawei Wang , Stephen Shaoyi Liao

The awareness and mitigation of biases are of fundamental importance for the fair and transparent use of contextual language models, yet they crucially depend on the accurate detection of biases as a precursor. Consequently, numerous bias…

Computation and Language · Computer Science 2022-11-17 Silke Husse , Andreas Spitz

Despite the great promise that machine learning has offered in many fields of medicine, it has also raised concerns about potential biases and poor generalization across genders, age distributions, races and ethnicities, hospitals, and data…

Machine Learning · Computer Science 2023-02-01 Rongguang Wang , Pratik Chaudhari , Christos Davatzikos

Bias can be introduced in diverse ways in machine learning datasets, for example via selection or label bias. Although these bias types in themselves have an influence on important aspects of fair machine learning, their different impact…

Machine Learning · Computer Science 2026-03-11 Magali Legast , Toon Calders , François Fouss