English
Related papers

Related papers: Language Models Get a Gender Makeover: Mitigating …

200 papers

Medical systems in general, and patient treatment decisions and outcomes in particular, are affected by bias based on gender and other demographic elements. As language models are increasingly applied to medicine, there is a growing…

Computation and Language · Computer Science 2021-03-11 Joshua R. Minot , Nicholas Cheney , Marc Maier , Danne C. Elbers , Christopher M. Danforth , Peter Sheridan Dodds

Data-driven predictive solutions predominant in commercial applications tend to suffer from biases and stereotypes, which raises equity concerns. Prediction models may discover, use, or amplify spurious correlations based on gender or other…

Computation and Language · Computer Science 2022-11-28 Abdelrahman Zayed , Prasanna Parthasarathi , Goncalo Mordido , Hamid Palangi , Samira Shabanian , Sarath Chandar

As language models have a greater impact on society, it is important to ensure they are aligned to a diverse range of perspectives and are able to reflect nuance in human values. However, the most popular training paradigms for modern…

Computation and Language · Computer Science 2025-10-21 Chu Fei Luo , Samuel Dahan , Xiaodan Zhu

We introduce BitFit, a sparse-finetuning method where only the bias-terms of the model (or a subset of them) are being modified. We show that with small-to-medium training data, applying BitFit on pre-trained BERT models is competitive with…

Machine Learning · Computer Science 2026-01-30 Elad Ben-Zaken , Shauli Ravfogel , Yoav Goldberg

Pre-trained models have revolutionized natural language understanding. However, researchers have found they can encode artifacts undesired in many applications, such as professions correlating with one gender more than another. We explore…

Computation and Language · Computer Science 2021-03-04 Kellie Webster , Xuezhi Wang , Ian Tenney , Alex Beutel , Emily Pitler , Ellie Pavlick , Jilin Chen , Ed Chi , Slav Petrov

Diffusion-based text-to-image models have rapidly gained popularity for their ability to generate detailed and realistic images from textual descriptions. However, these models often reflect the biases present in their training data,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Hidir Yesiltepe , Kiymet Akdemir , Pinar Yanardag

With the swift advancement of deep learning, state-of-the-art algorithms have been utilized in various social situations. Nonetheless, some algorithms have been discovered to exhibit biases and provide unequal results. The current debiasing…

Machine Learning · Computer Science 2024-07-02 Shangxi Wu , Qiuyang He , Jian Yu , Jitao Sang

While Large Language Models achieve state-of-the-art results across a wide range of NLP tasks, they remain prone to systematic biases. Among these, gender bias is particularly salient in MT, due to systematic differences across languages in…

Computation and Language · Computer Science 2026-03-19 Chiara Manna , Hosein Mohebbi , Afra Alishahi , Frédéric Blain , Eva Vanmassenhove

As Natural Language Processing (NLP) and Machine Learning (ML) tools rise in popularity, it becomes increasingly vital to recognize the role they play in shaping societal biases and stereotypes. Although NLP models have shown success in…

Computation and Language · Computer Science 2019-06-24 Tony Sun , Andrew Gaut , Shirlyn Tang , Yuxin Huang , Mai ElSherief , Jieyu Zhao , Diba Mirza , Elizabeth Belding , Kai-Wei Chang , William Yang Wang

Masked language models pick up gender biases during pre-training. Such biases are usually attributed to a certain model architecture and its pre-training corpora, with the implicit assumption that other variations in the pre-training…

Computation and Language · Computer Science 2022-11-29 Kenan Tang , Hanchun Jiang

Language Models have ushered a new age of AI gaining traction within the NLP community as well as amongst the general population. AI's ability to make predictions, generations and its applications in sensitive decision-making scenarios,…

Computation and Language · Computer Science 2023-11-28 Ananya Malik

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

Computation and Language · Computer Science 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

Vision Language Models achieve impressive multi-modal performance but often inherit gender biases from their training data. This bias might be coming from both the vision and text modalities. In this work, we dissect the contributions of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Vivek Hruday Kavuri , Vysishtya Karanam , Venkata Jahnavi Venkamsetty , Kriti Madumadukala , Lakshmipathi Balaji Darur , Ponnurangam Kumaraguru

Large pretrained Transformer language models have been shown to exhibit zero-shot generalization, i.e. they can perform a wide variety of tasks that they were not explicitly trained on. However, the architectures and pretraining objectives…

Computation and Language · Computer Science 2022-04-13 Thomas Wang , Adam Roberts , Daniel Hesslow , Teven Le Scao , Hyung Won Chung , Iz Beltagy , Julien Launay , Colin Raffel

Machine learning models can fail on subgroups that are underrepresented during training. While techniques such as dataset balancing can improve performance on underperforming groups, they require access to training group annotations and can…

Machine Learning · Computer Science 2024-06-25 Saachi Jain , Kimia Hamidieh , Kristian Georgiev , Andrew Ilyas , Marzyeh Ghassemi , Aleksander Madry

Although Large Language Models (LLMs) demonstrate remarkable reasoning capabilities, inherent social biases often cascade throughout the Chain-of-Thought (CoT) process, leading to continuous "Bias Propagation". Existing debiasing methods…

Computation and Language · Computer Science 2026-05-12 Xuan Feng , Shuai Zhao , Luwei Xiao , Tianlong Gu , Bo An

Large Language Models (LLMs) are prone to generating content that exhibits gender biases, raising significant ethical concerns. Alignment, the process of fine-tuning LLMs to better align with desired behaviors, is recognized as an effective…

Computation and Language · Computer Science 2024-12-17 Tao Zhang , Ziqian Zeng , Yuxiang Xiao , Huiping Zhuang , Cen Chen , James Foulds , Shimei Pan

Large pre-trained language models have become a crucial backbone for many downstream tasks in natural language processing (NLP), and while they are trained on a plethora of data containing a variety of biases, such as gender biases, it has…

Machine Learning · Computer Science 2026-01-22 Rick Wilming , Artur Dox , Hjalmar Schulz , Marta Oliveira , Benedict Clark , Stefan Haufe

Despite their impressive performance in a wide range of NLP tasks, Large Language Models (LLMs) have been reported to encode worrying-levels of gender biases. Prior work has proposed debiasing methods that require human labelled examples,…

Computation and Language · Computer Science 2024-02-21 Daisuke Oba , Masahiro Kaneko , Danushka Bollegala

Speech emotion recognition (SER) systems often exhibit gender bias. However, the effectiveness and robustness of existing debiasing methods in such multi-label scenarios remain underexplored. To address this gap, we present EMO-Debias, a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-06 Yi-Cheng Lin , Huang-Cheng Chou , Yu-Hsuan Li Liang , Hung-yi Lee
‹ Prev 1 3 4 5 6 7 10 Next ›