English
Related papers

Related papers: Collapsed Language Models Promote Fairness

200 papers

As NLP models become more integrated with the everyday lives of people, it becomes important to examine the social effect that the usage of these systems has. While these models understand language and have increased accuracy on difficult…

Computation and Language · Computer Science 2022-04-21 Rajas Bansal

Language Models (LMs) have demonstrated exceptional performance across various Natural Language Processing (NLP) tasks. Despite these advancements, LMs can inherit and amplify societal biases related to sensitive attributes such as gender…

Computation and Language · Computer Science 2026-01-16 Zhipeng Yin , Zichong Wang , Avash Palikhe , Wenbin Zhang

Large language models (LLMs), despite their remarkable capabilities, are susceptible to generating biased and discriminatory responses. As LLMs increasingly influence high-stakes decision-making (e.g., hiring and healthcare), mitigating…

Computation and Language · Computer Science 2025-03-04 Jingling Li , Zeyu Tang , Xiaoyu Liu , Peter Spirtes , Kun Zhang , Liu Leqi , Yang Liu

As language models are increasingly included in human-facing machine learning tools, bias against demographic subgroups has gained attention. We propose FineDeb, a two-phase debiasing framework for language models that starts with…

Computation and Language · Computer Science 2023-02-07 Akash Saravanan , Dhruv Mullick , Habibur Rahman , Nidhi Hegde

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

Machine Learning · Statistics 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

The recent advancements in Deep Learning models and techniques have led to significant strides in performance across diverse tasks and modalities. However, while the overall capabilities of models show promising growth, our understanding of…

Artificial Intelligence · Computer Science 2025-04-04 Erik Arakelyan

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

Computation and Language · Computer Science 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

An increasing awareness of biased patterns in natural language processing resources, like BERT, has motivated many metrics to quantify `bias' and `fairness'. But comparing the results of different metrics and the works that evaluate with…

Computation and Language · Computer Science 2021-12-15 Pieter Delobelle , Ewoenam Kwaku Tokpo , Toon Calders , Bettina Berendt

Machine learning systems produce biased results towards certain demographic groups, known as the fairness problem. Recent approaches to tackle this problem learn a latent code (i.e., representation) through disentangled representation…

Machine Learning · Computer Science 2023-09-06 Jindi Zhang , Luning Wang , Dan Su , Yongxiang Huang , Caleb Chen Cao , Lei Chen

The popularity of pretrained language models in natural language processing systems calls for a careful evaluation of such models in down-stream tasks, which have a higher potential for societal impact. The evaluation of such systems…

Computation and Language · Computer Science 2022-04-15 Ioana Baldini , Dennis Wei , Karthikeyan Natesan Ramamurthy , Mikhail Yurochkin , Moninder Singh

Transferability estimation aims to provide heuristics for quantifying how suitable a pre-trained model is for a specific downstream task, without fine-tuning them all. Prior studies have revealed that well-trained models exhibit the…

Machine Learning · Computer Science 2023-10-10 Yuhe Ding , Bo Jiang , Lijun Sheng , Aihua Zheng , Jian Liang

Traditional approaches to learning fair machine learning models often require rebuilding models from scratch, typically without considering potentially existing models. In a context where models need to be retrained frequently, this can…

Machine Learning · Computer Science 2025-07-22 Federico Di Gennaro , Thibault Laugel , Vincent Grari , Marcin Detyniecki

We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we first translate existing…

Machine Learning · Computer Science 2020-12-22 Aditya Jain , Manish Ravula , Joydeep Ghosh

As machine learning algorithms have been widely deployed across applications, many concerns have been raised over the fairness of their predictions, especially in high stakes settings (such as facial recognition and medical imaging). To…

Machine Learning · Computer Science 2021-02-16 Valeriia Cherepanova , Vedant Nanda , Micah Goldblum , John P. Dickerson , Tom Goldstein

To reduce human error and prejudice, many high-stakes decisions have been turned over to machine algorithms. However, recent research suggests that this does not remove discrimination, and can perpetuate harmful stereotypes. While…

Computers and Society · Computer Science 2019-12-18 Yuzi He , Keith Burghardt , Kristina Lerman

With language models becoming increasingly ubiquitous, it has become essential to address their inequitable treatment of diverse demographic groups and factors. Most research on evaluating and mitigating fairness harms has been concentrated…

Computation and Language · Computer Science 2023-03-01 Krithika Ramesh , Sunayana Sitaram , Monojit Choudhury

With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated…

Computation and Language · Computer Science 2021-12-13 Lei Ding , Dengdeng Yu , Jinhan Xie , Wenxing Guo , Shenggang Hu , Meichen Liu , Linglong Kong , Hongsheng Dai , Yanchun Bao , Bei Jiang

Machine learning models are becoming pervasive in high-stakes applications. Despite their clear benefits in terms of performance, the models could show discrimination against minority groups and result in fairness issues in a…

Machine Learning · Computer Science 2022-04-12 Mingyang Wan , Daochen Zha , Ninghao Liu , Na Zou

The pursuit of fairness in machine learning models has emerged as a critical research challenge in different applications ranging from bank loan approval to face detection. Despite the widespread adoption of artificial intelligence…

Machine Learning · Computer Science 2023-11-08 Modar Sulaiman , Kallol Roy

While deep learning models are making fast progress on the task of Natural Language Inference, recent studies have also shown that these models achieve high accuracy by exploiting several dataset biases, and without deep understanding of…

Computation and Language · Computer Science 2020-05-15 Xiang Zhou , Mohit Bansal