English
Related papers

Related papers: Fair Text Classification with Wasserstein Independ…

200 papers

Artificial intelligence (AI) systems, particularly those based on deep learning models, have increasingly achieved expert-level performance in medical applications. However, there is growing concern that such AI systems may reflect and…

Computation and Language · Computer Science 2025-04-25 Xiuying Chen , Tairan Wang , Juexiao Zhou , Zirui Song , Xin Gao , Xiangliang Zhang

Natural language generation models reproduce and often amplify the biases present in their training data. Previous research explored using sequence-to-sequence rewriting models to transform biased model outputs (or original texts) into more…

Computation and Language · Computer Science 2023-05-19 Chantal Amrhein , Florian Schottmann , Rico Sennrich , Samuel Läubli

Existing bias mitigation methods for DNN models primarily work on learning debiased encoders. This process not only requires a lot of instance-level annotations for sensitive attributes, it also does not guarantee that all fairness…

Machine Learning · Computer Science 2021-10-28 Mengnan Du , Subhabrata Mukherjee , Guanchu Wang , Ruixiang Tang , Ahmed Hassan Awadallah , Xia Hu

Fairness in machine learning seeks to mitigate model bias against individuals based on sensitive features such as sex or age, often caused by an uneven representation of the population in the training data due to selection bias. Notably,…

Machine Learning · Computer Science 2024-10-10 Yasin I. Tepeli , Joana P. Gonçalves

Most NLP datasets are not annotated with protected attributes such as gender, making it difficult to measure classification bias using standard measures of fairness (e.g., equal opportunity). However, manually annotating a large dataset…

Computation and Language · Computer Science 2020-04-28 Kawin Ethayarajh

The rapid developments of various machine learning models and their deployments in several applications has led to discussions around the importance of looking beyond the accuracies of these models. Fairness of such models is one such…

Machine Learning · Computer Science 2024-04-16 Biswajit Rout , Ananya B. Sai , Arun Rajkumar

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

Machine Learning · Statistics 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

Ensuring fairness in data driven decision making has become a central concern across domains such as marketing, lending, and healthcare, but fairness constraints often come at the cost of utility. We propose a statistical hypothesis testing…

Computers and Society · Computer Science 2025-09-25 Yan Chen , Zheng Tan , Jose Blanchet , Hanzhang Qin

It is evident that deep text classification models trained on human data could be biased. In particular, they produce biased outcomes for texts that explicitly include identity terms of certain demographic groups. We refer to this type of…

Computation and Language · Computer Science 2021-05-07 Haochen Liu , Wei Jin , Hamid Karimi , Zitao Liu , Jiliang Tang

The pursuit of fairness in machine learning (ML), ensuring that the models do not exhibit biases toward protected demographic groups, typically results in a compromise scenario. This compromise can be explained by a Pareto frontier where…

Machine Learning · Computer Science 2024-11-11 Jinlong Pang , Jialu Wang , Zhaowei Zhu , Yuanshun Yao , Chen Qian , Yang Liu

As they have a vital effect on social decision-making, AI algorithms not only should be accurate and but also should not pose unfairness against certain sensitive groups (e.g., non-white, women). Various specially designed AI algorithms to…

Machine Learning · Statistics 2023-01-23 Sara Kim , Kyusang Yu , Yongdai Kim

When working with textual data, a natural application of disentangled representations is fair classification where the goal is to make predictions without being biased (or influenced) by sensitive attributes that may be present in the data…

Computation and Language · Computer Science 2022-10-10 Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

In this paper, we address the limitations of existing text-to-image diffusion models in generating demographically fair results when given human-related descriptions. These models often struggle to disentangle the target language context…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Jia Li , Lijie Hu , Jingfeng Zhang , Tianhang Zheng , Hua Zhang , Di Wang

Counterfactual fairness methods address the question: How would the prediction change if the sensitive identity attributes referenced in the text instance were different? These methods are entirely based on generating counterfactuals for…

Computation and Language · Computer Science 2022-03-08 Mohit Wadhwa , Mohan Bhambhani , Ashvini Jindal , Uma Sawant , Ramanujam Madhavan

Debiasing methods in NLP models traditionally focus on isolating information related to a sensitive attribute (e.g., gender or race). We instead argue that a favorable debiasing method should use sensitive information 'fairly,' with…

Computation and Language · Computer Science 2023-10-24 Bodhisattwa Prasad Majumder , Zexue He , Julian McAuley

This work provides several fundamental characterizations of the optimal classification function under the demographic parity constraint. In the awareness framework, akin to the classical unconstrained classification case, we show that…

Machine Learning · Statistics 2022-09-02 Solenne Gaucher , Nicolas Schreuder , Evgenii Chzhen

The fair-ranking problem, which asks to rank a given set of items to maximize utility subject to group fairness constraints, has received attention in the fairness, information retrieval, and machine learning literature. Recent works,…

Machine Learning · Computer Science 2022-12-01 Anay Mehrotra , Nisheeth K. Vishnoi

We present a new data-driven model of fairness that, unlike existing static definitions of individual or group fairness is guided by the unfairness complaints received by the system. Our model supports multiple fairness criteria and takes…

Machine Learning · Computer Science 2020-08-24 Pranjal Awasthi , Corinna Cortes , Yishay Mansour , Mehryar Mohri

Improving fairness between privileged and less-privileged sensitive attribute groups (e.g, {race, gender}) has attracted lots of attention. To enhance the model performs uniformly well in different sensitive attributes, we propose a…

Machine Learning · Computer Science 2022-10-14 Qi Qi , Shervin Ardeshir , Yi Xu , Tianbao Yang

The ability to understand and trust the fairness of model predictions, particularly when considering the outcomes of unprivileged groups, is critical to the deployment and adoption of machine learning systems. SHAP values provide a unified…

Machine Learning · Computer Science 2020-06-29 James M. Hickey , Pietro G. Di Stefano , Vlasios Vasileiou