English
Related papers

Related papers: Counterfactual Fairness in Text Classification thr…

200 papers

Counterfactual fairness methods address the question: How would the prediction change if the sensitive identity attributes referenced in the text instance were different? These methods are entirely based on generating counterfactuals for…

Computation and Language · Computer Science 2022-03-08 Mohit Wadhwa , Mohan Bhambhani , Ashvini Jindal , Uma Sawant , Ramanujam Madhavan

Counterfactual fairness requires that a person would have been classified in the same way by an AI or other algorithmic system if they had a different protected class, such as a different race or gender. This is an intuitive standard, as…

Machine Learning · Computer Science 2023-10-31 Jacy Reese Anthis , Victor Veitch

With the rapid growth in language processing applications, fairness has emerged as an important consideration in data-driven solutions. Although various fairness definitions have been explored in the recent literature, there is lack of…

Machine Learning · Computer Science 2022-03-17 Satyapriya Krishna , Rahul Gupta , Apurv Verma , Jwala Dhamala , Yada Pruksachatkun , Kai-Wei Chang

A common approach for testing fairness issues in text-based classifiers is through the use of counterfactuals: does the classifier output change if a sensitive attribute in the input is changed? Existing counterfactual generation methods…

Computation and Language · Computer Science 2022-06-29 Zee Fryer , Vera Axelrod , Ben Packer , Alex Beutel , Jilin Chen , Kellie Webster

Contrastive representation learning has gained much attention due to its superior performance in learning representations from both image and sequential data. However, the learned representations could potentially lead to performance…

Computation and Language · Computer Science 2022-11-01 Jianfeng Chi , William Shand , Yaodong Yu , Kai-Wei Chang , Han Zhao , Yuan Tian

The counterfactual token generation has been limited to perturbing only a single token in texts that are generally short and single sentences. These tokens are often associated with one of many sensitive attributes. With limited…

Computation and Language · Computer Science 2022-02-10 Pranay Lohia

Machine learning can impact people with legal or ethical consequences when it is used to automate decisions in areas such as insurance, lending, hiring, and predictive policing. In many of these scenarios, previous decisions have been made…

Machine Learning · Statistics 2018-03-09 Matt J. Kusner , Joshua R. Loftus , Chris Russell , Ricardo Silva

As AI-based systems increasingly impact many areas of our lives, auditing these systems for fairness is an increasingly high-stakes problem. Traditional group fairness metrics can miss discrimination against individuals and are difficult to…

Machine Learning · Computer Science 2022-02-10 Krystal Maughan , Ivoline C. Ngong , Joseph P. Near

Mitigating algorithmic bias is a critical task in the development and deployment of machine learning models. While several toolkits exist to aid machine learning practitioners in addressing fairness issues, little is known about the…

Human-Computer Interaction · Computer Science 2023-03-02 Zahra Ashktorab , Benjamin Hoover , Mayank Agarwal , Casey Dugan , Werner Geyer , Hao Bang Yang , Mikhail Yurochkin

Text classifiers have promising applications in high-stake tasks such as resume screening and content moderation. These classifiers must be fair and avoid discriminatory decisions by being invariant to perturbations of sensitive attributes…

Computation and Language · Computer Science 2023-03-17 Florian E. Dorner , Momchil Peychev , Nikola Konstantinov , Naman Goel , Elliott Ash , Martin Vechev

Group fairness is a central research topic in text classification, where reaching fair treatment between sensitive groups (e.g. women vs. men) remains an open challenge. This paper presents a novel method for mitigating biases in neural…

Computation and Language · Computer Science 2023-11-22 Thibaud Leteno , Antoine Gourru , Charlotte Laclau , Rémi Emonet , Christophe Gravier

Fair machine learning aims to mitigate the biases of model predictions against certain subpopulations regarding sensitive attributes such as race and gender. Among the many existing fairness notions, counterfactual fairness measures the…

Machine Learning · Computer Science 2022-01-12 Jing Ma , Ruocheng Guo , Mengting Wan , Longqi Yang , Aidong Zhang , Jundong Li

As machine learning (ML) algorithms are used in applications that involve humans, concerns have arisen that these algorithms may be biased against certain social groups. \textit{Counterfactual fairness} (CF) is a fairness notion proposed in…

Machine Learning · Computer Science 2024-12-03 Zhiqun Zuo , Tian Xie , Xuwei Tan , Xueru Zhang , Mohammad Mahdi Khalili

Fairness-aware machine learning has attracted a surge of attention in many domains, such as online advertising, personalized recommendation, and social media analysis in web applications. Fairness-aware machine learning aims to eliminate…

Machine Learning · Computer Science 2023-07-18 Jing Ma , Ruocheng Guo , Aidong Zhang , Jundong Li

In this paper we look at popular fairness methods that use causal counterfactuals. These methods capture the intuitive notion that a prediction is fair if it coincides with the prediction that would have been made if someone's race, gender…

Machine Learning · Statistics 2022-12-12 Jake Fawkes , Robin Evans , Dino Sejdinovic

Spurious correlations threaten the validity of statistical classifiers. While model accuracy may appear high when the test data is from the same distribution as the training data, it can quickly degrade when the test distribution changes.…

Machine Learning · Computer Science 2020-12-21 Zhao Wang , Aron Culotta

Group fairness is a central research topic in text classification, where reaching fair treatment between sensitive groups (e.g., women and men) remains an open challenge. We propose an approach that extends the use of the Wasserstein…

Machine Learning · Computer Science 2025-12-08 Thibaud Leteno , Michael Perrot , Charlotte Laclau , Antoine Gourru , Christophe Gravier

The use of machine learning models in high-stake applications (e.g., healthcare, lending, college admission) has raised growing concerns due to potential biases against protected social groups. Various fairness notions and methods have been…

Machine Learning · Computer Science 2023-11-10 Zhiqun Zuo , Mohammad Mahdi Khalili , Xueru Zhang

In high-stake domains such as healthcare and hiring, the role of machine learning (ML) in decision-making raises significant fairness concerns. This work focuses on Counterfactual Fairness (CF), which posits that an ML model's outcome on…

Machine Learning · Computer Science 2025-01-23 Zeyu Zhou , Tianci Liu , Ruqi Bai , Jing Gao , Murat Kocaoglu , David I. Inouye

The popularity of pretrained language models in natural language processing systems calls for a careful evaluation of such models in down-stream tasks, which have a higher potential for societal impact. The evaluation of such systems…

Computation and Language · Computer Science 2022-04-15 Ioana Baldini , Dennis Wei , Karthikeyan Natesan Ramamurthy , Mikhail Yurochkin , Moninder Singh
‹ Prev 1 2 3 10 Next ›