English
Related papers

Related papers: Counterfactual Multi-Token Fairness in Text Classi…

200 papers

Natural language counterfactual generation aims to minimally modify a given text such that the modified text will be classified into a different class. The generated counterfactuals provide insight into the reasoning behind a model's…

Computation and Language · Computer Science 2024-10-08 Yongjie Wang , Xiaoqi Qiu , Yu Yue , Xu Guo , Zhiwei Zeng , Yuhong Feng , Zhiqi Shen

A common approach for testing fairness issues in text-based classifiers is through the use of counterfactuals: does the classifier output change if a sensitive attribute in the input is changed? Existing counterfactual generation methods…

Computation and Language · Computer Science 2022-06-29 Zee Fryer , Vera Axelrod , Ben Packer , Alex Beutel , Jilin Chen , Kellie Webster

Counterfactual fairness methods address the question: How would the prediction change if the sensitive identity attributes referenced in the text instance were different? These methods are entirely based on generating counterfactuals for…

Computation and Language · Computer Science 2022-03-08 Mohit Wadhwa , Mohan Bhambhani , Ashvini Jindal , Uma Sawant , Ramanujam Madhavan

As language models become increasingly integrated into our digital lives, Personalized Text Generation (PTG) has emerged as a pivotal component with a wide range of applications. However, the bias inherent in user written text, often used…

Computation and Language · Computer Science 2023-10-24 Nan Wang , Qifan Wang , Yi-Chia Wang , Maziar Sanjabi , Jingzhou Liu , Hamed Firooz , Hongning Wang , Shaoliang Nie

Despite large-scale pre-trained language models have achieved striking results for text classificaion, recent work has raised concerns about the challenge of shortcut learning. In general, a keyword is regarded as a shortcut if it creates a…

Computation and Language · Computer Science 2023-07-06 Rui Song , Fausto Giunchiglia , Yingji Li , Hao Xu

Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in providing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Kamran Alipour , Aditya Lahiri , Ehsan Adeli , Babak Salimi , Michael Pazzani

Providing explanations about how machine learning algorithms work and/or make particular predictions is one of the main tools that can be used to improve their trusworthiness, fairness and robustness. Among the most intuitive type of…

Machine Learning · Computer Science 2024-04-12 Rubén Ruiz-Torrubiano

A machine learning model, under the influence of observed or unobserved confounders in the training data, can learn spurious correlations and fail to generalize when deployed. For image classifiers, augmenting a training dataset using…

Machine Learning · Computer Science 2022-12-13 Abbavaram Gowtham Reddy , Saloni Dash , Amit Sharma , Vineeth N Balasubramanian

Counterfactual explanations promote explainability in machine learning models by answering the question "how should an input instance be perturbed to obtain a desired predicted label?". The comparison of this instance before and after…

Machine Learning · Computer Science 2022-11-09 Jing Ma , Ruocheng Guo , Saumitra Mishra , Aidong Zhang , Jundong Li

Counterfactual generation lies at the core of various machine learning tasks, including image translation and controllable text generation. This generation process usually requires the identification of the disentangled latent…

Machine Learning · Computer Science 2024-02-26 Hanqi Yan , Lingjing Kong , Lin Gui , Yuejie Chi , Eric Xing , Yulan He , Kun Zhang

In this paper, we study counterfactual fairness in text classification, which asks the question: How would the prediction change if the sensitive attribute referenced in the example were different? Toxicity classifiers demonstrate a…

Machine Learning · Computer Science 2019-02-15 Sahaj Garg , Vincent Perot , Nicole Limtiaco , Ankur Taly , Ed H. Chi , Alex Beutel

Counterfactual explanations are viewed as an effective way to explain machine learning predictions. This interest is reflected by a relatively young literature with already dozens of algorithms aiming to generate such explanations. These…

Machine Learning · Computer Science 2022-12-05 Raphael Mazzine , David Martens

Machine Learning has seen tremendous growth recently, which has led to larger adoption of ML systems for educational assessments, credit risk, healthcare, employment, criminal justice, to name a few. The trustworthiness of ML and NLP…

Computation and Language · Computer Science 2021-03-19 Nishtha Madaan , Inkit Padhi , Naveen Panwar , Diptikalyan Saha

With the wide use of deep neural networks (DNN), model interpretability has become a critical concern, since explainable decisions are preferred in high-stake scenarios. Current interpretation techniques mainly focus on the feature…

Machine Learning · Computer Science 2021-01-19 Fan Yang , Ninghao Liu , Mengnan Du , Xia Hu

Explainability for machine learning models has gained considerable attention within the research community given the importance of deploying more reliable machine-learning systems. In computer vision applications, generative counterfactual…

Machine Learning · Computer Science 2021-11-12 Pau Rodriguez , Massimo Caccia , Alexandre Lacoste , Lee Zamparo , Issam Laradji , Laurent Charlin , David Vazquez

Foundation models trained on web-scraped datasets propagate societal biases to downstream tasks. While counterfactual generation enables bias analysis, existing methods introduce artifacts by modifying contextual elements like clothing and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Kirill Sirotkin , Marcos Escudero-Viñolo , Pablo Carballeira , Mayug Maniparambil , Catarina Barata , Noel E. O'Connor

Machine Learning systems are increasingly prevalent across healthcare, law enforcement, and finance but often operate on historical data, which may carry biases against certain demographic groups. Causal and counterfactual fairness provides…

Machine Learning · Computer Science 2024-07-09 Jake Robertson , Noah Hollmann , Noor Awad , Frank Hutter

Counterfactual explanations shed light on the decisions of black-box models by explaining how an input can be altered to obtain a favourable decision from the model (e.g., when a loan application has been rejected). However, as noted…

Machine Learning · Computer Science 2023-12-13 Francesco Leofante , Nico Potyka

In the environment of fair lending laws and the General Data Protection Regulation (GDPR), the ability to explain a model's prediction is of paramount importance. High quality explanations are the first step in assessing fairness.…

Machine Learning · Computer Science 2021-06-23 Rachana Balasubramanian , Samuel Sharpe , Brian Barr , Jason Wittenbach , C. Bayan Bruss

Approaches for mitigating bias in supervised models are designed to reduce models' dependence on specific sensitive features of the input data, e.g., mentioned social groups. However, in the case of hate speech detection, it is not always…

Computation and Language · Computer Science 2020-10-27 Aida Mostafazadeh Davani , Ali Omrani , Brendan Kennedy , Mohammad Atari , Xiang Ren , Morteza Dehghani
‹ Prev 1 2 3 10 Next ›