English
Related papers

Related papers: Counterfactual Augmentation for Multimodal Learnin…

200 papers

We present a novel framework for augmenting data sets for machine learning based on counterexamples. Counterexamples are misclassified examples that have important properties for retraining and improving the model. Key components of our…

The need for interpretability in deep learning has driven interest in counterfactual explanations, which identify minimal changes to an instance that change a model's prediction. Current counterfactual (CF) generation methods require…

Computation and Language · Computer Science 2025-12-11 Van Bach Nguyen , Christin Seifert , Jörg Schlötterer

We propose an architecture for training generative models of counterfactual conditionals of the form, 'can we modify event A to cause B instead of C?', motivated by applications in robot control. Using an 'adversarial training' paradigm, an…

Robotics · Computer Science 2020-09-23 Simón C. Smith , Subramanian Ramamoorthy

The use of machine learning systems to support decision making in healthcare raises questions as to what extent these systems may introduce or exacerbate disparities in care for historically underrepresented and mistreated groups, due to…

Machine Learning · Computer Science 2019-07-16 Stephen Pfohl , Tony Duan , Daisy Yi Ding , Nigam H. Shah

We propose a novel approach to mitigate biases in computer vision models by utilizing counterfactual generation and fine-tuning. While counterfactuals have been used to analyze and address biases in DNN models, the counterfactuals…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Pushkar Shukla , Dhruv Srikanth , Lee Cohen , Matthew Turk

While counterfactual data augmentation offers a promising step towards robust generalization in natural language processing, producing a set of counterfactuals that offer valuable inductive bias for models remains a challenge. Most existing…

Computation and Language · Computer Science 2022-10-25 Phillip Howard , Gadi Singer , Vasudev Lal , Yejin Choi , Swabha Swayamdipta

In recommendation literature, explainability and fairness are becoming two prominent perspectives to consider. However, prior works have mostly addressed them separately, for instance by explaining to consumers why a certain item was…

Information Retrieval · Computer Science 2023-08-24 Ludovico Boratto , Francesco Fabbri , Gianni Fenu , Mirko Marras , Giacomo Medda

Counterfactual explanations for machine learning models are used to find minimal interventions to the feature values such that the model changes the prediction to a different output or a target output. A valid counterfactual explanation…

Machine Learning · Computer Science 2023-03-23 Shravan Kumar Sajja , Sumanta Mukherjee , Satyam Dwivedi

Counterfactual explanations offer actionable insights by illustrating how changes to inputs can lead to different outcomes. However, these explanations often suffer from ambiguity and impracticality, limiting their utility for non-expert…

Human-Computer Interaction · Computer Science 2025-04-22 Aditya Bhattacharya , Tim Vanherwegen , Katrien Verbert

Foundation models trained on web-scraped datasets propagate societal biases to downstream tasks. While counterfactual generation enables bias analysis, existing methods introduce artifacts by modifying contextual elements like clothing and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Kirill Sirotkin , Marcos Escudero-Viñolo , Pablo Carballeira , Mayug Maniparambil , Catarina Barata , Noel E. O'Connor

The class imbalance problem can cause machine learning models to produce an undesirable performance on the minority class as well as the whole dataset. Using data augmentation techniques to increase the number of samples is one way to…

Computation and Language · Computer Science 2023-06-02 Akbar Karimi , Lucie Flek

One of the primary challenges limiting the applicability of deep learning is its susceptibility to learning spurious correlations rather than the underlying mechanisms of the task of interest. The resulting failure to generalise cannot be…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Damien Teney , Ehsan Abbasnedjad , Anton van den Hengel

Data augmentation is one of the most successful techniques to improve the classification accuracy of machine learning models in computer vision. However, applying data augmentation to tabular data is a challenging problem since it is hard…

Machine Learning · Computer Science 2022-07-26 Azhar Mohammed , Dang Nguyen , Bao Duong , Thin Nguyen

Counterfactual explanations are viewed as an effective way to explain machine learning predictions. This interest is reflected by a relatively young literature with already dozens of algorithms aiming to generate such explanations. These…

Machine Learning · Computer Science 2022-12-05 Raphael Mazzine , David Martens

Although pre-trained language models show good performance on various natural language processing tasks, they often rely on non-causal features and patterns to determine the outcome. For natural language inference tasks, previous results…

Computation and Language · Computer Science 2024-10-29 Heerin Yang , Sseung-won Hwang , Jungmin So

Counterfactual data augmentation (CDA) is a method for controlling information or biases in training datasets by generating a complementary dataset with typically opposing biases. Prior work often either relies on hand-crafted rules or…

Machine Learning · Computer Science 2025-02-26 Mitchell Plyler , Min Chi

In the domain of Visual Question Answering (VQA), studies have shown improvement in users' mental model of the VQA system when they are exposed to examples of how these systems answer certain Image-Question (IQ) pairs. In this work, we show…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Kamran Alipour , Arijit Ray , Xiao Lin , Michael Cogswell , Jurgen P. Schulze , Yi Yao , Giedrius T. Burachas

Counterfactuals refer to minimally edited inputs that cause a model's prediction to change, serving as a promising approach to explaining the model's behavior. Large language models (LLMs) excel at generating English counterfactuals and…

Computation and Language · Computer Science 2026-04-07 Qianli Wang , Van Bach Nguyen , Yihong Liu , Fedor Splitt , Nils Feldhus , Christin Seifert , Hinrich Schütze , Sebastian Möller , Vera Schmitt

Despite large-scale pre-trained language models have achieved striking results for text classificaion, recent work has raised concerns about the challenge of shortcut learning. In general, a keyword is regarded as a shortcut if it creates a…

Computation and Language · Computer Science 2023-07-06 Rui Song , Fausto Giunchiglia , Yingji Li , Hao Xu

The growing integration of machine learning (ML) and artificial intelligence (AI) models into high-stakes domains such as healthcare and scientific research calls for models that are not only accurate but also interpretable. Among the…

Machine Learning · Computer Science 2025-10-23 Zhuo Cao , Xuan Zhao , Lena Krieger , Hanno Scharr , Ira Assent