English
Related papers

Related papers: Automatic Counterfactual Augmentation for Robust T…

200 papers

Counterfactual reasoning is an important paradigm applicable in many fields, such as healthcare, economics, and education. In this work, we propose a novel method to address the issue of \textit{selection bias}. We learn two groups of…

Machine Learning · Computer Science 2019-12-20 Zichen Zhang , Qingfeng Lan , Lei Ding , Yue Wang , Negar Hassanpour , Russell Greiner

For text classification tasks, finetuned language models perform remarkably well. Yet, they tend to rely on spurious patterns in training data, thus limiting their performance on out-of-distribution (OOD) test data. Among recent models…

Computation and Language · Computer Science 2022-10-24 Maarten De Raedt , Fréderic Godin , Chris Develder , Thomas Demeester

This paper proposes a novel framework to reinforce classification models using language-guided generated counterfactual images. Deep learning classification models are often trained using datasets that mirror real-world scenarios. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xiang Li , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Despite significant progress has been achieved in text summarization, factual inconsistency in generated summaries still severely limits its practical applications. Among the key factors to ensure factual consistency, a reliable automatic…

Computation and Language · Computer Science 2021-09-09 Yuexiang Xie , Fei Sun , Yang Deng , Yaliang Li , Bolin Ding

Automatic multi-hop fact verification task has gained significant attention in recent years. Despite impressive results, these well-designed models perform poorly on out-of-domain data. One possible solution is to augment the training data…

Computation and Language · Computer Science 2023-10-24 Yingjie Zhu , Jiasheng Si , Yibo Zhao , Haiyang Zhu , Deyu Zhou , Yulan He

Recent work on language model self-improvement shows that models can refine their own reasoning through reflection, verification, debate, or self-generated rewards. However, most existing approaches rely on external critics, learned reward…

Artificial Intelligence · Computer Science 2026-01-06 Mandar Parab

Clustering algorithms rely on complex optimisation processes that may be difficult to comprehend, especially for individuals who lack technical expertise. While many explainable artificial intelligence techniques exist for supervised…

Machine Learning · Computer Science 2024-09-20 Aurora Spagnol , Kacper Sokol , Pietro Barbiero , Marc Langheinrich , Martin Gjoreski

Currently, there is a significant amount of research being conducted in the field of artificial intelligence to improve the explainability and interpretability of deep learning models. It is found that if end-users understand the reason for…

Information Retrieval · Computer Science 2023-06-02 Niloofar Ranjbar , Saeedeh Momtazi , MohammadMehdi Homayounpour

Counterfactual instances are a powerful tool to obtain valuable insights into automated decision processes, describing the necessary minimal changes in the input space to alter the prediction towards a desired target. Most previous…

Machine Learning · Computer Science 2021-06-07 Robert-Florian Samoilescu , Arnaud Van Looveren , Janis Klaise

Conventional audio classification relied on predefined classes, lacking the ability to learn from free-form text. Recent methods unlock learning joint audio-text embeddings from raw audio-text pairs describing audio in natural language.…

Multimedia · Computer Science 2024-01-11 Ali Vosoughi , Luca Bondi , Ho-Hsiang Wu , Chenliang Xu

Counterfactual explanations describe how to modify a feature vector in order to flip the outcome of a trained classifier. Obtaining robust counterfactual explanations is essential to provide valid algorithmic recourse and meaningful…

Machine Learning · Computer Science 2024-03-22 Alexandre Forel , Axel Parmentier , Thibaut Vidal

Rationales, snippets of extracted text that explain an inference, have emerged as a popular framework for interpretable natural language processing (NLP). Rationale models typically consist of two cooperating modules: a selector and a…

Computation and Language · Computer Science 2022-01-17 Mitchell Plyler , Michael Green , Min Chi

Counterfactual explanations are one of the most popular methods to make predictions of black box machine learning models interpretable by providing explanations in the form of `what-if scenarios'. Most current approaches optimize a…

Machine Learning · Statistics 2020-10-16 Susanne Dandl , Christoph Molnar , Martin Binder , Bernd Bischl

A challenge in mitigating social bias in fine-tuned language models (LMs) is the potential reduction in language modeling capability, which can harm downstream performance. Counterfactual data augmentation (CDA), a widely used method for…

Computation and Language · Computer Science 2026-02-11 Shweta Parihar , Liu Guangliang , Natalie Parde , Lu Cheng

Approaches for mitigating bias in supervised models are designed to reduce models' dependence on specific sensitive features of the input data, e.g., mentioned social groups. However, in the case of hate speech detection, it is not always…

Computation and Language · Computer Science 2020-10-27 Aida Mostafazadeh Davani , Ali Omrani , Brendan Kennedy , Mohammad Atari , Xiang Ren , Morteza Dehghani

Recently, prefix-tuning was proposed to efficiently adapt pre-trained language models to a broad spectrum of natural language classification tasks. It leverages soft prefix as task-specific indicators and language verbalizers as…

Computation and Language · Computer Science 2024-02-14 Yang Li , Canran Xu , Guodong Long , Tao Shen , Chongyang Tao , Jing Jiang

Large language models (LLMs) have transformed natural language processing (NLP), enabling diverse applications by integrating large-scale pre-trained knowledge. However, their static knowledge limits dynamic reasoning over external…

Computation and Language · Computer Science 2025-09-26 Harshad Khadilkar , Abhay Gupta

In attempts to produce ML models less reliant on spurious patterns in NLP datasets, researchers have recently proposed curating counterfactually augmented data (CAD) via a human-in-the-loop process in which given some documents and their…

Computation and Language · Computer Science 2021-03-25 Divyansh Kaushik , Amrith Setlur , Eduard Hovy , Zachary C. Lipton

Despite the widespread adoption of autoregressive language models, explainability evaluation research has predominantly focused on span infilling and masked language models. Evaluating the faithfulness of an explanation method -- how…

Computation and Language · Computer Science 2025-03-11 Sepehr Kamahi , Yadollah Yaghoobzadeh

In text classification tasks, models often rely on spurious correlations for predictions, incorrectly associating irrelevant features with the target labels. This issue limits the robustness and generalization of models, especially when…

Machine Learning · Computer Science 2025-02-04 Yuqing Zhou , Ziwei Zhu