English
Related papers

Related papers: Explaining The Efficacy of Counterfactually Augmen…

200 papers

While pretrained language models achieve excellent performance on natural language understanding benchmarks, they tend to rely on spurious correlations and generalize poorly to out-of-distribution (OOD) data. Recent work has explored using…

Computation and Language · Computer Science 2022-03-17 Nitish Joshi , He He

In real-world machine learning systems, labels are often derived from user behaviors that the system wishes to encourage. Over time, new models must be trained as new training examples and features become available. However, feedback loops…

Machine Learning · Computer Science 2023-11-01 Victoria Lin , Louis-Philippe Morency , Dimitrios Dimitriadis , Srinagesh Sharma

As NLP models are increasingly deployed in socially situated settings such as online abusive content detection, it is crucial to ensure that these models are robust. One way of improving model robustness is to generate counterfactually…

Computers and Society · Computer Science 2021-09-16 Indira Sen , Mattia Samory , Fabian Floeck , Claudia Wagner , Isabelle Augenstein

Counterfactually Augmented Data (CAD) involves creating new data samples by applying minimal yet sufficient modifications to flip the label of existing data samples to other classes. Training with CAD enhances model robustness against…

Machine Learning · Computer Science 2024-06-12 Xiaoqi Qiu , Yongjie Wang , Xu Guo , Zhiwei Zeng , Yue Yu , Yuhong Feng , Chunyan Miao

Counterfactually Augmented Data (CAD) aims to improve out-of-domain generalizability, an indicator of model robustness. The improvement is credited with promoting core features of the construct over spurious artifacts that happen to…

Computation and Language · Computer Science 2022-05-10 Indira Sen , Mattia Samory , Claudia Wagner , Isabelle Augenstein

The reliance of text classifiers on spurious correlations can lead to poor generalization at deployment, raising concerns about their use in safety-critical domains such as healthcare. In this work, we propose to use counterfactual data…

Machine Learning · Computer Science 2024-01-10 Amir Feder , Yoav Wald , Claudia Shi , Suchi Saria , David Blei

Despite the success of machine learning applications in science, industry, and society in general, many approaches are known to be non-robust, often relying on spurious correlations to make predictions. Spuriousness occurs when some…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Chun-Hao Chang , George Alexandru Adam , Anna Goldenberg

Despite alarm over the reliance of machine learning systems on so-called spurious patterns, the term lacks coherent meaning in standard statistical frameworks. However, the language of causality offers clarity: spurious associations are due…

Computation and Language · Computer Science 2020-02-18 Divyansh Kaushik , Eduard Hovy , Zachary C. Lipton

NLP models are used in a variety of critical social computing tasks, such as detecting sexist, racist, or otherwise hateful content. Therefore, it is imperative that these models are robust to spurious features. Past work has attempted to…

Computation and Language · Computer Science 2024-02-27 Indira Sen , Dennis Assenmacher , Mattia Samory , Isabelle Augenstein , Wil van der Aalst , Claudia Wagner

Causal generative modelling is gaining interest in medical imaging due to its ability to answer interventional and counterfactual queries. Most work focuses on generating counterfactual images that look plausible, using auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Tian Xia , Mélanie Roschewitz , Fabio De Sousa Ribeiro , Charles Jones , Ben Glocker

Rationales, snippets of extracted text that explain an inference, have emerged as a popular framework for interpretable natural language processing (NLP). Rationale models typically consist of two cooperating modules: a selector and a…

Computation and Language · Computer Science 2022-01-17 Mitchell Plyler , Michael Green , Min Chi

While state-of-the-art NLP models have been achieving the excellent performance of a wide range of tasks in recent years, important questions are being raised about their robustness and their underlying sensitivity to systematic biases that…

Computation and Language · Computer Science 2022-03-25 Linyi Yang , Jiazheng Li , Pádraig Cunningham , Yue Zhang , Barry Smyth , Ruihai Dong

Counterfactual statements, which describe events that did not or cannot take place, are beneficial to numerous NLP applications. Hence, we consider the problem of counterfactual detection (CFD) and seek to enhance the CFD models. Previous…

Computation and Language · Computer Science 2024-10-01 Thong Nguyen , Truc-My Nguyen

Counterfactual Data Augmentation (CDA) is a commonly used technique for improving robustness in natural language classifiers. However, one fundamental challenge is how to discover meaningful counterfactuals and efficiently label them, with…

Computation and Language · Computer Science 2023-05-24 Ananth Balashankar , Xuezhi Wang , Yao Qin , Ben Packer , Nithum Thain , Jilin Chen , Ed H. Chi , Alex Beutel

Recent studies have shown the impressive efficacy of counterfactually augmented data (CAD) for reducing NLU models' reliance on spurious features and improving their generalizability. However, current methods still heavily rely on human…

Artificial Intelligence · Computer Science 2022-11-30 Jiaxin Wen , Yeshuang Zhu , Jinchao Zhang , Jie Zhou , Minlie Huang

Machine learning models are prone to capturing the spurious correlations between non-causal attributes and classes, with counterfactual data augmentation being a promising direction for breaking these spurious associations. However,…

Machine Learning · Computer Science 2025-07-11 Xiaoling Zhou , Ou Wu , Michael K. Ng

Offline data are both valuable and practical resources for teaching robots complex behaviors. Ideally, learning agents should not be constrained by the scarcity of available demonstrations, but rather generalize beyond the training…

Machine Learning · Computer Science 2024-12-13 Núria Armengol Urpí , Marco Bagatella , Marin Vlastelica , Georg Martius

Label noise is common in large real-world datasets, and its presence harms the training process of deep neural networks. Although several works have focused on the training strategies to address this problem, there are few studies that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Emeson Santana , Gustavo Carneiro , Filipe R. Cordeiro

Data augmentation integrates domain knowledge into a dataset by making domain-informed modifications to existing data points. For example, image data can be augmented by duplicating images in different tints or orientations, thereby…

Machine Learning · Computer Science 2026-03-17 Mateusz Gajewski , Sophia Xiao , Bijan Mazaheri

Consider the problem of estimating the causal effect of some attribute of a text document; for example: what effect does writing a polite vs. rude email have on response time? To estimate a causal effect from observational data, we need to…

Machine Learning · Statistics 2023-02-09 Lin Gui , Victor Veitch
‹ Prev 1 2 3 10 Next ›