English
Related papers

Related papers: Improving Classifier Robustness through Active Gen…

200 papers

We propose a novel data augmentation for labeled sentences called contextual augmentation. We assume an invariance that sentences are natural even if the words in the sentences are replaced with other words with paradigmatic relations. We…

Computation and Language · Computer Science 2018-05-17 Sosuke Kobayashi

Most previous methods for text data augmentation are limited to simple tasks and weak baselines. We explore data augmentation on hard tasks (i.e., few-shot natural language understanding) and strong baselines (i.e., pretrained models with…

Computation and Language · Computer Science 2022-03-16 Jing Zhou , Yanan Zheng , Jie Tang , Jian Li , Zhilin Yang

Counterfactuals refer to minimally edited inputs that cause a model's prediction to change, serving as a promising approach to explaining the model's behavior. Large language models (LLMs) excel at generating English counterfactuals and…

Computation and Language · Computer Science 2026-04-07 Qianli Wang , Van Bach Nguyen , Yihong Liu , Fedor Splitt , Nils Feldhus , Christin Seifert , Hinrich Schütze , Sebastian Möller , Vera Schmitt

Data augmentation has been demonstrated as an effective strategy for improving model generalization and data efficiency. However, due to the discrete nature of natural language, designing label-preserving transformations for text data tends…

Computation and Language · Computer Science 2020-10-20 Yanru Qu , Dinghan Shen , Yelong Shen , Sandra Sajeev , Jiawei Han , Weizhu Chen

The reliance of text classifiers on spurious correlations can lead to poor generalization at deployment, raising concerns about their use in safety-critical domains such as healthcare. In this work, we propose to use counterfactual data…

Machine Learning · Computer Science 2024-01-10 Amir Feder , Yoav Wald , Claudia Shi , Suchi Saria , David Blei

Determining the plausibility of causal relations between clauses is a commonsense reasoning task that requires complex inference ability. The general approach to this task is to train a large pretrained language model on a specific dataset.…

Computation and Language · Computer Science 2021-01-14 Ieva Staliūnaitė , Philip John Gorinski , Ignacio Iacobacci

Counterfactual fairness methods address the question: How would the prediction change if the sensitive identity attributes referenced in the text instance were different? These methods are entirely based on generating counterfactuals for…

Computation and Language · Computer Science 2022-03-08 Mohit Wadhwa , Mohan Bhambhani , Ashvini Jindal , Uma Sawant , Ramanujam Madhavan

A growing body of work shows that models exploit annotation artifacts to achieve state-of-the-art performance on standard crowdsourced benchmarks---datasets collected from crowdworkers to create an evaluation task---while still failing on…

Computation and Language · Computer Science 2020-10-13 William Huang , Haokun Liu , Samuel R. Bowman

Deep NLP models have been shown to learn spurious correlations, leaving them brittle to input perturbations. Recent work has shown that counterfactual or contrastive data -- i.e. minimally perturbed inputs -- can reveal these weaknesses,…

Computation and Language · Computer Science 2022-03-31 Bhargavi Paranjape , Matthew Lamm , Ian Tenney

Many dynamic processes, including common scenarios in robotic control and reinforcement learning (RL), involve a set of interacting subprocesses. Though the subprocesses are not independent, their interactions are often sparse, and the…

Machine Learning · Computer Science 2020-12-07 Silviu Pitis , Elliot Creager , Animesh Garg

A machine learning model, under the influence of observed or unobserved confounders in the training data, can learn spurious correlations and fail to generalize when deployed. For image classifiers, augmenting a training dataset using…

Machine Learning · Computer Science 2022-12-13 Abbavaram Gowtham Reddy , Saloni Dash , Amit Sharma , Vineeth N Balasubramanian

This paper proposes a novel framework to reinforce classification models using language-guided generated counterfactual images. Deep learning classification models are often trained using datasets that mirror real-world scenarios. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xiang Li , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples…

Machine Learning · Computer Science 2022-10-25 Sumedha Singla , Nihal Murali , Forough Arabshahi , Sofia Triantafyllou , Kayhan Batmanghelich

Natural language counterfactual generation aims to minimally modify a given text such that the modified text will be classified into a different class. The generated counterfactuals provide insight into the reasoning behind a model's…

Computation and Language · Computer Science 2024-10-08 Yongjie Wang , Xiaoqi Qiu , Yu Yue , Xu Guo , Zhiwei Zeng , Yuhong Feng , Zhiqi Shen

There is a broad consensus on the importance of deep learning models in tasks involving complex data. Often, an adequate understanding of these models is required when focusing on the transparency of decisions in human-critical…

Counterfactual learning from observational data involves learning a classifier on an entire population based on data that is observed conditioned on a selection policy. This work considers this problem in an active setting, where the…

Machine Learning · Statistics 2019-10-29 Songbai Yan , Kamalika Chaudhuri , Tara Javidi

Learning from class imbalanced datasets poses challenges for many machine learning algorithms. Many real-world domains are, by definition, class imbalanced by virtue of having a majority class that naturally has many more instances than its…

Machine Learning · Computer Science 2021-11-08 Mohammed Temraz , Mark T. Keane

Counterfactual instances are a powerful tool to obtain valuable insights into automated decision processes, describing the necessary minimal changes in the input space to alter the prediction towards a desired target. Most previous…

Machine Learning · Computer Science 2021-06-07 Robert-Florian Samoilescu , Arnaud Van Looveren , Janis Klaise

While counterfactual data augmentation offers a promising step towards robust generalization in natural language processing, producing a set of counterfactuals that offer valuable inductive bias for models remains a challenge. Most existing…

Computation and Language · Computer Science 2022-10-25 Phillip Howard , Gadi Singer , Vasudev Lal , Yejin Choi , Swabha Swayamdipta

Nowadays, data augmentation through synthetic data has been widely used in the field of Grammatical Error Correction (GEC) to alleviate the problem of data scarcity. However, these synthetic data are mainly used in the pre-training phase…

Computation and Language · Computer Science 2024-06-26 Yixuan Wang , Baoxin Wang , Yijun Liu , Qingfu Zhu , Dayong Wu , Wanxiang Che