English
Related papers

Related papers: Avoiding the Hypothesis-Only Bias in Natural Langu…

200 papers

Popular Natural Language Inference (NLI) datasets have been shown to be tainted by hypothesis-only biases. Adversarial learning may help models ignore sensitive biases and spurious correlations in data. We evaluate whether adversarial…

Computation and Language · Computer Science 2019-07-11 Yonatan Belinkov , Adam Poliak , Stuart M. Shieber , Benjamin Van Durme , Alexander M. Rush

Many recent studies have shown that for models trained on datasets for natural language inference (NLI), it is possible to make correct predictions by merely looking at the hypothesis while completely ignoring the premise. In this work, we…

Computation and Language · Computer Science 2021-03-16 Tianyu Liu , Xin Zheng , Baobao Chang , Zhifang Sui

Natural language inference (NLI) aims at predicting the relationship between a given pair of premise and hypothesis. However, several works have found that there widely exists a bias pattern called annotation artifacts in NLI datasets,…

Computation and Language · Computer Science 2019-10-08 Guanhua Zhang , Bing Bai , Junqi Zhang , Kun Bai , Conghui Zhu , Tiejun Zhao

The release of large natural language inference (NLI) datasets like SNLI and MNLI have led to rapid development and improvement of completely neural systems for the task. Most recently, heavily pre-trained, Transformer-based models like…

Computation and Language · Computer Science 2019-12-10 Tiffany Chien , Jugal Kalita

Language models can achieve high accuracy on natural language tasks such as NLI, but performance suffers on manually created adversarial examples. We investigate the performance of a language model trained on the Stanford Natural Language…

Computation and Language · Computer Science 2024-10-31 Chris Achard

Natural Language Inference (NLI) datasets often contain hypothesis-only biases---artifacts that allow models to achieve non-trivial performance without learning whether a premise entails a hypothesis. We propose two probabilistic methods to…

Computation and Language · Computer Science 2019-07-11 Yonatan Belinkov , Adam Poliak , Stuart M. Shieber , Benjamin Van Durme , Alexander M. Rush

While Natural Language Inference (NLI) models have achieved high performances on benchmark datasets, there are still concerns whether they truly capture the intended task, or largely exploit dataset artifacts. Through detailed analysis of…

Computation and Language · Computer Science 2024-12-24 Karthik Sivakoti

Large-scale datasets for natural language inference are created by presenting crowd workers with a sentence (premise), and asking them to generate three new sentences (hypotheses) that it entails, contradicts, or is logically neutral with…

Computation and Language · Computer Science 2018-04-18 Suchin Gururangan , Swabha Swayamdipta , Omer Levy , Roy Schwartz , Samuel R. Bowman , Noah A. Smith

Statistical natural language inference (NLI) models are susceptible to learning dataset bias: superficial cues that happen to associate with the label on a particular dataset, but are not useful in general, e.g., negation words indicate…

Computation and Language · Computer Science 2019-11-26 He He , Sheng Zha , Haohan Wang

We introduce a new large-scale NLI benchmark dataset, collected via an iterative, adversarial human-and-model-in-the-loop procedure. We show that training models on this new dataset leads to state-of-the-art performance on a variety of…

Computation and Language · Computer Science 2020-05-07 Yixin Nie , Adina Williams , Emily Dinan , Mohit Bansal , Jason Weston , Douwe Kiela

Machine learning models can reach high performance on benchmark natural language processing (NLP) datasets but fail in more challenging settings. We study this issue when a pre-trained model learns dataset artifacts in natural language…

Computation and Language · Computer Science 2023-03-20 Zhenyuan Lu

Natural Language Inference (NLI) is the task of inferring whether the hypothesis can be justified by the given premise. Basically, we classify the hypothesis into three labels(entailment, neutrality and contradiction) given the premise. NLI…

Computation and Language · Computer Science 2024-12-11 Zijiang Yang

Adversarial examples are inputs to machine learning models designed to cause the model to make a mistake. They are useful for understanding the shortcomings of machine learning models, interpreting their results, and for regularisation. In…

Machine Learning · Computer Science 2018-08-28 Pasquale Minervini , Sebastian Riedel

The prior work on natural language inference (NLI) debiasing mainly targets at one or few known biases while not necessarily making the models more robust. In this paper, we focus on the model-agnostic debiasing strategies and explore how…

Computation and Language · Computer Science 2020-10-20 Tianyu Liu , Xin Zheng , Xiaoan Ding , Baobao Chang , Zhifang Sui

Crowdworker-constructed natural language inference (NLI) datasets have been found to contain statistical artifacts associated with the annotation process that allow hypothesis-only classifiers to achieve better-than-random performance…

Computation and Language · Computer Science 2021-06-04 Christine Herlihy , Rachel Rudinger

The surge of state-of-the-art Transformer-based models has undoubtedly pushed the limits of NLP model performance, excelling in a variety of tasks. We cast the spotlight on the underexplored task of Natural Language Inference (NLI), since…

Computation and Language · Computer Science 2025-08-04 Alexandros Koulakos , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou

Recent studies show that crowd-sourced Natural Language Inference (NLI) datasets may suffer from significant biases like annotation artifacts. Models utilizing these superficial clues gain mirage advantages on the in-domain testing set,…

Computation and Language · Computer Science 2020-10-16 Guanhua Zhang , Bing Bai , Jian Liang , Kun Bai , Conghui Zhu , Tiejun Zhao

Natural Language Inference (NLI) or Recognizing Textual Entailment (RTE) is the task of predicting the entailment relation between a pair of sentences (premise and hypothesis). This task has been described as a valuable testing ground for…

Computation and Language · Computer Science 2021-01-25 Qingyuan Hu , Yi Zhang , Kanishka Misra , Julia Rayz

The ability to understand logical relationships between sentences is an important task in language understanding. To aid in progress for this task, researchers have collected datasets for machine learning and evaluation of current systems.…

Computation and Language · Computer Science 2019-06-25 Shawn Tan , Yikang Shen , Chin-wei Huang , Aaron Courville

Many natural language inference (NLI) datasets contain biases that allow models to perform well by only using a biased subset of the input, without considering the remainder features. For instance, models are able to make a classification…

Computation and Language · Computer Science 2021-09-01 Dimion Asael , Zachary Ziegler , Yonatan Belinkov
‹ Prev 1 2 3 10 Next ›