中文
相关论文

相关论文: Are Natural Language Inference Models IMPPRESsive?…

200 篇论文

The task of natural language inference (NLI) asks whether a given premise (expressed in NL) entails a given NL hypothesis. NLI benchmarks contain human ratings of entailment, but the meaning relationships driving these ratings are not…

计算与语言 · 计算机科学 2023-09-06 Juri Opitz , Shira Wein , Julius Steen , Anette Frank , Nathan Schneider

Natural Language Inference (NLI) task requires an agent to determine the logical relationship between a natural language premise and a natural language hypothesis. We introduce Interactive Inference Network (IIN), a novel class of neural…

计算与语言 · 计算机科学 2018-05-29 Yichen Gong , Heng Luo , Jian Zhang

Given the increasingly prominent role NLP models (will) play in our lives, it is important for human expectations of model behavior to align with actual model behavior. Using Natural Language Inference (NLI) as a case study, we investigate…

计算与语言 · 计算机科学 2021-09-20 Grusha Prasad , Yixin Nie , Mohit Bansal , Robin Jia , Douwe Kiela , Adina Williams

Nature language inference (NLI) task is a predictive task of determining the inference relationship of a pair of natural language sentences. With the increasing popularity of NLI, many state-of-the-art predictive models have been proposed…

计算与语言 · 计算机科学 2018-11-13 Haohan Wang , Da Sun , Eric P. Xing

Natural language inference (NLI) is a fundamentally important task in natural language processing that has many applications. The recently released Stanford Natural Language Inference (SNLI) corpus has made it possible to develop and…

计算与语言 · 计算机科学 2016-11-11 Shuohang Wang , Jing Jiang

Natural Language Inference (NLI) models are known to learn from biases and artefacts within their training data, impacting how well they generalise to other unseen datasets. Existing de-biasing approaches focus on preventing the models from…

计算与语言 · 计算机科学 2022-05-03 Joe Stacey , Yonatan Belinkov , Marek Rei

Standard evaluations of deep learning models for semantics using naturalistic corpora are limited in what they can tell us about the fidelity of the learned representations, because the corpora rarely come with good measures of semantic…

计算与语言 · 计算机科学 2018-11-01 Atticus Geiger , Ignacio Cases , Lauri Karttunen , Christopher Potts

The recent state-of-the-art natural language understanding (NLU) systems often behave unpredictably, failing on simpler reasoning examples. Despite this, there has been limited focus on quantifying progress towards systems with more…

人工智能 · 计算机科学 2021-07-16 Ishan Tarunesh , Somak Aditya , Monojit Choudhury

Neural network models have shown great success at natural language inference (NLI), the task of determining whether a premise entails a hypothesis. However, recent studies suggest that these models may rely on fallible heuristics rather…

计算与语言 · 计算机科学 2018-12-04 R. Thomas McCoy , Tal Linzen

The task of abductive natural language inference (\alpha{}nli), to decide which hypothesis is the more likely explanation for a set of observations, is a particularly difficult type of NLI. Instead of just determining a causal relationship,…

计算与语言 · 计算机科学 2022-07-12 Emīls Kadiķis , Vaibhav Srivastav , Roman Klinger

Reasoning about conjuncts in conjunctive sentences is important for a deeper understanding of conjunctions in English and also how their usages and semantics differ from conjunctive and disjunctive boolean logic. Existing NLI stress tests…

计算与语言 · 计算机科学 2020-10-23 Swarnadeep Saha , Yixin Nie , Mohit Bansal

Despite recent breakthroughs in Machine Learning for Natural Language Processing, the Natural Language Inference (NLI) problems still constitute a challenge. To this purpose we contribute a new dataset that focuses exclusively on the…

计算与语言 · 计算机科学 2023-06-21 Daniel Ziembicki , Anna Wróblewska , Karolina Seweryn

The release of large natural language inference (NLI) datasets like SNLI and MNLI have led to rapid development and improvement of completely neural systems for the task. Most recently, heavily pre-trained, Transformer-based models like…

计算与语言 · 计算机科学 2019-12-10 Tiffany Chien , Jugal Kalita

We analyze two Natural Language Inference data sets with respect to their linguistic features. The goal is to identify those syntactic and semantic properties that are particularly hard to comprehend for a machine learning model. To this…

计算与语言 · 计算机科学 2022-10-20 Maren Pielka , Felix Rode , Lisa Pucknat , Tobias Deußer , Rafet Sifa

Natural Language Inference (NLI) is the task of determining whether a premise entails, contradicts, or is neutral with respect to a given hypothesis. The task is often framed as emulating human inferential processes, in which commonsense…

计算与语言 · 计算机科学 2026-01-27 Chathuri Jayaweera , Brianna Yanqui , Bonnie Dorr

Popular Natural Language Inference (NLI) datasets have been shown to be tainted by hypothesis-only biases. Adversarial learning may help models ignore sensitive biases and spurious correlations in data. We evaluate whether adversarial…

计算与语言 · 计算机科学 2019-07-11 Yonatan Belinkov , Adam Poliak , Stuart M. Shieber , Benjamin Van Durme , Alexander M. Rush

Natural Language Inference (NLI), also known as Recognizing Textual Entailment (RTE), is one of the most important problems in natural language processing. It requires to infer the logical relationship between two given sentences. While…

计算与语言 · 计算机科学 2019-07-24 Boyuan Pan , Yazheng Yang , Zhou Zhao , Yueting Zhuang , Deng Cai , Xiaofei He

Understanding language requires grasping not only the overtly stated content, but also making inferences about things that were left unsaid. These inferences include presuppositions, a phenomenon by which a listener learns about new…

计算与语言 · 计算机科学 2021-09-16 Alicia Parrish , Sebastian Schuster , Alex Warstadt , Omar Agha , Soo-Hwan Lee , Zhuoye Zhao , Samuel R. Bowman , Tal Linzen

Natural language inference (NLI) requires models to learn and apply commonsense knowledge. These reasoning abilities are particularly important for explainable NLI systems that generate a natural language explanation in addition to their…

计算与语言 · 计算机科学 2021-10-14 Hendrik Schuff , Hsiu-Yu Yang , Heike Adel , Ngoc Thang Vu

Natural Language Inference (NLI) is the task of determining the semantic relationship between a premise and a hypothesis. In this paper, we focus on the {\em generation} of hypotheses from premises in a multimodal setting, to generate a…

计算与语言 · 计算机科学 2019-09-24 Somaye Jafaritazehjani , Albert Gatt , Marc Tanti