English
Related papers

Related papers: Are Natural Language Inference Models IMPPRESsive?…

200 papers

Large Language Models (LLMs) perform remarkably well in Natural Language Inference (NLI). However, NLI involving numerical and logical expressions remains challenging. Comparatives are a key linguistic phenomenon related to such inference,…

Computation and Language · Computer Science 2025-09-18 Yosuke Mikami , Daiki Matsuoka , Hitomi Yanaka

Although pre-trained language models show good performance on various natural language processing tasks, they often rely on non-causal features and patterns to determine the outcome. For natural language inference tasks, previous results…

Computation and Language · Computer Science 2024-10-29 Heerin Yang , Sseung-won Hwang , Jungmin So

Natural language understanding (NLU) and Natural language generation (NLG) tasks hold a strong dual relationship, where NLU aims at predicting semantic labels based on natural language utterances and NLG does the opposite. The prior work…

Computation and Language · Computer Science 2020-10-16 Shang-Yu Su , Yung-Sung Chuang , Yun-Nung Chen

Sentence-level representations are necessary for various NLP tasks. Recurrent neural networks have proven to be very effective in learning distributed representations and can be trained efficiently on natural language inference tasks. We…

Computation and Language · Computer Science 2019-08-15 Aarne Talman , Anssi Yli-Jyrä , Jörg Tiedemann

Natural Language Inference (NLI) relies heavily on adequately parsing the semantic content of the premise and hypothesis. In this work, we investigate whether adding semantic information in the form of an Abstract Meaning Representation…

Computation and Language · Computer Science 2025-09-26 Junghyun Min , Xiulin Yang , Shira Wein

We introduce MorphNLI, a modular step-by-step approach to natural language inference (NLI). When classifying the premise-hypothesis pairs into {entailment, contradiction, neutral}, we use a language model to generate the necessary edits to…

Computation and Language · Computer Science 2026-02-16 Vlad Andrei Negru , Robert Vacareanu , Camelia Lemnaru , Mihai Surdeanu , Rodica Potolea

How can we interpret and retrieve medical evidence to support clinical decisions? Clinical trial reports (CTR) amassed over the years contain indispensable information for the development of personalized medicine. However, it is practically…

Computation and Language · Computer Science 2023-10-31 Maël Jullien , Marco Valentino , Hannah Frost , Paul O'Regan , Donal Landers , André Freitas

State of the art models using deep neural networks have become very good in learning an accurate mapping from inputs to outputs. However, they still lack generalization capabilities in conditions that differ from the ones encountered during…

Computation and Language · Computer Science 2018-08-28 Alexey Romanov , Chaitanya Shivade

The ability to accurately interpret implied meanings plays a crucial role in human communication and language use, and language models are also expected to possess this capability. This study demonstrates that providing language models with…

Computation and Language · Computer Science 2025-11-20 Takuma Sato , Seiya Kawano , Koichiro Yoshino

An important challenge for human-like AI is compositional semantics. Recent research has attempted to address this by using deep neural networks to learn vector space embeddings of sentences, which then serve as input to other tasks. We…

Computation and Language · Computer Science 2018-05-21 Ishita Dasgupta , Demi Guo , Andreas Stuhlmüller , Samuel J. Gershman , Noah D. Goodman

We investigate the use of Natural Language Inference (NLI) in automating requirements engineering tasks. In particular, we focus on three tasks: requirements classification, identification of requirements specification defects, and…

Software Engineering · Computer Science 2024-05-09 Mohamad Fazelnia , Viktoria Koscinski , Spencer Herzog , Mehdi Mirakhorli

There has been significant progress in recent years in the field of Natural Language Processing thanks to the introduction of the Transformer architecture. Current state-of-the-art models, via a large number of parameters and pre-training…

Artificial Intelligence · Computer Science 2020-03-31 Carlos Aspillaga , Andrés Carvallo , Vladimir Araujo

Natural Language Inference (NLI) is a fundamental and challenging task in Natural Language Processing (NLP). Most existing methods only apply one-pass inference process on a mixed matching feature, which is a concatenation of different…

Computation and Language · Computer Science 2019-01-09 Chunhua Liu , Shan Jiang , Hainan Yu , Dong Yu

We evaluate whether BERT, a widely used neural network for sentence processing, acquires an inductive bias towards forming structural generalizations through pretraining on raw data. We conduct four experiments testing its preference for…

Computation and Language · Computer Science 2020-09-25 Alex Warstadt , Samuel R. Bowman

The abductive natural language inference task ($\alpha$NLI) is proposed to evaluate the abductive reasoning ability of a learning system. In the $\alpha$NLI task, two observations are given and the most plausible hypothesis is asked to pick…

Information Retrieval · Computer Science 2021-09-15 Yunchang Zhu , Liang Pang , Yanyan Lan , Xueqi Cheng

Ambiguity is an intrinsic feature of natural language. Managing ambiguity is a key part of human language understanding, allowing us to anticipate misunderstanding as communicators and revise our interpretations as listeners. As language…

Computation and Language · Computer Science 2023-10-23 Alisa Liu , Zhaofeng Wu , Julian Michael , Alane Suhr , Peter West , Alexander Koller , Swabha Swayamdipta , Noah A. Smith , Yejin Choi

We propose a simple neural architecture for natural language inference. Our approach uses attention to decompose the problem into subproblems that can be solved separately, thus making it trivially parallelizable. On the Stanford Natural…

Computation and Language · Computer Science 2016-09-27 Ankur P. Parikh , Oscar Täckström , Dipanjan Das , Jakob Uszkoreit

Abduction has long been seen as crucial for narrative comprehension and reasoning about everyday situations. The abductive natural language inference ($\alpha$NLI) task has been proposed, and this narrative text-based task aims to infer the…

Computation and Language · Computer Science 2023-09-18 Chunkit Chan , Xin Liu , Tsz Ho Chan , Jiayang Cheng , Yangqiu Song , Ginny Wong , Simon See

Fine-tuning pre-trained contextualized embedding models has become an integral part of the NLP pipeline. At the same time, probing has emerged as a way to investigate the linguistic knowledge captured by pre-trained models. Very little is,…

Computation and Language · Computer Science 2020-10-07 Marius Mosbach , Anna Khokhlova , Michael A. Hedderich , Dietrich Klakow

In recent years, the Natural Language Inference (NLI) task has garnered significant attention, with new datasets and models achieving near human-level performance on it. However, the full promise of NLI -- particularly that it learns…

Computation and Language · Computer Science 2020-09-22 Anshuman Mishra , Dhruvesh Patel , Aparna Vijayakumar , Xiang Li , Pavan Kapanipathi , Kartik Talamadupula