English
Related papers

Related papers: Probing the Natural Language Inference Task with A…

200 papers

Natural language explanations play a fundamental role in Natural Language Inference (NLI) by revealing how premises logically entail hypotheses. Recent work has shown that the interaction of large language models (LLMs) with theorem provers…

Computation and Language · Computer Science 2025-06-02 Xin Quan , Marco Valentino , Louise A. Dennis , André Freitas

Paraphrasing is a useful natural language processing task that can contribute to more diverse generated or translated texts. Natural language inference (NLI) and paraphrasing share some similarities and can benefit from a joint approach. We…

Computation and Language · Computer Science 2021-11-16 Matej Klemen , Marko Robnik-Šikonja

Natural language inference (NLI) is formulated as a unified framework for solving various NLP problems such as relation extraction, question answering, summarization, etc. It has been studied intensively in the past few years thanks to the…

Computation and Language · Computer Science 2021-06-18 Wenpeng Yin , Dragomir Radev , Caiming Xiong

We introduce a set of nine challenge tasks that test for the understanding of function words. These tasks are created by structurally mutating sentences from existing datasets to target the comprehension of specific types of function words…

In the recent past, a popular way of evaluating natural language understanding (NLU), was to consider a model's ability to perform natural language inference (NLI) tasks. In this paper, we investigate if NLI tasks, that are rarely used for…

Computation and Language · Computer Science 2024-11-22 Lovish Madaan , David Esiobu , Pontus Stenetorp , Barbara Plank , Dieuwke Hupkes

The ability to reason with natural language is a fundamental prerequisite for many NLP tasks such as information extraction, machine translation and question answering. To quantify this ability, systems are commonly tested whether they can…

Computation and Language · Computer Science 2016-06-07 Vladyslav Kolesnyk , Tim Rocktäschel , Sebastian Riedel

In the recent past, Natural language Inference (NLI) has gained significant attention, particularly given its promise for downstream NLP tasks. However, its true impact is limited and has not been well studied. Therefore, in this paper, we…

Computation and Language · Computer Science 2020-10-06 Anshuman Mishra , Dhruvesh Patel , Aparna Vijayakumar , Xiang Li , Pavan Kapanipathi , Kartik Talamadupula

In this paper we present a technique of NLP to tackle the problem of inference relation (NLI) between pairs of sentences in a target language of choice without a language-specific training dataset. We exploit a generic translation dataset,…

Computation and Language · Computer Science 2023-09-07 Lorenzo Corradi , Alessandro Manenti , Francesca Del Bonifro , Francesco Setti , Dario Del Sorbo

The recent growth in the popularity and success of deep learning models on NLP classification tasks has accompanied the need for generating some form of natural language explanation of the predicted labels. Such generated natural language…

Computation and Language · Computer Science 2020-05-26 Sawan Kumar , Partha Talukdar

The task of natural language inference (NLI) is to identify the relation between the given premise and hypothesis. While recent NLI models achieve very high performance on individual datasets, they fail to generalize across similar…

Computation and Language · Computer Science 2019-09-20 Nafise Sadat Moosavi , Prasetya Ajie Utama , Andreas Rücklé , Iryna Gurevych

The abductive natural language inference task ($\alpha$NLI) is proposed to evaluate the abductive reasoning ability of a learning system. In the $\alpha$NLI task, two observations are given and the most plausible hypothesis is asked to pick…

Information Retrieval · Computer Science 2021-09-15 Yunchang Zhu , Liang Pang , Yanyan Lan , Xueqi Cheng

Current Natural Language Inference (NLI) systems primarily operate at the sentence level, providing black-box decisions that lack explanatory power. While atomic-level NLI offers a promising alternative by decomposing hypotheses into…

Computation and Language · Computer Science 2026-01-13 Minghui Huang

We analyze two Natural Language Inference data sets with respect to their linguistic features. The goal is to identify those syntactic and semantic properties that are particularly hard to comprehend for a machine learning model. To this…

Computation and Language · Computer Science 2022-10-20 Maren Pielka , Felix Rode , Lisa Pucknat , Tobias Deußer , Rafet Sifa

When evaluating an answer choice for Reading Comprehension task, other answer choices available for the question and the answers of related questions about the same paragraph often provide valuable information. In this paper, we propose a…

Computation and Language · Computer Science 2021-01-01 Rajkumar Pujari , Dan Goldwasser

Recently, the Natural Language Inference (NLI) task has been studied for semi-structured tables that do not have a strict format. Although neural approaches have achieved high performance in various types of NLI, including NLI between…

Computation and Language · Computer Science 2022-04-26 Tomoya Kurosawa , Hitomi Yanaka

Natural Language Inference (NLI) is a hot topic research in natural language processing, contradiction detection between sentences is a special case of NLI. This is considered a difficult NLP task which has a big influence when added as a…

Computation and Language · Computer Science 2023-04-05 Khloud Al Jallad , Nada Ghneim

Natural language explanations represent a proxy for evaluating explanation-based and multi-step Natural Language Inference (NLI) models. However, assessing the validity of explanations for NLI is challenging as it typically involves the…

Computation and Language · Computer Science 2024-10-14 Xin Quan , Marco Valentino , Louise A. Dennis , André Freitas

Natural Language Processing (NLP) helps empower intelligent machines by enhancing a better understanding of the human language for linguistic-based human-computer communication. Recent developments in computational power and the advent of…

Computation and Language · Computer Science 2021-03-02 Amirsina Torfi , Rouzbeh A. Shirvani , Yaser Keneshloo , Nader Tavaf , Edward A. Fox

To build robust question answering systems, we need the ability to verify whether answers to questions are truly correct, not just "good enough" in the context of imperfect QA datasets. We explore the use of natural language inference (NLI)…

Computation and Language · Computer Science 2021-09-14 Jifan Chen , Eunsol Choi , Greg Durrett

Natural Language Inference (NLI) is considered a representative task to test natural language understanding (NLU). In this work, we propose an extensible framework to collectively yet categorically test diverse Logical reasoning…

Artificial Intelligence · Computer Science 2023-09-06 Ishan Tarunesh , Somak Aditya , Monojit Choudhury