English
Related papers

Related papers: Natural Language Inference in Context -- Investiga…

200 papers

Reviewing contracts is a time-consuming procedure that incurs large expenses to companies and social inequality to those who cannot afford it. In this work, we propose "document-level natural language inference (NLI) for contracts", a…

Computation and Language · Computer Science 2021-10-06 Yuta Koreeda , Christopher D. Manning

A fundamental goal of scientific research is to learn about causal relationships. However, despite its critical role in the life and social sciences, causality has not had the same importance in Natural Language Processing (NLP), which has…

How can we interpret and retrieve medical evidence to support clinical decisions? Clinical trial reports (CTR) amassed over the years contain indispensable information for the development of personalized medicine. However, it is practically…

Computation and Language · Computer Science 2023-10-31 Maël Jullien , Marco Valentino , Hannah Frost , Paul O'Regan , Donal Landers , André Freitas

We analyze two Natural Language Inference data sets with respect to their linguistic features. The goal is to identify those syntactic and semantic properties that are particularly hard to comprehend for a machine learning model. To this…

Computation and Language · Computer Science 2022-10-20 Maren Pielka , Felix Rode , Lisa Pucknat , Tobias Deußer , Rafet Sifa

Reasoning about conjuncts in conjunctive sentences is important for a deeper understanding of conjunctions in English and also how their usages and semantics differ from conjunctive and disjunctive boolean logic. Existing NLI stress tests…

Computation and Language · Computer Science 2020-10-23 Swarnadeep Saha , Yixin Nie , Mohit Bansal

This work introduces a natural language inference (NLI) dataset that focuses on the validity of statements in legal wills. This dataset is unique because: (a) each entailment decision requires three inputs: the statement from the will, the…

Computation and Language · Computer Science 2022-11-01 Alice Saebom Kwak , Jacob O. Israelsen , Clayton T. Morrison , Derek E. Bambauer , Mihai Surdeanu

Much of human communication depends on implication, conveying meaning beyond literal words to express a wider range of thoughts, intentions, and feelings. For models to better understand and facilitate human communication, they must be…

Computation and Language · Computer Science 2025-01-20 Shreya Havaldar , Hamidreza Alvari , John Palowitch , Mohammad Javad Hosseini , Senaka Buthpitiya , Alex Fabrikant

Existing Natural Language Inference (NLI) datasets, while being instrumental in the advancement of Natural Language Understanding (NLU) research, are not related to scientific text. In this paper, we introduce SciNLI, a large dataset for…

Computation and Language · Computer Science 2022-03-16 Mobashir Sadat , Cornelia Caragea

Natural language inference has trended toward studying contexts beyond the sentence level. An important application area is law: past cases often do not foretell how they apply to new situations and implications must be inferred. This paper…

Computation and Language · Computer Science 2022-12-07 William Bruno , Dan Roth

In this paper we present a technique of NLP to tackle the problem of inference relation (NLI) between pairs of sentences in a target language of choice without a language-specific training dataset. We exploit a generic translation dataset,…

Computation and Language · Computer Science 2023-09-07 Lorenzo Corradi , Alessandro Manenti , Francesca Del Bonifro , Francesco Setti , Dario Del Sorbo

Do state-of-the-art models for language understanding already have, or can they easily learn, abilities such as boolean coordination, quantification, conditionals, comparatives, and monotonicity reasoning (i.e., reasoning about word…

Computation and Language · Computer Science 2019-12-03 Kyle Richardson , Hai Hu , Lawrence S. Moss , Ashish Sabharwal

Natural language understanding (NLU) of text is a fundamental challenge in AI, and it has received significant attention throughout the history of NLP research. This primary goal has been studied under different tasks, such as Question…

Computation and Language · Computer Science 2019-08-15 Daniel Khashabi

Deep learning (DL) based language models achieve high performance on various benchmarks for Natural Language Inference (NLI). And at this time, symbolic approaches to NLI are receiving less attention. Both approaches (symbolic and DL) have…

Computation and Language · Computer Science 2021-06-11 Zeming Chen , Qiyue Gao , Lawrence S. Moss

Natural Language Inference (NLI) is a cornerstone of Natural Language Processing (NLP), providing insights into the entailment relationships between text pairings. It is a critical component of Natural Language Understanding (NLU),…

Computation and Language · Computer Science 2024-05-08 Fatema Tuj Johora Faria , Mukaffi Bin Moin , Asif Iftekher Fahim , Pronay Debnath , Faisal Muhammad Shah

Natural Language Inference (NLI) or Recognizing Textual Entailment (RTE) is the task of predicting the entailment relation between a pair of sentences (premise and hypothesis). This task has been described as a valuable testing ground for…

Computation and Language · Computer Science 2021-01-25 Qingyuan Hu , Yi Zhang , Kanishka Misra , Julia Rayz

Current Natural Language Inference (NLI) models achieve impressive results, sometimes outperforming humans when evaluating on in-distribution test sets. However, as these models are known to learn from annotation artefacts and dataset…

Computation and Language · Computer Science 2022-10-24 Joe Stacey , Pasquale Minervini , Haim Dubossarsky , Marek Rei

In the recent past, a popular way of evaluating natural language understanding (NLU), was to consider a model's ability to perform natural language inference (NLI) tasks. In this paper, we investigate if NLI tasks, that are rarely used for…

Computation and Language · Computer Science 2024-11-22 Lovish Madaan , David Esiobu , Pontus Stenetorp , Barbara Plank , Dieuwke Hupkes

We ask whether contemporary LLMs are able to perform natural language inference (NLI) tasks on mathematical texts. We call this the Math NLI problem. We construct a corpus of Math NLI pairs whose premises are from extant mathematical text…

Computation and Language · Computer Science 2025-08-01 Valeria de Paiva , Qiyue Gao , Hai Hu , Pavel Kovalev , Yikang Liu , Lawrence S. Moss , Zhiheng Qian

Large language models (LLMs) are increasingly applied in multilingual contexts, yet their capacity for consistent, logically grounded alignment across languages remains underexplored. We present a controlled evaluation framework for…

Computation and Language · Computer Science 2025-08-21 Samir Abdaljalil , Erchin Serpedin , Khalid Qaraqe , Hasan Kurban

While many natural language inference (NLI) datasets target certain semantic phenomena, e.g., negation, tense & aspect, monotonicity, and presupposition, to the best of our knowledge, there is no NLI dataset that involves diverse types of…

Computation and Language · Computer Science 2023-07-06 Lasha Abzianidze , Joost Zwarts , Yoad Winter