English
Related papers

Related papers: BioNLI: Generating a Biomedical NLI Dataset Using …

200 papers

Natural Language Inference (NLI) models are known to learn from biases and artefacts within their training data, impacting how well they generalise to other unseen datasets. Existing de-biasing approaches focus on preventing the models from…

Computation and Language · Computer Science 2022-05-03 Joe Stacey , Yonatan Belinkov , Marek Rei

Natural language inference has trended toward studying contexts beyond the sentence level. An important application area is law: past cases often do not foretell how they apply to new situations and implications must be inferred. This paper…

Computation and Language · Computer Science 2022-12-07 William Bruno , Dan Roth

This work presents an Argument Mining process that extracts argumentative entities from clinical texts and identifies their relationships using token classification and Natural Language Inference techniques. Compared to straightforward…

Computation and Language · Computer Science 2025-06-17 Maitane Urruela , Sergio Martín , Iker De la Iglesia , Ander Barrena

We propose a general method to break down a main complex task into a set of intermediary easier sub-tasks, which are formulated in natural language as binary questions related to the final target task. Our method allows for representing…

Computation and Language · Computer Science 2024-02-02 Felipe Urrutia , Cristian Buc , Valentin Barriere

Natural Language Inference is a challenging task that has received substantial attention, and state-of-the-art models now achieve impressive test set performance in the form of accuracy scores. Here, we go beyond this single evaluation…

Computation and Language · Computer Science 2018-05-14 Vicente Ivan Sanchez Carmona , Jeff Mitchell , Sebastian Riedel

Natural language inference (NLI) is an increasingly important task for natural language understanding, which requires one to infer whether a sentence entails another. However, the ability of NLI models to make pragmatic inferences remains…

Computation and Language · Computer Science 2020-07-15 Paloma Jeretic , Alex Warstadt , Suvrat Bhooshan , Adina Williams

Natural Language Inference (NLI) is the task of inferring the logical relationship, typically entailment or contradiction, between a premise and hypothesis. Code-mixing is the use of more than one language in the same conversation or…

Computation and Language · Computer Science 2020-04-14 Simran Khanuja , Sandipan Dandapat , Sunayana Sitaram , Monojit Choudhury

Natural language inference (NLI) data has proven useful in benchmarking and, especially, as pretraining data for tasks requiring language understanding. However, the crowdsourcing protocol that was used to collect this data has known issues…

Computation and Language · Computer Science 2020-10-01 Samuel R. Bowman , Jennimaria Palomaki , Livio Baldini Soares , Emily Pitler

We revisit the reference determinacy (RD) assumption in the task of natural language inference (NLI), i.e., the premise and hypothesis are assumed to refer to the same context when human raters annotate a label. While RD is a practical…

Computation and Language · Computer Science 2025-02-11 Sihao Chen , Chaitanya Malaviya , Alex Fabrikant , Hagai Taitelbaum , Tal Schuster , Senaka Buthpitiya , Dan Roth

Natural Language Inference (NLI) is a cornerstone of Natural Language Processing (NLP), providing insights into the entailment relationships between text pairings. It is a critical component of Natural Language Understanding (NLU),…

Computation and Language · Computer Science 2024-05-08 Fatema Tuj Johora Faria , Mukaffi Bin Moin , Asif Iftekher Fahim , Pronay Debnath , Faisal Muhammad Shah

We ask whether contemporary LLMs are able to perform natural language inference (NLI) tasks on mathematical texts. We call this the Math NLI problem. We construct a corpus of Math NLI pairs whose premises are from extant mathematical text…

Computation and Language · Computer Science 2025-08-01 Valeria de Paiva , Qiyue Gao , Hai Hu , Pavel Kovalev , Yikang Liu , Lawrence S. Moss , Zhiheng Qian

Decomposition of text into atomic propositions is a flexible framework allowing for the closer inspection of input and output text. We use atomic decomposition of hypotheses in two natural language reasoning tasks, traditional NLI and…

Computation and Language · Computer Science 2025-03-10 Neha Srikanth , Rachel Rudinger

We address whether neural models for Natural Language Inference (NLI) can learn the compositional interactions between lexical entailment and negation, using four methods: the behavioral evaluation methods of (1) challenge test sets and (2)…

Computation and Language · Computer Science 2020-11-24 Atticus Geiger , Kyle Richardson , Christopher Potts

We propose a hypothesis only baseline for diagnosing Natural Language Inference (NLI). Especially when an NLI dataset assumes inference is occurring based purely on the relationship between a context and a hypothesis, it follows that…

Computation and Language · Computer Science 2018-05-04 Adam Poliak , Jason Naradowsky , Aparajita Haldar , Rachel Rudinger , Benjamin Van Durme

Large crowdsourced datasets are widely used for training and evaluating neural models on natural language inference (NLI). Despite these efforts, neural models have a hard time capturing logical inferences, including those licensed by…

Computation and Language · Computer Science 2019-04-30 Hitomi Yanaka , Koji Mineshima , Daisuke Bekki , Kentaro Inui , Satoshi Sekine , Lasha Abzianidze , Johan Bos

We create a new NLI test set that shows the deficiency of state-of-the-art models in inferences that require lexical and world knowledge. The new examples are simpler than the SNLI test set, containing sentences that differ by at most one…

Computation and Language · Computer Science 2018-05-08 Max Glockner , Vered Shwartz , Yoav Goldberg

State-of-the-art natural language processing systems rely on supervision in the form of annotated data to learn competent models. These models are generally trained on data in a single language (usually English), and cannot be directly used…

Computation and Language · Computer Science 2018-09-14 Alexis Conneau , Guillaume Lample , Ruty Rinott , Adina Williams , Samuel R. Bowman , Holger Schwenk , Veselin Stoyanov

Modeling natural language inference is a very challenging task. With the availability of large annotated data, it has recently become feasible to train complex models such as neural-network-based inference models, which have shown to…

Computation and Language · Computer Science 2020-03-04 Qian Chen , Xiaodan Zhu , Zhen-Hua Ling , Diana Inkpen , Si Wei

A human decision-maker benefits the most from an AI assistant that corrects for their biases. For problems such as generating interpretation of a radiology report given findings, a system predicting only highly likely outcomes may be less…

Computation and Language · Computer Science 2023-06-01 Liyan Tang , Yifan Peng , Yanshan Wang , Ying Ding , Greg Durrett , Justin F. Rousseau

The recent growth in the popularity and success of deep learning models on NLP classification tasks has accompanied the need for generating some form of natural language explanation of the predicted labels. Such generated natural language…

Computation and Language · Computer Science 2020-05-26 Sawan Kumar , Partha Talukdar