English
Related papers

Related papers: Collecting Diverse Natural Language Inference Prob…

200 papers

Natural Language Inference (NLI) is the task of determining the semantic relationship between a premise and a hypothesis. In this paper, we focus on the {\em generation} of hypotheses from premises in a multimodal setting, to generate a…

Computation and Language · Computer Science 2019-09-24 Somaye Jafaritazehjani , Albert Gatt , Marc Tanti

Reasoning about conjuncts in conjunctive sentences is important for a deeper understanding of conjunctions in English and also how their usages and semantics differ from conjunctive and disjunctive boolean logic. Existing NLI stress tests…

Computation and Language · Computer Science 2020-10-23 Swarnadeep Saha , Yixin Nie , Mohit Bansal

A machine learning system can score well on a given test set by relying on heuristics that are effective for frequent example types but break down in more challenging cases. We study this issue within natural language inference (NLI), the…

Computation and Language · Computer Science 2019-06-25 R. Thomas McCoy , Ellie Pavlick , Tal Linzen

Inconsistencies are ubiquitous in law, administration, and jurisprudence. Though a cure is too much to hope for, we propose a technological remedy. Large language models (LLMs) can accurately extract propositions from arguments and compile…

Computers and Society · Computer Science 2025-09-24 Steve Huntsman

Multiple lines of research have developed Natural Language (NL) interfaces for formulating database queries. We build upon this work, but focus on presenting a highly detailed form of the answers in NL. The answers that we present are…

Databases · Computer Science 2020-07-10 Daniel Deutch , Nave Frost , Amir Gilad

Natural Language Inference Generation task is to generate a text hypothesis given a text premise and a logical relation between the two. This task can be used in data augmentation and controllable text generation in practice. In this paper,…

Computation and Language · Computer Science 2022-05-24 Kaijian Li , Shansan Gong , Kenny Q. Zhu

Natural Language Inference (NLI) datasets often contain hypothesis-only biases---artifacts that allow models to achieve non-trivial performance without learning whether a premise entails a hypothesis. We propose two probabilistic methods to…

Computation and Language · Computer Science 2019-07-11 Yonatan Belinkov , Adam Poliak , Stuart M. Shieber , Benjamin Van Durme , Alexander M. Rush

This paper presents the results of the RepEval 2017 Shared Task, which evaluated neural network sentence representation learning models on the Multi-Genre Natural Language Inference corpus (MultiNLI) recently introduced by Williams et al.…

Computation and Language · Computer Science 2017-07-27 Nikita Nangia , Adina Williams , Angeliki Lazaridou , Samuel R. Bowman

Understanding how large language models (LLMs) represent natural language is a central challenge in natural language processing (NLP) research. Many existing methods extract word embeddings from an LLM, visualise the embedding space via…

Computation and Language · Computer Science 2026-01-12 Thomas Fabian

Large language models (LLMs) are increasingly applied in multilingual contexts, yet their capacity for consistent, logically grounded alignment across languages remains underexplored. We present a controlled evaluation framework for…

Computation and Language · Computer Science 2025-08-21 Samir Abdaljalil , Erchin Serpedin , Khalid Qaraqe , Hasan Kurban

Motivated by the sparsity of NLP resources for Eastern European languages, we present a broad index of existing Eastern European language resources (90+ datasets and 45+ models) published as a github repository open for updates from the…

Computation and Language · Computer Science 2022-05-12 Alexey Tikhonov , Alex Malkhasov , Andrey Manoshin , George Dima , Réka Cserháti , Md. Sadek Hossain Asif , Matt Sárdi

The recent growth in the popularity and success of deep learning models on NLP classification tasks has accompanied the need for generating some form of natural language explanation of the predicted labels. Such generated natural language…

Computation and Language · Computer Science 2020-05-26 Sawan Kumar , Partha Talukdar

In settings from fact-checking to question answering, we frequently want to know whether a collection of evidence (premises) entails a hypothesis. Existing methods primarily focus on the end-to-end discriminative version of this task, but…

Computation and Language · Computer Science 2022-10-31 Kaj Bostrom , Zayne Sprague , Swarat Chaudhuri , Greg Durrett

Natural language processing (NLP) practitioners are leveraging large language models (LLM) to create structured datasets from semi-structured and unstructured data sources such as patents, papers, and theses, without having domain-specific…

Computation and Language · Computer Science 2024-03-26 Jesse Atuhurra , Seiveright Cargill Dujohn , Hidetaka Kamigaito , Hiroyuki Shindo , Taro Watanabe

Natural Language Inference is an important task for Natural Language Understanding. It is concerned with classifying the logical relation between two sentences. In this paper, we propose several text generative neural networks for…

Artificial Intelligence · Computer Science 2017-03-28 Janez Starc , Dunja Mladenić

Despite recent breakthroughs in Machine Learning for Natural Language Processing, the Natural Language Inference (NLI) problems still constitute a challenge. To this purpose we contribute a new dataset that focuses exclusively on the…

Computation and Language · Computer Science 2023-06-21 Daniel Ziembicki , Anna Wróblewska , Karolina Seweryn

Distributed representation plays an important role in deep learning based natural language processing. However, the representation of a sentence often varies in different tasks, which is usually learned from scratch and suffers from the…

Computation and Language · Computer Science 2018-04-24 Renjie Zheng , Junkun Chen , Xipeng Qiu

There is increasing evidence of Human Label Variation (HLV) in Natural Language Inference (NLI), where annotators assign different labels to the same premise-hypothesis pair. However, within-label variation--cases where annotators agree on…

Computation and Language · Computer Science 2025-10-09 Pingjun Hong , Beiduo Chen , Siyao Peng , Marie-Catherine de Marneffe , Barbara Plank

In the summarization domain, a key requirement for summaries is to be factually consistent with the input document. Previous work has found that natural language inference (NLI) models do not perform competitively when applied to…

Computation and Language · Computer Science 2021-11-19 Philippe Laban , Tobias Schnabel , Paul N. Bennett , Marti A. Hearst

While Indic NLP has made rapid advances recently in terms of the availability of corpora and pre-trained models, benchmark datasets on standard NLU tasks are limited. To this end, we introduce IndicXNLI, an NLI dataset for 11 Indic…

Computation and Language · Computer Science 2022-04-20 Divyanshu Aggarwal , Vivek Gupta , Anoop Kunchukuttan