English
Related papers

Related papers: Analyzing Compositionality-Sensitivity of NLI Mode…

200 papers

Natural language inference (NLI) is the task of determining if a natural language hypothesis can be inferred from a given premise in a justifiable manner. NLI was proposed as a benchmark task for natural language understanding. Existing…

Computation and Language · Computer Science 2018-06-15 Aakanksha Naik , Abhilasha Ravichander , Norman Sadeh , Carolyn Rose , Graham Neubig

In the interest of interpreting neural NLI models and their reasoning strategies, we carry out a systematic probing study which investigates whether these models capture the crucial semantic features central to natural logic: monotonicity…

Computation and Language · Computer Science 2023-11-09 Julia Rozanova , Deborah Ferreira , Marco Valentino , Mokanrarangan Thayaparan , Andre Freitas

We analyze two Natural Language Inference data sets with respect to their linguistic features. The goal is to identify those syntactic and semantic properties that are particularly hard to comprehend for a machine learning model. To this…

Computation and Language · Computer Science 2022-10-20 Maren Pielka , Felix Rode , Lisa Pucknat , Tobias Deußer , Rafet Sifa

Comparative constructions pose a challenge in Natural Language Inference (NLI), which is the task of determining whether a text entails a hypothesis. Comparatives are structurally complex in that they interact with other linguistic…

Computation and Language · Computer Science 2020-05-19 Izumi Haruta , Koji Mineshima , Daisuke Bekki

We introduce a synthetic dataset called Sentences Involving Complex Compositional Knowledge (SICCK) and a novel analysis that investigates the performance of Natural Language Inference (NLI) models to understand compositionality in logic.…

Computation and Language · Computer Science 2025-10-21 Sushma Anand Akoju , Robert Vacareanu , Haris Riaz , Eduardo Blanco , Mihai Surdeanu

While deep learning models are making fast progress on the task of Natural Language Inference, recent studies have also shown that these models achieve high accuracy by exploiting several dataset biases, and without deep understanding of…

Computation and Language · Computer Science 2020-05-15 Xiang Zhou , Mohit Bansal

Large language models (LLMs) are increasingly applied in multilingual contexts, yet their capacity for consistent, logically grounded alignment across languages remains underexplored. We present a controlled evaluation framework for…

Computation and Language · Computer Science 2025-08-21 Samir Abdaljalil , Erchin Serpedin , Khalid Qaraqe , Hasan Kurban

Sensitivity of deep-neural models to input noise is known to be a challenging problem. In NLP, model performance often deteriorates with naturally occurring noise, such as spelling errors. To mitigate this issue, models may leverage…

Computation and Language · Computer Science 2021-11-18 Jakub Náplava , Martin Popel , Milan Straka , Jana Straková

While many natural language inference (NLI) datasets target certain semantic phenomena, e.g., negation, tense & aspect, monotonicity, and presupposition, to the best of our knowledge, there is no NLI dataset that involves diverse types of…

Computation and Language · Computer Science 2023-07-06 Lasha Abzianidze , Joost Zwarts , Yoad Winter

We propose SETI (Systematicity Evaluation of Textual Inference), a novel and comprehensive benchmark designed for evaluating pre-trained language models (PLMs) for their systematicity capabilities in the domain of textual inference.…

Computation and Language · Computer Science 2023-05-25 Xiyan Fu , Anette Frank

State-of-the-art spoken language understanding (SLU) models have shown tremendous success in benchmark SLU datasets, yet they still fail in many practical scenario due to the lack of model compositionality when trained on limited training…

Computation and Language · Computer Science 2023-12-27 Avik Ray , Yilin Shen , Hongxia Jin

Compositional Natural Language Inference has been explored to assess the true abilities of neural models to perform NLI. Yet, current evaluations assume models to have full access to all primitive inferences in advance, in contrast to…

Computation and Language · Computer Science 2024-07-29 Xiyan Fu , Anette Frank

Despite a multitude of empirical studies, little consensus exists on whether neural networks are able to generalise compositionally, a controversy that, in part, stems from a lack of agreement about what it means for a neural model to be…

Computation and Language · Computer Science 2020-02-25 Dieuwke Hupkes , Verna Dankers , Mathijs Mul , Elia Bruni

Natural language inference (NLI) requires models to learn and apply commonsense knowledge. These reasoning abilities are particularly important for explainable NLI systems that generate a natural language explanation in addition to their…

Computation and Language · Computer Science 2021-10-14 Hendrik Schuff , Hsiu-Yu Yang , Heike Adel , Ngoc Thang Vu

Many natural language inference (NLI) datasets contain biases that allow models to perform well by only using a biased subset of the input, without considering the remainder features. For instance, models are able to make a classification…

Computation and Language · Computer Science 2021-09-01 Dimion Asael , Zachary Ziegler , Yonatan Belinkov

Natural language inference (NLI) is a fundamental NLP task, investigating the entailment relationship between two texts. Popular NLI datasets present the task at sentence-level. While adequate for testing semantic representations, they fall…

Computation and Language · Computer Science 2020-11-11 Hanmeng Liu , Leyang Cui , Jian Liu , Yue Zhang

Recombining known primitive concepts into larger novel combinations is a quintessentially human cognitive capability. Whether large neural models in NLP can acquire this ability while learning from data is an open question. In this paper,…

Computation and Language · Computer Science 2023-08-02 Josef Valvoda , Naomi Saphra , Jonathan Rawski , Adina Williams , Ryan Cotterell

We address whether neural models for Natural Language Inference (NLI) can learn the compositional interactions between lexical entailment and negation, using four methods: the behavioral evaluation methods of (1) challenge test sets and (2)…

Computation and Language · Computer Science 2020-11-24 Atticus Geiger , Kyle Richardson , Christopher Potts

Natural Language Inference (NLI) has been a cornerstone task in evaluating language models' inferential reasoning capabilities. However, the standard three-way classification scheme used in NLI has well-known shortcomings in evaluating…

Computation and Language · Computer Science 2023-06-19 Animesh Nighojkar , Antonio Laverghetta , John Licato

Large-scale pre-trained language models have demonstrated high performance on standard datasets for natural language inference (NLI) tasks. Unfortunately, these evaluations can be misleading, as although the models can perform well on…

Computation and Language · Computer Science 2025-01-09 Daniel Petrov