English
Related papers

Related papers: Analyzing Compositionality-Sensitivity of NLI Mode…

200 papers

Natural Language Inference (NLI) is the task of inferring whether the hypothesis can be justified by the given premise. Basically, we classify the hypothesis into three labels(entailment, neutrality and contradiction) given the premise. NLI…

Computation and Language · Computer Science 2024-12-11 Zijiang Yang

Natural Language Inference (NLI) models are known to learn from biases and artefacts within their training data, impacting how well they generalise to other unseen datasets. Existing de-biasing approaches focus on preventing the models from…

Computation and Language · Computer Science 2022-05-03 Joe Stacey , Yonatan Belinkov , Marek Rei

State-of-the-art natural language processing systems rely on supervision in the form of annotated data to learn competent models. These models are generally trained on data in a single language (usually English), and cannot be directly used…

Computation and Language · Computer Science 2018-09-14 Alexis Conneau , Guillaume Lample , Ruty Rinott , Adina Williams , Samuel R. Bowman , Holger Schwenk , Veselin Stoyanov

Natural language contexts display logical regularities with respect to substitutions of related concepts: these are captured in a functional order-theoretic property called monotonicity. For a certain class of NLI problems where the…

Computation and Language · Computer Science 2021-05-18 Julia Rozanova , Deborah Ferreira , Mokanarangan Thayaparan , Marco Valentino , André Freitas

Compositionality is considered central to language abilities. As performant language systems, how do large language models (LLMs) do on compositional tasks? We evaluate adjective-noun compositionality in LLMs using two complementary setups:…

Computation and Language · Computer Science 2026-03-17 Ruchira Dhar , Qiwei Peng , Anders Søgaard

Despite the recent success of deep neural networks in natural language processing, the extent to which they can demonstrate human-like generalization capacities for natural language understanding remains unclear. We explore this issue in…

Computation and Language · Computer Science 2021-01-27 Hitomi Yanaka , Koji Mineshima , Kentaro Inui

Recently, there has been much interest in the question of whether deep natural language understanding models exhibit systematicity; generalizing such that units like words make consistent contributions to the meaning of the sentences in…

Computation and Language · Computer Science 2020-08-26 Emily Goodwin , Koustuv Sinha , Timothy J. O'Donnell

Learning intents and slot labels from user utterances is a fundamental step in all spoken language understanding (SLU) and dialog systems. State-of-the-art neural network based methods, after deployment, often suffer from performance…

Computation and Language · Computer Science 2018-09-19 Avik Ray , Yilin Shen , Hongxia Jin

Monotonicity reasoning is one of the important reasoning skills for any intelligent natural language inference (NLI) model in that it requires the ability to capture the interaction between lexical and syntactic structures. Since no test…

Computation and Language · Computer Science 2019-06-28 Hitomi Yanaka , Koji Mineshima , Daisuke Bekki , Kentaro Inui , Satoshi Sekine , Lasha Abzianidze , Johan Bos

Many recent studies have shown that for models trained on datasets for natural language inference (NLI), it is possible to make correct predictions by merely looking at the hypothesis while completely ignoring the premise. In this work, we…

Computation and Language · Computer Science 2021-03-16 Tianyu Liu , Xin Zheng , Baobao Chang , Zhifang Sui

Modern Natural Language Processing (NLP) models are known to be sensitive to input perturbations and their performance can decrease when applied to real-world, noisy data. However, it is still unclear why models are less robust to some…

Computation and Language · Computer Science 2022-03-21 Yunxiang Zhang , Liangming Pan , Samson Tan , Min-Yen Kan

Natural language is characterized by compositionality: the meaning of a complex expression is constructed from the meanings of its constituent parts. To facilitate the evaluation of the compositional abilities of language processing…

Computation and Language · Computer Science 2020-10-13 Najoung Kim , Tal Linzen

Compared to English, German word order is freer and therefore poses additional challenges for natural language inference (NLI). We create WOGLI (Word Order in German Language Inference), the first adversarial NLI dataset for German word…

Computation and Language · Computer Science 2023-06-08 Ines Reinig , Katja Markert

In the domain of Natural Language Inference (NLI), especially in tasks involving the classification of multiple input texts, the Cross-Entropy Loss metric is widely employed as a standard for error measurement. However, this metric falls…

Computation and Language · Computer Science 2024-10-03 Manish Sanwal

Recent years have seen a growing number of publications that analyse Natural Language Inference (NLI) datasets for superficial cues, whether they undermine the complexity of the tasks underlying those datasets and how they impact those…

Computation and Language · Computer Science 2020-06-01 Viktor Schlegel , Goran Nenadic , Riza Batista-Navarro

Language models can achieve high accuracy on natural language tasks such as NLI, but performance suffers on manually created adversarial examples. We investigate the performance of a language model trained on the Stanford Natural Language…

Computation and Language · Computer Science 2024-10-31 Chris Achard

The principle of compositionality, which enables natural language to represent complex concepts via a structured combination of simpler ones, allows us to convey an open-ended set of messages using a limited vocabulary. If compositionality…

Computation and Language · Computer Science 2020-02-18 Yi Ren , Shangmin Guo , Matthieu Labeau , Shay B. Cohen , Simon Kirby

Neural network models have been very successful at achieving high accuracy on natural language inference (NLI) tasks. However, as demonstrated in recent literature, when tested on some simple adversarial examples, most of the models suffer…

Computation and Language · Computer Science 2019-09-04 Alexander Hanbo Li , Abhinav Sethy

Natural Language Inference (NLI) is a cornerstone of Natural Language Processing (NLP), providing insights into the entailment relationships between text pairings. It is a critical component of Natural Language Understanding (NLU),…

Computation and Language · Computer Science 2024-05-08 Fatema Tuj Johora Faria , Mukaffi Bin Moin , Asif Iftekher Fahim , Pronay Debnath , Faisal Muhammad Shah

NLP models have progressed drastically in recent years, according to numerous datasets proposed to evaluate performance. Questions remain, however, about how particular dataset design choices may impact the conclusions we draw about model…

Computation and Language · Computer Science 2023-10-27 Kaiser Sun , Adina Williams , Dieuwke Hupkes