English
Related papers

Related papers: Breaking NLI Systems with Sentences that Require S…

200 papers

Neural language representation models such as BERT, pre-trained on large-scale unstructured corpora lack explicit grounding to real-world commonsense knowledge and are often unable to remember facts required for reasoning and inference.…

Computation and Language · Computer Science 2021-08-04 Amit Gajbhiye , Noura Al Moubayed , Steven Bradley

We propose a simple neural architecture for natural language inference. Our approach uses attention to decompose the problem into subproblems that can be solved separately, thus making it trivially parallelizable. On the Stanford Natural…

Computation and Language · Computer Science 2016-09-27 Ankur P. Parikh , Oscar Täckström , Dipanjan Das , Jakob Uszkoreit

This report describes the entry by the Intelligent Knowledge Management (IKM) Lab in the WSDM 2019 Fake News Classification challenge. We treat the task as natural language inference (NLI). We individually train a number of the strongest…

Computation and Language · Computer Science 2019-07-18 Kai-Chou Yang , Timothy Niven , Hung-Yu Kao

Sequence-to-sequence transduction is the core problem in language processing applications as diverse as semantic parsing, machine translation, and instruction following. The neural network models that provide the dominant solution to these…

Computation and Language · Computer Science 2021-06-09 Ekin Akyürek , Jacob Andreas

Identifying arguments is a necessary prerequisite for various tasks in automated discourse analysis, particularly within contexts such as political debates, online discussions, and scientific reasoning. In addition to theoretical advances…

Computation and Language · Computer Science 2025-05-29 Marc Feger , Katarina Boland , Stefan Dietze

Making theory-of-mind inferences from human dialogue is a strong indicator of a model's underlying social abilities, which are fundamental for adept AI assistants. However, large language and reasoning models struggle to understand…

Computation and Language · Computer Science 2025-10-08 Akhil Deo , Kate Sanders , Benjamin Van Durme

Ensemble methods using multiple classifiers have proven to be the most successful approach for the task of Native Language Identification (NLI), achieving the current state of the art. However, a systematic examination of ensemble methods…

Computation and Language · Computer Science 2017-03-21 Shervin Malmasi , Mark Dras

Natural Language Processing systems are heavily dependent on the availability of annotated data to train practical models. Primarily, models are trained on English datasets. In recent times, significant advances have been made in…

Computation and Language · Computer Science 2023-01-18 Ankit Kumar Upadhyay , Harsit Kumar Upadhya

Negation is a core construction in natural language. Despite being very successful on many tasks, state-of-the-art pre-trained language models often handle negation incorrectly. To improve language models in this regard, we propose to…

Computation and Language · Computer Science 2021-05-11 Arian Hosseini , Siva Reddy , Dzmitry Bahdanau , R Devon Hjelm , Alessandro Sordoni , Aaron Courville

This position paper argues that annotation disagreement in Natural Language Inference (NLI) is not mere noise but often reflects meaningful variation, especially when triggered by ambiguity in the premise or hypothesis. While underspecified…

Computation and Language · Computer Science 2025-09-03 Chathuri Jayaweera , Bonnie J. Dorr

Natural language contexts display logical regularities with respect to substitutions of related concepts: these are captured in a functional order-theoretic property called monotonicity. For a certain class of NLI problems where the…

Computation and Language · Computer Science 2021-05-18 Julia Rozanova , Deborah Ferreira , Mokanarangan Thayaparan , Marco Valentino , André Freitas

The task of natural language inference (NLI) asks whether a given premise (expressed in NL) entails a given NL hypothesis. NLI benchmarks contain human ratings of entailment, but the meaning relationships driving these ratings are not…

Computation and Language · Computer Science 2023-09-06 Juri Opitz , Shira Wein , Julius Steen , Anette Frank , Nathan Schneider

Multilingual language models achieve impressive zero-shot accuracies in many languages in complex tasks such as Natural Language Inference (NLI). Examples in NLI (and equivalent complex tasks) often pertain to various types of sub-tasks,…

Computation and Language · Computer Science 2021-10-07 Karthikeyan K , Aalok Sathe , Somak Aditya , Monojit Choudhury

Natural Language Inference (NLI) is a hot topic research in natural language processing, contradiction detection between sentences is a special case of NLI. This is considered a difficult NLP task which has a big influence when added as a…

Computation and Language · Computer Science 2023-04-05 Khloud Al Jallad , Nada Ghneim

Pre-training by language modeling has become a popular and successful approach to NLP tasks, but we have yet to understand exactly what linguistic capacities these pre-training processes confer upon models. In this paper we introduce a…

Computation and Language · Computer Science 2020-07-14 Allyson Ettinger

Obtaining human-like performance in NLP is often argued to require compositional generalisation. Whether neural networks exhibit this ability is usually studied by training models on highly compositional synthetic data. However,…

Computation and Language · Computer Science 2022-04-01 Verna Dankers , Elia Bruni , Dieuwke Hupkes

Contrastive learning has proven to be an effective method for pre-training models using weakly labeled data in the vision domain. Sentence transformers are the NLP counterparts to this architecture, and have been growing in popularity due…

Computation and Language · Computer Science 2023-11-30 Tanmay Chavan , Shantanu Patankar , Aditya Kane , Omkar Gokhale , Geetanjali Kale , Raviraj Joshi

Large Language Models (LLMs) are claimed to be capable of Natural Language Inference (NLI), necessary for applied tasks like question answering and summarization. We present a series of behavioral studies on several LLM families (LLaMA,…

Computation and Language · Computer Science 2023-10-24 Nick McKenna , Tianyi Li , Liang Cheng , Mohammad Javad Hosseini , Mark Johnson , Mark Steedman

The abductive natural language inference task ($\alpha$NLI) is proposed to infer the most plausible explanation between the cause and the event. In the $\alpha$NLI task, two observations are given, and the most plausible hypothesis is asked…

Computation and Language · Computer Science 2022-12-21 Linhao Li , Ming Xu , Yongfeng Dong , Xin Li , Ao Wang

Modern language models (LMs) exhibit strong deductive reasoning capabilities, yet standard evaluations emphasize correctness while overlooking a key aspect of reasoning: efficiency. In real-world reasoning scenarios, much of the available…