English
Related papers

Related papers: Improving the Natural Language Inference robustnes…

200 papers

Natural Language Inference (NLI) aims to determine the logic relationships (i.e., entailment, neutral and contradiction) between a pair of premise and hypothesis. Recently, the alignment mechanism effectively helps NLI by capturing the…

Computation and Language · Computer Science 2019-11-12 Zhen Cheng , Zaixiang Zheng , Xin-Yu Dai , Shujian Huang , Jiajun Chen

In the interest of interpreting neural NLI models and their reasoning strategies, we carry out a systematic probing study which investigates whether these models capture the crucial semantic features central to natural logic: monotonicity…

Computation and Language · Computer Science 2023-11-09 Julia Rozanova , Deborah Ferreira , Marco Valentino , Mokanrarangan Thayaparan , Andre Freitas

Natural Language Inference (NLI) is a fundamental and challenging task in Natural Language Processing (NLP). Most existing methods only apply one-pass inference process on a mixed matching feature, which is a concatenation of different…

Computation and Language · Computer Science 2019-01-09 Chunhua Liu , Shan Jiang , Hainan Yu , Dong Yu

Natural Language Inference (NLI) is a fundamental task in natural language processing. While NLI has developed many sub-directions such as sentence-level NLI, document-level NLI and cross-lingual NLI, Cross-Document Cross-Lingual NLI…

Computation and Language · Computer Science 2025-10-08 Mengying Yuan , Wenhao Wang , Zixuan Wang , Yujie Huang , Kangli Wei , Fei Li , Chong Teng , Donghong Ji

Natural Language Inference (NLI) is a growingly essential task in natural language understanding, which requires inferring the relationship between the sentence pairs (premise and hypothesis). Recently, low-resource natural language…

Computation and Language · Computer Science 2022-06-01 Shu'ang Li , Xuming Hu , Li Lin , Aiwei Liu , Lijie Wen , Philip S. Yu

The reliance of text classifiers on spurious correlations can lead to poor generalization at deployment, raising concerns about their use in safety-critical domains such as healthcare. In this work, we propose to use counterfactual data…

Machine Learning · Computer Science 2024-01-10 Amir Feder , Yoav Wald , Claudia Shi , Suchi Saria , David Blei

Natural language inference (NLI) data has proven useful in benchmarking and, especially, as pretraining data for tasks requiring language understanding. However, the crowdsourcing protocol that was used to collect this data has known issues…

Computation and Language · Computer Science 2020-10-01 Samuel R. Bowman , Jennimaria Palomaki , Livio Baldini Soares , Emily Pitler

Free-text explanations are expressive and easy to understand, but many datasets lack annotated explanation data, making it challenging to train models for explainable predictions. To address this, we investigate how to use existing…

Computation and Language · Computer Science 2025-02-10 Jing Yang , Max Glockner , Anderson Rocha , Iryna Gurevych

Do state-of-the-art models for language understanding already have, or can they easily learn, abilities such as boolean coordination, quantification, conditionals, comparatives, and monotonicity reasoning (i.e., reasoning about word…

Computation and Language · Computer Science 2019-12-03 Kyle Richardson , Hai Hu , Lawrence S. Moss , Ashish Sabharwal

When evaluating an answer choice for Reading Comprehension task, other answer choices available for the question and the answers of related questions about the same paragraph often provide valuable information. In this paper, we propose a…

Computation and Language · Computer Science 2021-01-01 Rajkumar Pujari , Dan Goldwasser

This paper addresses the classification of Arabic text data in the field of Natural Language Processing (NLP), with a particular focus on Natural Language Inference (NLI) and Contradiction Detection (CD). Arabic is considered a…

Computation and Language · Computer Science 2023-07-28 Mohammad Majd Saad Al Deen , Maren Pielka , Jörn Hees , Bouthaina Soulef Abdou , Rafet Sifa

Recent years have seen the rise of large language models (LLMs), where practitioners use task-specific prompts; this was shown to be effective for a variety of tasks. However, when applied to semantic textual similarity (STS) and natural…

Computation and Language · Computer Science 2024-02-06 Yuxia Wang , Minghan Wang , Preslav Nakov

Large annotated datasets in NLP are overwhelmingly in English. This is an obstacle to progress in other languages. Unfortunately, obtaining new annotated resources for each task in each language would be prohibitively expensive. At the same…

Computation and Language · Computer Science 2020-10-21 Emrah Budur , Rıza Özçelik , Tunga Güngör , Christopher Potts

Natural Language Inference (NLI) has been a cornerstone task in evaluating language models' inferential reasoning capabilities. However, the standard three-way classification scheme used in NLI has well-known shortcomings in evaluating…

Computation and Language · Computer Science 2023-06-19 Animesh Nighojkar , Antonio Laverghetta , John Licato

This paper introduces the Multi-Genre Natural Language Inference (MultiNLI) corpus, a dataset designed for use in the development and evaluation of machine learning models for sentence understanding. In addition to being one of the largest…

Computation and Language · Computer Science 2018-02-21 Adina Williams , Nikita Nangia , Samuel R. Bowman

Generating diverse, interesting responses to chitchat conversations is a problem for neural conversational agents. This paper makes two substantial contributions to improving diversity in dialogue generation. First, we propose a novel…

Computation and Language · Computer Science 2022-05-04 Katherine Stasaski , Marti A. Hearst

Missing information is a common issue of dialogue summarization where some information in the reference summaries is not covered in the generated summaries. To address this issue, we propose to utilize natural language inference (NLI)…

Computation and Language · Computer Science 2023-01-26 Kung-Hsiang Huang , Siffi Singh , Xiaofei Ma , Wei Xiao , Feng Nan , Nicholas Dingwall , William Yang Wang , Kathleen McKeown

Large language models (LLMs) are now rapidly advancing and surpassing human abilities on many natural language tasks. However, aligning these super-human LLMs with human knowledge remains challenging because the supervision signals from…

Computation and Language · Computer Science 2024-06-28 Yue Guo , Yi Yang

Large language models (LLMs) and theorem provers (TPs) can be effectively combined for verifiable natural language inference (NLI). However, existing approaches rely on a fixed logical formalism, a feature that limits robustness and…

Artificial Intelligence · Computer Science 2026-01-12 Ali Farjami , Luca Redondi , Marco Valentino

An increasing amount of research in Natural Language Inference (NLI) focuses on the application and evaluation of Large Language Models (LLMs) and their reasoning capabilities. Despite their success, however, LLMs are still prone to factual…

Computation and Language · Computer Science 2024-02-02 Xin Quan , Marco Valentino , Louise A. Dennis , André Freitas