English
Related papers

Related papers: Stress Test Evaluation for Natural Language Infere…

200 papers

Natural Language Inference (NLI) aims to determine the logic relationships (i.e., entailment, neutral and contradiction) between a pair of premise and hypothesis. Recently, the alignment mechanism effectively helps NLI by capturing the…

Computation and Language · Computer Science 2019-11-12 Zhen Cheng , Zaixiang Zheng , Xin-Yu Dai , Shujian Huang , Jiajun Chen

Natural Language Inference (NLI) has been extensively studied by the NLP community as a framework for estimating the semantic relation between sentence pairs. While early work identified certain biases in NLI models, recent advancements in…

Computation and Language · Computer Science 2022-11-02 Tal Schuster , Sihao Chen , Senaka Buthpitiya , Alex Fabrikant , Donald Metzler

In the interest of interpreting neural NLI models and their reasoning strategies, we carry out a systematic probing study which investigates whether these models capture the crucial semantic features central to natural logic: monotonicity…

Computation and Language · Computer Science 2023-11-09 Julia Rozanova , Deborah Ferreira , Marco Valentino , Mokanrarangan Thayaparan , Andre Freitas

Rigorous evaluation of the causal effects of semantic features on language model predictions can be hard to achieve for natural language reasoning problems. However, this is such a desirable form of analysis from both an interpretability…

Computation and Language · Computer Science 2024-04-04 Julia Rozanova , Marco Valentino , Andre Freitas

Natural Language Inference (NLI) is fundamental to many Natural Language Processing (NLP) applications including semantic search and question answering. The NLI problem has gained significant attention thanks to the release of large scale,…

Lexical inference in context (LIiC) is the task of recognizing textual entailment between two very similar sentences, i.e., sentences that only differ in one expression. It can therefore be seen as a variant of the natural language…

Computation and Language · Computer Science 2021-04-28 Martin Schmitt , Hinrich Schütze

Scientific Natural Language Inference (NLI) is the task of predicting the semantic relation between a pair of sentences extracted from research articles. The automatic annotation method based on distant supervision for the training set of…

Computation and Language · Computer Science 2024-06-24 Mobashir Sadat , Cornelia Caragea

Finding counterevidence to statements is key to many tasks, including counterargument generation. We build a system that, given a statement, retrieves counterevidence from diverse sources on the Web. At the core of this system is a natural…

Computation and Language · Computer Science 2021-09-21 Yohan Jo , Haneul Yoo , JinYeong Bak , Alice Oh , Chris Reed , Eduard Hovy

The release of large natural language inference (NLI) datasets like SNLI and MNLI have led to rapid development and improvement of completely neural systems for the task. Most recently, heavily pre-trained, Transformer-based models like…

Computation and Language · Computer Science 2019-12-10 Tiffany Chien , Jugal Kalita

Much of human communication depends on implication, conveying meaning beyond literal words to express a wider range of thoughts, intentions, and feelings. For models to better understand and facilitate human communication, they must be…

Computation and Language · Computer Science 2025-01-20 Shreya Havaldar , Hamidreza Alvari , John Palowitch , Mohammad Javad Hosseini , Senaka Buthpitiya , Alex Fabrikant

We revisit the reference determinacy (RD) assumption in the task of natural language inference (NLI), i.e., the premise and hypothesis are assumed to refer to the same context when human raters annotate a label. While RD is a practical…

Computation and Language · Computer Science 2025-02-11 Sihao Chen , Chaitanya Malaviya , Alex Fabrikant , Hagai Taitelbaum , Tal Schuster , Senaka Buthpitiya , Dan Roth

Comparative constructions pose a challenge in Natural Language Inference (NLI), which is the task of determining whether a text entails a hypothesis. Comparatives are structurally complex in that they interact with other linguistic…

Computation and Language · Computer Science 2020-05-19 Izumi Haruta , Koji Mineshima , Daisuke Bekki

Monotonicity reasoning is one of the important reasoning skills for any intelligent natural language inference (NLI) model in that it requires the ability to capture the interaction between lexical and syntactic structures. Since no test…

Computation and Language · Computer Science 2019-06-28 Hitomi Yanaka , Koji Mineshima , Daisuke Bekki , Kentaro Inui , Satoshi Sekine , Lasha Abzianidze , Johan Bos

In this paper we present a technique of NLP to tackle the problem of inference relation (NLI) between pairs of sentences in a target language of choice without a language-specific training dataset. We exploit a generic translation dataset,…

Computation and Language · Computer Science 2023-09-07 Lorenzo Corradi , Alessandro Manenti , Francesca Del Bonifro , Francesco Setti , Dario Del Sorbo

This paper describes our system for addressing SMM4H 2023 Shared Task 2 on "Classification of sentiment associated with therapies (aspect-oriented)". In our work, we adopt an approach based on Natural language inference (NLI) to formulate…

Computation and Language · Computer Science 2023-12-08 Rajaraman Kanagasabai , Anitha Veeramani

While discriminative neural network classifiers are generally preferred, recent work has shown advantages of generative classifiers in term of data efficiency and robustness. In this paper, we focus on natural language inference (NLI). We…

Computation and Language · Computer Science 2020-10-09 Xiaoan Ding , Tianyu Liu , Baobao Chang , Zhifang Sui , Kevin Gimpel

Natural Language Inference (NLI) is a cornerstone of Natural Language Processing (NLP), providing insights into the entailment relationships between text pairings. It is a critical component of Natural Language Understanding (NLU),…

Computation and Language · Computer Science 2024-05-08 Fatema Tuj Johora Faria , Mukaffi Bin Moin , Asif Iftekher Fahim , Pronay Debnath , Faisal Muhammad Shah

Natural language explanations represent a proxy for evaluating explanation-based and multi-step Natural Language Inference (NLI) models. However, assessing the validity of explanations for NLI is challenging as it typically involves the…

Computation and Language · Computer Science 2024-10-14 Xin Quan , Marco Valentino , Louise A. Dennis , André Freitas

Natural Language Inference (NLI) or Recognizing Textual Entailment (RTE) aims at predicting the relation between a pair of sentences (premise and hypothesis) as entailment, contradiction or semantic independence. Although deep learning…

Computation and Language · Computer Science 2022-11-08 Mobashir Sadat , Cornelia Caragea

Most research on hate speech detection has focused on English where a sizeable amount of labeled training data is available. However, to expand hate speech detection into more languages, approaches that require minimal training data are…

Computation and Language · Computer Science 2023-06-13 Janis Goldzycher , Moritz Preisig , Chantal Amrhein , Gerold Schneider
‹ Prev 1 3 4 5 6 7 10 Next ›