English
Related papers

Related papers: Logical Reasoning with Span-Level Predictions for …

200 papers

Despite the significant improvements achieved by large language models (LLMs) in English reasoning tasks, these models continue to struggle with multilingual reasoning. Recent studies leverage a full-parameter and two-stage training…

Computation and Language · Computer Science 2025-01-08 Yuchun Fan , Yongyu Mu , Yilin Wang , Lei Huang , Junhao Ruan , Bei Li , Tong Xiao , Shujian Huang , Xiaocheng Feng , Jingbo Zhu

We propose SETI (Systematicity Evaluation of Textual Inference), a novel and comprehensive benchmark designed for evaluating pre-trained language models (PLMs) for their systematicity capabilities in the domain of textual inference.…

Computation and Language · Computer Science 2023-05-25 Xiyan Fu , Anette Frank

Standard evaluations of deep learning models for semantics using naturalistic corpora are limited in what they can tell us about the fidelity of the learned representations, because the corpora rarely come with good measures of semantic…

Computation and Language · Computer Science 2018-11-01 Atticus Geiger , Ignacio Cases , Lauri Karttunen , Christopher Potts

Natural language understanding (NLU) and Natural language generation (NLG) tasks hold a strong dual relationship, where NLU aims at predicting semantic labels based on natural language utterances and NLG does the opposite. The prior work…

Computation and Language · Computer Science 2020-10-16 Shang-Yu Su , Yung-Sung Chuang , Yun-Nung Chen

Machine learning models can reach high performance on benchmark natural language processing (NLP) datasets but fail in more challenging settings. We study this issue when a pre-trained model learns dataset artifacts in natural language…

Computation and Language · Computer Science 2023-03-20 Zhenyuan Lu

Recently generating natural language explanations has shown very promising results in not only offering interpretable explanations but also providing additional information and supervision for prediction. However, existing approaches…

Computation and Language · Computer Science 2022-05-30 Wangchunshu Zhou , Jinyi Hu , Hanlin Zhang , Xiaodan Liang , Maosong Sun , Chenyan Xiong , Jian Tang

In today's day and age where information is rapidly spread through online platforms, the rise of fake news poses an alarming threat to the integrity of public discourse, societal trust, and reputed news sources. Classical machine learning…

Computation and Language · Computer Science 2024-10-15 Arjun Shah , Hetansh Shah , Vedica Bafna , Charmi Khandor , Sindhu Nair

We investigate the use of Natural Language Inference (NLI) in automating requirements engineering tasks. In particular, we focus on three tasks: requirements classification, identification of requirements specification defects, and…

Software Engineering · Computer Science 2024-05-09 Mohamad Fazelnia , Viktoria Koscinski , Spencer Herzog , Mehdi Mirakhorli

Neural networks have recently achieved human-level performance on various challenging natural language processing (NLP) tasks, but it is notoriously difficult to understand why a neural network produced a particular prediction. In this…

Computation and Language · Computer Science 2020-05-01 Sharan Narang , Colin Raffel , Katherine Lee , Adam Roberts , Noah Fiedel , Karishma Malkan

The task of abductive natural language inference (\alpha{}nli), to decide which hypothesis is the more likely explanation for a set of observations, is a particularly difficult type of NLI. Instead of just determining a causal relationship,…

Computation and Language · Computer Science 2022-07-12 Emīls Kadiķis , Vaibhav Srivastav , Roman Klinger

Natural Language Inference (NLI) or Recognizing Textual Entailment (RTE) aims at predicting the relation between a pair of sentences (premise and hypothesis) as entailment, contradiction or semantic independence. Although deep learning…

Computation and Language · Computer Science 2022-11-08 Mobashir Sadat , Cornelia Caragea

Modern language models (LMs) exhibit strong deductive reasoning capabilities, yet standard evaluations emphasize correctness while overlooking a key aspect of reasoning: efficiency. In real-world reasoning scenarios, much of the available…

Despite the recent success of deep neural networks in natural language processing, the extent to which they can demonstrate human-like generalization capacities for natural language understanding remains unclear. We explore this issue in…

Computation and Language · Computer Science 2021-01-27 Hitomi Yanaka , Koji Mineshima , Kentaro Inui

Large Language Models (LLMs) have revolutionized natural language processing, yet they struggle with inconsistent reasoning, particularly in novel domains and complex logical sequences. This research introduces Proof of Thought, a framework…

Artificial Intelligence · Computer Science 2024-10-24 Debargha Ganguly , Srinivasan Iyengar , Vipin Chaudhary , Shivkumar Kalyanaraman

The dominating NLP paradigm of training a strong neural predictor to perform one task on a specific dataset has led to state-of-the-art performance in a variety of applications (eg. sentiment classification, span-prediction based question…

Computation and Language · Computer Science 2021-09-06 Paul Michel

Large crowdsourced datasets are widely used for training and evaluating neural models on natural language inference (NLI). Despite these efforts, neural models have a hard time capturing logical inferences, including those licensed by…

Computation and Language · Computer Science 2019-04-30 Hitomi Yanaka , Koji Mineshima , Daisuke Bekki , Kentaro Inui , Satoshi Sekine , Lasha Abzianidze , Johan Bos

Natural Language Inference (NLI) models have been used in various ways to improve the factuality of LLM outputs. This is typically done by applying an NLI model to judge whether the model output is entailed from the supposed evidence,…

Computation and Language · Computer Science 2025-11-04 Sapir Harary , Eran Hirsch , Aviv Slobodkin , David Wan , Mohit Bansal , Ido Dagan

This position paper argues that annotation disagreement in Natural Language Inference (NLI) is not mere noise but often reflects meaningful variation, especially when triggered by ambiguity in the premise or hypothesis. While underspecified…

Computation and Language · Computer Science 2025-09-03 Chathuri Jayaweera , Bonnie J. Dorr

Model robustness to bias is often determined by the generalization on carefully designed out-of-distribution datasets. Recent debiasing methods in natural language understanding (NLU) improve performance on such datasets by pressuring…

Computation and Language · Computer Science 2021-09-10 Michael Mendelson , Yonatan Belinkov

Neuro-symbolic NLP methods aim to leverage the complementary strengths of large language models and formal logical solvers. However, current approaches are mostly static in nature, i.e., the integration of a target solver is predetermined…

Computation and Language · Computer Science 2025-10-09 Lei Xu , Pierre Beckmann , Marco Valentino , André Freitas