English
Related papers

Related papers: A Multilingual Perspective Towards the Evaluation …

200 papers

We introduce Uncertain Natural Language Inference (UNLI), a refinement of Natural Language Inference (NLI) that shifts away from categorical labels, targeting instead the direct prediction of subjective probability assessments. We…

Computation and Language · Computer Science 2020-05-06 Tongfei Chen , Zhengping Jiang , Adam Poliak , Keisuke Sakaguchi , Benjamin Van Durme

There has been significant debate in the NLP community about whether or not attention weights can be used as an explanation - a mechanism for interpreting how important each input token is for a particular prediction. The validity of…

Computation and Language · Computer Science 2022-05-11 Michael Neely , Stefan F. Schouten , Maurits Bleeker , Ana Lucic

We introduce MorphNLI, a modular step-by-step approach to natural language inference (NLI). When classifying the premise-hypothesis pairs into {entailment, contradiction, neutral}, we use a language model to generate the necessary edits to…

Computation and Language · Computer Science 2026-02-16 Vlad Andrei Negru , Robert Vacareanu , Camelia Lemnaru , Mihai Surdeanu , Rodica Potolea

We investigate the use of Natural Language Inference (NLI) in automating requirements engineering tasks. In particular, we focus on three tasks: requirements classification, identification of requirements specification defects, and…

Software Engineering · Computer Science 2024-05-09 Mohamad Fazelnia , Viktoria Koscinski , Spencer Herzog , Mehdi Mirakhorli

Natural language-based assessment (NLA) is an approach to second language assessment that uses instructions - expressed in the form of can-do descriptors - originally intended for human examiners, aiming to determine whether large language…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-15 Stefano Bannò , Rao Ma , Mengjie Qian , Siyuan Tang , Kate Knill , Mark Gales

Natural Language Inference (NLI) is a fundamental task in natural language processing. While NLI has developed many sub-directions such as sentence-level NLI, document-level NLI and cross-lingual NLI, Cross-Document Cross-Lingual NLI…

Computation and Language · Computer Science 2025-10-08 Mengying Yuan , Wenhao Wang , Zixuan Wang , Yujie Huang , Kangli Wei , Fei Li , Chong Teng , Donghong Ji

Natural Language Inference (NLI) aims to determine the logic relationships (i.e., entailment, neutral and contradiction) between a pair of premise and hypothesis. Recently, the alignment mechanism effectively helps NLI by capturing the…

Computation and Language · Computer Science 2019-11-12 Zhen Cheng , Zaixiang Zheng , Xin-Yu Dai , Shujian Huang , Jiajun Chen

Large language models (LLMs) achieve strong performance across many natural language processing tasks, yet their decision processes remain difficult to interpret. This lack of transparency creates challenges for trust, debugging, and…

Computation and Language · Computer Science 2026-04-20 Venkata Abhinandan Kancharla

Attributional inference, the ability to predict latent intentions behind observed actions, is a critical yet underexplored capability for large language models (LLMs) operating in multi-agent environments. Traditional natural language…

Computation and Language · Computer Science 2026-01-14 Xin Quan , Jiafeng Xiong , Marco Valentino , André Freitas

We consider the problem of finding plausible knowledge that is missing from a given ontology, as a generalisation of the well-studied taxonomy expansion task. One line of work treats this task as a Natural Language Inference (NLI) problem,…

Computation and Language · Computer Science 2024-03-27 Na Li , Thomas Bailleux , Zied Bouraoui , Steven Schockaert

Large Language Models (LLMs) have demonstrated remarkable capabilities across various applications, fundamentally reshaping the landscape of natural language processing (NLP) research. However, recent evaluation frameworks often rely on the…

Computation and Language · Computer Science 2024-07-10 Chenyang Lyu , Minghao Wu , Alham Fikri Aji

The expansion of explainable artificial intelligence as a field of research has generated numerous methods of visualizing and understanding the black box of a machine learning model. Attribution maps are generally used to highlight the…

Machine Learning · Computer Science 2023-08-02 Ian E. Nielsen , Ravi P. Ramachandran , Nidhal Bouaynaya , Hassan M. Fathallah-Shaykh , Ghulam Rasool

Deep learning (DL) based language models achieve high performance on various benchmarks for Natural Language Inference (NLI). And at this time, symbolic approaches to NLI are receiving less attention. Both approaches (symbolic and DL) have…

Computation and Language · Computer Science 2021-06-11 Zeming Chen , Qiyue Gao , Lawrence S. Moss

Natural Language Inference (NLI) is a central task in natural language understanding with applications in fact-checking, question answering, and information retrieval. Despite its importance, current NLI systems heavily rely on supervised…

Computation and Language · Computer Science 2025-05-07 Pablo Miralles-González , Javier Huertas-Tato , Alejandro Martín , David Camacho

Various XAI attribution methods have been recently proposed for the transformer architecture, allowing for insights into the decision-making process of large language models by assigning importance scores to input tokens and intermediate…

Computation and Language · Computer Science 2025-02-25 Leila Arras , Bruno Puri , Patrick Kahardipraja , Sebastian Lapuschkin , Wojciech Samek

Large Language Models (LLMs) offer natural language explanations as an alternative to feature attribution methods for model interpretability. However, despite their plausibility, they may not reflect the model's true reasoning faithfully.…

Computation and Language · Computer Science 2025-12-29 Kerem Zaman , Shashank Srivastava

Beyond individual languages, multilingual natural language processing (NLP) research increasingly aims to develop models that perform well across languages generally. However, evaluating these systems on all the world's languages is…

Computation and Language · Computer Science 2025-09-09 Esther Ploeger , Wessel Poelman , Andreas Holck Høeg-Petersen , Anders Schlichtkrull , Miryam de Lhoneux , Johannes Bjerva

Feature attribution methods help make machine learning-based inference explainable by determining how much one or several features have contributed to a model's output. A particularly popular attribution method is based on the Shapley value…

Artificial Intelligence · Computer Science 2025-11-04 Filip Naudot , Tobias Sundqvist , Timotheus Kampik

Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative…

Machine Learning · Computer Science 2019-11-06 Mengjiao Yang , Been Kim

The study of the attribution of input features to the output of neural network models is an active area of research. While numerous Explainable AI (XAI) techniques have been proposed to interpret these models, the systematic and automated…

Computation and Language · Computer Science 2026-03-13 Aria Nourbakhsh , Salima Lamsiyah , Adelaide Danilov , Christoph Schommer