English
Related papers

Related papers: EvalxNLP: A Framework for Benchmarking Post-Hoc Ex…

200 papers

Large Language Models (LLMs) have achieved remarkable success in natural language tasks, yet understanding their reasoning processes remains a significant challenge. We address this by introducing XplainLLM, a dataset accompanying an…

Computation and Language · Computer Science 2024-09-24 Zichen Chen , Jianda Chen , Ambuj Singh , Misha Sra

EXplainable Artificial Intelligence (XAI) aims to help users to grasp the reasoning behind the predictions of an Artificial Intelligence (AI) system. Many XAI approaches have emerged in recent years. Consequently, a subfield related to the…

Recent advancements in explainable recommendation have greatly bolstered user experience by elucidating the decision-making rationale. However, the existing methods actually fail to provide effective feedback signals for potentially better…

Information Retrieval · Computer Science 2025-08-08 Jiakai Tang , Jingsen Zhang , Zihang Tian , Xueyang Feng , Lei Wang , Xu Chen

In this paper, we introduce the Eval4NLP-2021shared task on explainable quality estimation. Given a source-translation pair, this shared task requires not only to provide a sentence-level score indicating the overall quality of the…

Computation and Language · Computer Science 2021-10-12 Marina Fomicheva , Piyawat Lertvittayakumjorn , Wei Zhao , Steffen Eger , Yang Gao

Explaining opaque Machine Learning (ML) models has become an increasingly important challenge. However, current eXplanation in AI (XAI) methods suffer several shortcomings, including insufficient abstraction, limited user interactivity, and…

Computers and Society · Computer Science 2026-03-02 Laura State , Salvatore Ruggieri , Franco Turini

Machine learning (ML) model explainability has received growing attention, especially in the area related to model risk and regulations. In this paper, we reviewed and compared some popular ML model explainability methodologies, especially…

Artificial Intelligence · Computer Science 2021-06-15 Shafie Gholizadeh , Nengfeng Zhou

Explainability remains a critical challenge in artificial intelligence (AI) systems, particularly in high stakes domains such as healthcare, finance, and decision support, where users must understand and trust automated reasoning.…

Human-Computer Interaction · Computer Science 2025-08-05 Rukshani Somarathna , Madhawa Perera , Tom Gedeon , Matt Adcock

Despite the high accuracy offered by state-of-the-art deep natural-language models (e.g. LSTM, BERT), their application in real-life settings is still widely limited, as they behave like a black-box to the end-user. Hence, explainability is…

Computation and Language · Computer Science 2021-06-15 Francesco Ventura , Salvatore Greco , Daniele Apiletti , Tania Cerquitelli

As machine learning becomes more widespread and is used in more critical applications, it's important to provide explanations for these models, to prevent unintended behavior. Unfortunately, many current interpretability methods struggle…

Computation and Language · Computer Science 2024-11-28 Andreas Madsen

Incrementality is ubiquitous in human-human interaction and beneficial for human-computer interaction. It has been a topic of research in different parts of the NLP community, mostly with focus on the specific topic at hand even though…

Computation and Language · Computer Science 2018-06-15 Arne Köhn

Deep neural networks are powerful statistical learners. However, their predictions do not come with an explanation of their process. To analyze these models, explanation methods are being developed. We present a novel explanation method,…

Computation and Language · Computer Science 2021-01-29 David Harbecke

Most evaluations of attribution methods focus on the English language. In this work, we present a multilingual approach for evaluating attribution methods for the Natural Language Inference (NLI) task in terms of faithfulness and…

Computation and Language · Computer Science 2023-06-06 Kerem Zaman , Yonatan Belinkov

The recent spike in certified Artificial Intelligence (AI) tools for healthcare has renewed the debate around adoption of this technology. One thread of such debate concerns Explainable AI (XAI) and its promise to render AI devices more…

Artificial Intelligence · Computer Science 2023-02-27 Giovanni Cinà , Tabea E. Röber , Rob Goedhart , Ş. İlker Birbil

Interpretable Machine Learning (IML) has become increasingly important in many real-world applications, such as autonomous cars and medical diagnosis, where explanations are significantly preferred to help people better understand how…

Machine Learning · Computer Science 2019-08-19 Fan Yang , Mengnan Du , Xia Hu

Deep learning models have performed well on many NLP tasks. However, their internal mechanisms are typically difficult for humans to understand. The development of methods to explain models has become a key issue in the reliability of deep…

Human-Computer Interaction · Computer Science 2024-05-20 Xiaotian Lu , Jiyi Li , Zhen Wan , Xiaofeng Lin , Koh Takeuchi , Hisashi Kashima

Having a unified, coherent taxonomy is essential for effective knowledge representation in domain-specific applications as diverse terminologies need to be mapped to underlying concepts. Traditional manual approaches to taxonomy alignment…

Explanation methods in Interpretable NLP often explain the model's decision by extracting evidence (rationale) from the input texts supporting the decision. Benchmark datasets for rationales have been released to evaluate how good the…

Computation and Language · Computer Science 2022-04-12 Cheng-Han Chiang , Hung-yi Lee

Recent years have witnessed an increasing number of interpretation methods being developed for improving transparency of NLP models. Meanwhile, researchers also try to answer the question that whether the obtained interpretation is faithful…

Computation and Language · Computer Science 2020-09-17 Ninghao Liu , Yunsong Meng , Xia Hu , Tie Wang , Bo Long

Explainability for Large Language Models (LLMs) is a critical yet challenging aspect of natural language processing. As LLMs are increasingly integral to diverse applications, their "black-box" nature sparks significant concerns regarding…

Computation and Language · Computer Science 2024-02-23 Haoyan Luo , Lucia Specia

This paper surveys evaluation techniques to enhance the trustworthiness and understanding of Large Language Models (LLMs). As reliance on LLMs grows, ensuring their reliability, fairness, and transparency is crucial. We explore algorithmic…

Computation and Language · Computer Science 2024-06-05 Nik Bear Brown