中文
相关论文

相关论文: Does It Make Sense to Explain a Black Box With Ano…

200 篇论文

Black-box machine learning models are being used in more and more high-stakes domains, which creates a growing need for Explainable AI (XAI). Unfortunately, the use of XAI in machine learning introduces new privacy risks, which currently…

机器学习 · 计算机科学 2022-10-24 Sofie Goethals , Kenneth Sörensen , David Martens

AI-driven outcomes can be challenging for end-users to understand. Explanations can address two key questions: "Why this outcome?" (factual) and "Why not another?" (counterfactual). While substantial efforts have been made to formalize…

人工智能 · 计算机科学 2025-03-21 Suryani Lim , Henri Prade , Gilles Richard

This paper provides empirical concerns about post-hoc explanations of black-box ML models, one of the major trends in AI explainability (XAI), by showing its lack of interpretability and societal consequences. Using a representative…

人机交互 · 计算机科学 2021-10-01 Jean-Marie John-Mathews

Clustering algorithms rely on complex optimisation processes that may be difficult to comprehend, especially for individuals who lack technical expertise. While many explainable artificial intelligence techniques exist for supervised…

机器学习 · 计算机科学 2024-09-20 Aurora Spagnol , Kacper Sokol , Pietro Barbiero , Marc Langheinrich , Martin Gjoreski

In machine learning algorithm design, there exists a trade-off between the interpretability and performance of the algorithm. In general, algorithms which are simpler and easier for humans to comprehend tend to show worse performance than…

机器学习 · 计算机科学 2024-07-15 Eric M. Vernon , Naoki Masuyama , Yusuke Nojima

Machine learning (ML) models play an increasingly prevalent role in many software engineering tasks. However, because most models are now powered by opaque deep neural networks, it can be difficult for developers to understand why the model…

软件工程 · 计算机科学 2021-11-11 Jürgen Cito , Isil Dillig , Vijayaraghavan Murali , Satish Chandra

Explainability has become a crucial concern in today's world, aiming to enhance transparency in machine learning and deep learning models. Information retrieval is no exception to this trend. In existing literature on explainability of…

信息检索 · 计算机科学 2026-04-15 Bhavik Chandna , Procheta Sen

The emergence of tools based on artificial intelligence has also led to the need of producing explanations which are understandable by a human being. In most approaches, the system is considered a black box, making it difficult to generate…

人工智能 · 计算机科学 2024-10-23 Germán Vidal

Model interpretability methods are often used to explain NLP model decisions on tasks such as text classification, where the output space is relatively small. However, when applied to language generation, where the output space often…

计算与语言 · 计算机科学 2022-05-24 Kayo Yin , Graham Neubig

Counterfactual post-hoc interpretability approaches have been proven to be useful tools to generate explanations for the predictions of a trained blackbox classifier. However, the assumptions they make about the data and the classifier make…

机器学习 · 计算机科学 2019-06-13 Thibault Laugel , Marie-Jeanne Lesot , Christophe Marsala , Marcin Detyniecki

We propose a novel training regime termed counterfactual training that leverages counterfactual explanations to increase the explanatory capacity of models. Counterfactual explanations have emerged as a popular post-hoc explanation method…

机器学习 · 计算机科学 2026-01-23 Patrick Altmeyer , Aleksander Buszydlik , Arie van Deursen , Cynthia C. S. Liem

Natural language counterfactual generation aims to minimally modify a given text such that the modified text will be classified into a different class. The generated counterfactuals provide insight into the reasoning behind a model's…

计算与语言 · 计算机科学 2024-10-08 Yongjie Wang , Xiaoqi Qiu , Yu Yue , Xu Guo , Zhiwei Zeng , Yuhong Feng , Zhiqi Shen

In recent years, there has been an explosion of AI research on counterfactual explanations as a solution to the problem of eXplainable AI (XAI). These explanations seem to offer technical, psychological and legal benefits over other…

机器学习 · 计算机科学 2021-05-03 Mark T Keane , Eoin M Kenny , Eoin Delaney , Barry Smyth

We introduce the notion of contrastive ABox explanations to answer questions of the type "Why is a an instance of C, but b is not?". While there are various approaches for explaining positive entailments (why is C(a) entailed by the…

人工智能 · 计算机科学 2025-11-17 Patrick Koopmann , Yasir Mahmood , Axel-Cyrille Ngonga Ngomo , Balram Tiwari

Although many machine learning methods, especially from the field of deep learning, have been instrumental in addressing challenges within robotic applications, we cannot take full advantage of such methods before these can provide…

机器人学 · 计算机科学 2022-12-09 Vilde B. Gjærum , Inga Strümke , Anastasios M. Lekkas , Tim Miller

Counterfactuals have been established as a popular explainability technique which leverages a set of minimal edits to alter the prediction of a classifier. When considering conceptual counterfactuals on images, the edits requested should…

机器学习 · 计算机科学 2024-05-06 Angeliki Dimitriou , Nikolaos Chaidos , Maria Lymperaiou , Giorgos Stamou

This paper investigates the reliability of explanations generated by large language models (LLMs) when prompted to explain their previous output. We evaluate two kinds of such self-explanations - extractive and counterfactual - using three…

计算与语言 · 计算机科学 2025-02-03 Korbinian Randl , John Pavlopoulos , Aron Henriksson , Tony Lindgren

Despite advancements in large language models (LLMs), non-factual responses still persist in fact-seeking question answering. Unlike extensive studies on post-hoc detection of these responses, this work studies non-factuality prediction…

计算与语言 · 计算机科学 2025-08-19 Yanling Wang , Haoyang Li , Hao Zou , Jing Zhang , Xinlei He , Qi Li , Ke Xu

Recent advances in deep learning have improved the performance of many Natural Language Processing (NLP) tasks such as translation, question-answering, and text classification. However, this improvement comes at the expense of model…

计算与语言 · 计算机科学 2023-11-14 Sai Gurrapu , Ajay Kulkarni , Lifu Huang , Ismini Lourentzou , Laura Freeman , Feras A. Batarseh

As NLP models become increasingly integral to decision-making processes, the need for explainability and interpretability has become paramount. In this work, we propose a framework that achieves the aforementioned by generating semantically…

计算与语言 · 计算机科学 2025-08-04 Dimitris Lymperopoulos , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou