中文
相关论文

相关论文: Critical Empirical Study on Black-box Explanations…

200 篇论文

Neural networks for NLP are becoming increasingly complex and widespread, and there is a growing concern if these models are responsible to use. Explaining models helps to address the safety and ethical concerns and is essential for…

计算与语言 · 计算机科学 2023-11-29 Andreas Madsen , Siva Reddy , Sarath Chandar

Large Language Models (LLMs) have played a pivotal role in advancing Artificial Intelligence (AI). However, despite their achievements, LLMs often struggle to explain their decision-making processes, making them a 'black box' and presenting…

计算与语言 · 计算机科学 2025-06-30 Avash Palikhe , Zhenyu Yu , Zichong Wang , Wenbin Zhang

The unprecedented performance of machine learning models in recent years, particularly Deep Learning and transformer models, has resulted in their application in various domains such as finance, healthcare, and education. However, the…

人机交互 · 计算机科学 2023-12-20 Milad Rogha

Interactive Artificial Intelligence (AI) agents are becoming increasingly prevalent in society. However, application of such systems without understanding them can be problematic. Black-box AI systems can lead to liability and…

计算机与社会 · 计算机科学 2023-01-16 Pradyumna Tambwekar , Matthew Gombolay

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

人工智能 · 计算机科学 2024-07-23 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

This paper reports two experiments (N=349) on the impact of post hoc explanations by example and error rates on peoples perceptions of a black box classifier. Both experiments show that when people are given case based explanations, from an…

机器学习 · 计算机科学 2020-09-15 Courtney Ford , Eoin M. Kenny , Mark T. Keane

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

人工智能 · 计算机科学 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

XAI refers to the techniques and methods for building AI applications which assist end users to interpret output and predictions of AI models. Black box AI applications in high-stakes decision-making situations, such as medical domain have…

In the last years many accurate decision support systems have been constructed as black boxes, that is as systems that hide their internal logic to the user. This lack of explanation constitutes both a practical and an ethical issue. The…

计算机与社会 · 计算机科学 2018-06-22 Riccardo Guidotti , Anna Monreale , Salvatore Ruggieri , Franco Turini , Dino Pedreschi , Fosca Giannotti

The use of complex machine learning models can make systems opaque to users. Machine learning research proposes the use of post-hoc explanations. However, it is unclear if they give users insights into otherwise uninterpretable models. One…

人机交互 · 计算机科学 2019-05-09 Martin Schuessler , Philipp Weiß

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

机器学习 · 计算机科学 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

人工智能 · 计算机科学 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

This position paper defends post-hoc explainability methods as legitimate tools for scientific knowledge production in machine learning. Addressing criticism of these methods' reliability and epistemic status, we develop a philosophical…

机器学习 · 计算机科学 2025-10-31 Nick Oh

The widespread adoption of black-box models in Artificial Intelligence has enhanced the need for explanation methods to reveal how these obscure models reach specific decisions. Retrieving explanations is fundamental to unveil possible…

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

人工智能 · 计算机科学 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

The implementation of Artificial Intelligence (AI) systems in the manufacturing domain enables higher production efficiency, outstanding performance, and safer operations, leveraging powerful tools such as deep learning and reinforcement…

人工智能 · 计算机科学 2021-07-07 Georgios Sofianidis , Jože M. Rožanec , Dunja Mladenić , Dimosthenis Kyriazis

The ubiquity of machine learning based predictive models in modern society naturally leads people to ask how trustworthy those models are? In predictive modeling, it is quite common to induce a trade-off between accuracy and…

机器学习 · 计算机科学 2019-04-05 John Mitros , Brian Mac Namee

In this work, we report the practical and theoretical aspects of Explainable AI (XAI) identified in some fundamental literature. Although there is a vast body of work on representing the XAI backgrounds, most of the corpuses pinpoint a…

人工智能 · 计算机科学 2020-12-18 Nazanin Fouladgar , Kary Främling

While research on applications and evaluations of explanation methods continues to expand, fairness of the explanation methods concerning disparities in their performance across subgroups remains an often overlooked aspect. In this paper,…

计算与语言 · 计算机科学 2025-05-05 Mahdi Dhaini , Ege Erdogan , Nils Feldhus , Gjergji Kasneci

Explainable Artificial Intelligence (XAI) aims to create transparency in modern AI models by offering explanations of the models to human users. There are many ways in which researchers have attempted to evaluate the quality of these XAI…

人机交互 · 计算机科学 2025-11-07 Joe Shymanski , Jacob Brue , Sandip Sen