English
Related papers

Related papers: Self-explaining AI as an alternative to interpreta…

200 papers

A common assumption about neural networks is that they can learn an appropriate internal representations on their own, see e.g. end-to-end learning. In this work we challenge this assumption. We consider two simple tasks and show that the…

Machine Learning · Computer Science 2019-11-19 Krisztian Buza

We introduce SelfExplain, a novel self-explaining model that explains a text classifier's predictions using phrase-based concepts. SelfExplain augments existing neural classifiers by adding (1) a globally interpretable layer that identifies…

Computation and Language · Computer Science 2021-09-09 Dheeraj Rajagopal , Vidhisha Balachandran , Eduard Hovy , Yulia Tsvetkov

Deep neural networks (DNNs) have greatly impacted numerous fields over the past decade. Yet despite exhibiting superb performance over many problems, their black-box nature still poses a significant challenge with respect to explainability.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Snir Vitrack Tamam , Raz Lapid , Moshe Sipper

Given the complexity and lack of transparency in deep neural networks (DNNs), extensive efforts have been made to make these systems more interpretable or explain their behaviors in accessible terms. Unlike most reviews, which focus on…

Artificial Intelligence · Computer Science 2024-01-17 Haoyi Xiong , Xuhong Li , Xiaofei Zhang , Jiamin Chen , Xinhao Sun , Yuchen Li , Zeyi Sun , Mengnan Du

As Artificial Intelligence (AI) systems continue to grow in size and complexity, so does the difficulty of the quest for AI transparency. In a world of large models and complex AI systems, why do we explain AI and what should we explain?…

Artificial Intelligence · Computer Science 2026-04-23 Karina Cortinas-Lorenzo , Gavin Doherty

We examine how users perceive the limitations of an AI system when it encounters a task that it cannot perform perfectly and whether providing explanations alongside its answers aids users in constructing an appropriate mental model of the…

Computation and Language · Computer Science 2025-06-24 Judith Sieker , Simeon Junker , Ronja Utescher , Nazia Attari , Heiko Wersing , Hendrik Buschmeier , Sina Zarrieß

Recently, it has been proposed that fruitful synergies may exist between Deep Learning (DL) and Case Based Reasoning (CBR); that there are insights to be gained by applying CBR ideas to problems in DL (what could be called DeepCBR). In this…

Artificial Intelligence · Computer Science 2021-06-15 Mark T Keane , Eoin M Kenny , Mohammed Temraz , Derek Greene , Barry Smyth

The recent advancements in Deep Learning models and techniques have led to significant strides in performance across diverse tasks and modalities. However, while the overall capabilities of models show promising growth, our understanding of…

Artificial Intelligence · Computer Science 2025-04-04 Erik Arakelyan

Deep neural networks are complex and opaque. As they enter application in a variety of important and safety critical domains, users seek methods to explain their output predictions. We develop an approach to explaining deep neural networks…

Artificial Intelligence · Computer Science 2018-02-05 Michael Harradon , Jeff Druce , Brian Ruttenberg

Artificial intelligence (AI) has revolutionized decision-making processes and systems throughout society and, in particular, has emerged as a significant technology in high-impact scenarios of national interest. Yet, despite AI's impressive…

Machine Learning · Statistics 2024-08-05 Gregory Canal , Vladimir Leung , Philip Sage , Eric Heim , I-Jeng Wang

Objective: This paper develops a theoretical framework explaining when and why AI explanations enhance versus impair human decision-making. Background: Transparency is advocated as universally beneficial for human-AI interaction, yet…

Human-Computer Interaction · Computer Science 2026-01-21 Ancuta Margondai , Mustapha Mouloua

This paper investigates the prospects of using directive explanations to assist people in achieving recourse of machine learning decisions. Directive explanations list which specific actions an individual needs to take to achieve their…

Machine Learning · Computer Science 2021-02-05 Ronal Singh , Paul Dourish , Piers Howe , Tim Miller , Liz Sonenberg , Eduardo Velloso , Frank Vetere

During the last decade, deep neural networks (DNN) have demonstrated impressive performances solving a wide range of problems in various domains such as medicine, finance, law, etc. Despite their great performances, they have long been…

Machine Learning · Computer Science 2020-10-13 Jiechieu Kameni Florentin Flambeau , Tsopze Norbert

eXplainable AI focuses on generating explanations for the output of an AI algorithm to a user, usually a decision-maker. Such user needs to interpret the AI system in order to decide whether to trust the machine outcome. When addressing…

Human-Computer Interaction · Computer Science 2020-05-28 Irene Celino

For strategic problems, intelligent systems based on Deep Reinforcement Learning (DRL) have demonstrated an impressive ability to learn advanced solutions that can go far beyond human capabilities, especially when dealing with complex…

Artificial Intelligence · Computer Science 2020-11-16 Jonas Andrulis , Ole Meyer , Grégory Schott , Samuel Weinbach , Volker Gruhn

Explaining sophisticated machine-learning based systems is an important issue at the foundations of AI. Recent efforts have shown various methods for providing explanations. These approaches can be broadly divided into two schools: those…

Artificial Intelligence · Computer Science 2021-08-24 Nicholas Asher , Soumya Paul , Chris Russell

Advanced Artificial Intelligence (AI) systems, specifically large language models (LLMs), have the capability to generate not just misinformation, but also deceptive explanations that can justify and propagate false information and erode…

Artificial Intelligence · Computer Science 2024-08-02 Valdemar Danry , Pat Pataranutaporn , Matthew Groh , Ziv Epstein , Pattie Maes

Artificial Intelligence (AI), defined in its most simple form, is a technological tool that makes machines intelligent. Since learning is at the core of intelligence, machine learning poses itself as a core sub-field of AI. Then there comes…

Machine Learning · Computer Science 2019-05-06 Imad Alhousseini , Wissam Chemissany , Fatima Kleit , Aly Nasrallah

We discuss methods for visualizing neural network decision boundaries and decision regions. We use these visualizations to investigate issues related to reproducibility and generalization in neural network training. We observe that changes…

Artificial Neural Networks are powerful function approximators capable of modelling solutions to a wide variety of problems, both supervised and unsupervised. As their size and expressivity increases, so too does the variance of the model,…

Neural and Evolutionary Computing · Computer Science 2018-01-26 Richard Evans , Edward Grefenstette