English
Related papers

Related papers: Perturbation on Feature Coalition: Towards Interpr…

200 papers

Explainable Artificial Intelligence (XAI) aims to make learning machines less opaque, and offers researchers and practitioners various tools to reveal the decision-making strategies of neural networks. In this work, we investigate how XAI…

Machine Learning · Computer Science 2023-11-15 Dennis Grinwald , Kirill Bykov , Shinichi Nakajima , Marina M. -C. Höhne

The emergence of Deep Neural Networks (DNNs) has revolutionized various domains by enabling the resolution of complex tasks spanning image recognition, natural language processing, and scientific problem-solving. However, this progress has…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Jindong Gu , Xiaojun Jia , Pau de Jorge , Wenqain Yu , Xinwei Liu , Avery Ma , Yuan Xun , Anjun Hu , Ashkan Khakzar , Zhijiang Li , Xiaochun Cao , Philip Torr

Deep neural networks (DNNs) may outperform human brains in complex tasks, but the lack of transparency in their decision-making processes makes us question whether we could fully trust DNNs with high stakes problems. As DNNs' operations…

Machine Learning · Computer Science 2020-03-19 Jung Hoon Lee

The reasonable definition of semantic interpretability presents the core challenge in explainable AI. This paper proposes a method to modify a traditional convolutional neural network (CNN) into an interpretable compositional CNN, in order…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Wen Shen , Zhihua Wei , Shikun Huang , Binbin Zhang , Jiaqi Fan , Ping Zhao , Quanshi Zhang

Deep neural networks are highly vulnerable to adversarial examples, which imposes severe security issues for these state-of-the-art models. Many defense methods have been proposed to mitigate this problem. However, a lot of them depend on…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Nader Asadi , AmirMohammad Sarfi , Mehrdad Hosseinzadeh , Sahba Tahsini , Mahdi Eftekhari

Indecipherable black boxes are common in machine learning (ML), but applications increasingly require explainable artificial intelligence (XAI). The core of XAI is to establish transparent and interpretable data-driven algorithms. This work…

Optimization and Control · Mathematics 2023-06-13 Howard Heaton , Samy Wu Fung

We propose a new way to explain and to visualize neural network classification through a decomposition-based explainable AI (DXAI). Instead of providing an explanation heatmap, our method yields a decomposition of the image into…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Elnatan Kadar , Guy Gilboa

We propose a novel segmentation-based explainable artificial intelligence (XAI) method for neural networks working on point cloud classification. As one building block of this method, we propose a novel point-shifting mechanism to introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Raju Ningappa Mulawade , Christoph Garth , Alexander Wiebel

Interpreting the inner function of neural networks is crucial for the trustworthy development and deployment of these black-box models. Prior interpretability methods focus on correlation-based measures to attribute model decisions to…

Machine Learning · Computer Science 2023-06-21 Ola Ahmad , Nicolas Bereux , Loïc Baret , Vahid Hashemi , Freddy Lecue

Deep Learning using the eponymous deep neural networks (DNNs) has become an attractive approach towards various data-based problems of theoretical physics in the past decade. There has been a clear trend to deeper architectures containing…

Machine Learning · Computer Science 2021-06-30 Bastian Kaspschak , Ulf-G. Meißner

Deep Neural Networks (DNNs) are often considered black boxes due to their opaque decision-making processes. To reduce their opacity Concept Models (CMs), such as Concept Bottleneck Models (CBMs), were introduced to predict human-defined…

Human-Computer Interaction · Computer Science 2025-12-02 Jack Furby , Dan Cunnington , Dave Braines , Alun Preece

There has been a significant surge of interest recently around the concept of explainable artificial intelligence (XAI), where the goal is to produce an interpretation for a decision made by a machine learning algorithm. Of particular…

Machine Learning · Computer Science 2019-10-31 Zhong Qiu Lin , Mohammad Javad Shafiee , Stanislav Bochkarev , Michael St. Jules , Xiao Yu Wang , Alexander Wong

Machine learning solutions for pattern classification problems are nowadays widely deployed in society and industry. However, the lack of transparency and accountability of most accurate models often hinders their safe use. Thus, there is a…

Machine Learning · Computer Science 2021-12-24 Gonzalo Nápoles , Yamisleydi Salgueiro , Isel Grau , Maikel Leon Espinosa

Building generalizable AI models is one of the primary challenges in the healthcare domain. While radiologists rely on generalizable descriptive rules of abnormality, Neural Network (NN) models suffer even with a slight shift in input…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Shantanu Ghosh , Ke Yu , Kayhan Batmanghelich

Deep Neural Networks (DNNs) are increasingly utilized in high-stakes domains like medical diagnostics and autonomous driving where model reliability is critical. However, the research landscape for ensuring this reliability is…

Machine Learning · Computer Science 2026-04-07 Ole Delzer , Sidney Bender

Deep learning models are used in critical applications, in which mistakes can have serious consequences. Therefore, it is crucial to understand how and why models generate predictions. This understanding provides useful information to check…

Deep Neural Networks (DNNs) are a revolutionary force in the ongoing information revolution, and yet their intrinsic properties remain a mystery. In particular, it is widely known that DNNs are highly sensitive to noise, whether adversarial…

Machine Learning · Computer Science 2020-05-01 Netanel Raviv , Siddharth Jain , Pulakesh Upadhyaya , Jehoshua Bruck , Anxiao Jiang

Explainable artificial intelligence (XAI) plays an indispensable role in demystifying the decision-making processes of AI, especially within the healthcare industry. Clinicians rely heavily on detailed reasoning when making a diagnosis,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Anna Stubbin , Thompson Chyrikov , Jim Zhao , Christina Chajo

Without any means of interpretation, neural networks that predict molecular properties and bioactivities are merely black boxes. We will unravel these black boxes and will demonstrate approaches to understand the learned representations…

Machine Learning · Computer Science 2019-03-19 Kristina Preuer , Günter Klambauer , Friedrich Rippmann , Sepp Hochreiter , Thomas Unterthiner

(Artificial) neural networks have become increasingly popular in mechanics to accelerate computations with model order reduction techniques and as universal models for a wide variety of materials. However, the major disadvantage of neural…

Machine Learning · Computer Science 2021-07-13 Arnd Koeppe , Franz Bamer , Michael Selzer , Britta Nestler , Bernd Markert