English
Related papers

Related papers: Aligned explanations in neural networks

200 papers

Deep convolutional neural networks have proven their effectiveness, and have been acknowledged as the most dominant method for image classification. However, a severe drawback of deep convolutional neural networks is poor explainability.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Bin Wang , Wenbin Pei , Bing Xue , Mengjie Zhang

Physics informed neural networks (PINNs) have recently been very successfully applied for efficiently approximating inverse problems for PDEs. We focus on a particular class of inverse problems, the so-called data assimilation or unique…

Numerical Analysis · Mathematics 2023-12-07 Siddhartha Mishra , Roberto Molinaro

Physics-informed neural networks (PINNs) are an influential method of solving differential equations and estimating their parameters given data. However, since they make use of neural networks, they provide only a point estimate of…

Machine Learning · Computer Science 2024-05-15 Lena Podina , Mahdi Torabi Rad , Mohammad Kohandel

High quality explanations of neural networks (NNs) should exhibit two key properties. Completeness ensures that they accurately reflect a network's function and interpretability makes them understandable to humans. Many existing methods…

Machine Learning · Computer Science 2025-03-20 Nolan Dey , Eric Taylor , Alexander Wong , Bryan Tripp , Graham W. Taylor

Explaining predictions of black-box neural networks is crucial when applied to decision-critical tasks. Thus, attribution maps are commonly used to identify important image regions, despite prior work showing that humans prefer explanations…

Machine Learning · Computer Science 2023-12-20 Tom Nuno Wolf , Fabian Bongratz , Anne-Marie Rickmann , Sebastian Pölsterl , Christian Wachinger

Self-explainable deep neural networks are a recent class of models that can output ante-hoc local explanations that are faithful to the model's reasoning, and as such represent a step forward toward filling the gap between expressiveness…

Machine Learning · Computer Science 2023-08-30 Marc Christiansen , Lea Villadsen , Zhiqiang Zhong , Stefano Teso , Davide Mottin

Deep neural networks are widely used for classification. These deep models often suffer from a lack of interpretability -- they are particularly difficult to understand because of their non-linear nature. As a result, neural networks are…

Artificial Intelligence · Computer Science 2017-11-22 Oscar Li , Hao Liu , Chaofan Chen , Cynthia Rudin

We present an interpretable neural network approach to predicting and understanding politeness in natural language requests. Our models are based on simple convolutional neural networks directly on raw text, avoiding any manual…

Computation and Language · Computer Science 2016-10-11 Malika Aubakirova , Mohit Bansal

Interpretable deep learning models have received widespread attention in the field of image recognition. Due to the unique multi-instance learning of medical images and the difficulty in identifying decision-making regions, many…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yitao Peng , Lianghua He , Die Hu , Yihang Liu , Longzhen Yang , Shaohua Shang

This paper introduces function alignment, a novel theory of mind and intelligence that is both intuitively compelling and structurally grounded. It explicitly models how meaning, interpretation, and analogy emerge from interactions among…

Computation and Language · Computer Science 2025-04-15 Gus G. Xia

Interpretability has emerged as a crucial aspect of building trust in machine learning systems, aimed at providing insights into the working of complex neural networks that are otherwise opaque to a user. There are a plethora of existing…

Machine Learning · Statistics 2021-01-19 Rushil Anirudh , Jayaraman J. Thiagarajan , Rahul Sridhar , Peer-Timo Bremer

The ubiquity of neural networks (NNs) in real-world applications, from healthcare to natural language processing, underscores their immense utility in capturing complex relationships within high-dimensional data. However, NNs come with…

Machine Learning · Computer Science 2024-07-08 Chang Yue , Niraj K. Jha

When we are faced with challenging image classification tasks, we often explain our reasoning by dissecting the image, and pointing out prototypical aspects of one class or another. The mounting evidence for each of the classes helps us…

Machine Learning · Computer Science 2020-01-01 Chaofan Chen , Oscar Li , Chaofan Tao , Alina Jade Barnett , Jonathan Su , Cynthia Rudin

Artificial Intelligence has emerged as a useful aid in numerous clinical applications for diagnosis and treatment decisions. Deep neural networks have shown same or better performance than clinicians in many tasks owing to the rapid…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Zohaib Salahuddin , Henry C Woodruff , Avishek Chatterjee , Philippe Lambin

This paper proposes a set of criteria to evaluate the objectiveness of explanation methods of neural networks, which is crucial for the development of explainable AI, but it also presents significant challenges. The core challenge is that…

Machine Learning · Computer Science 2019-11-21 Hao Zhang , Jiayi Chen , Haotian Xue , Quanshi Zhang

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

One of the major challenges in machine learning nowadays is to provide predictions with not only high accuracy but also user-friendly explanations. Although in recent years we have witnessed increasingly popular use of deep neural networks…

Machine Learning · Computer Science 2019-07-24 Yao Ming , Panpan Xu , Huamin Qu , Liu Ren

With the broader and highly successful usage of machine learning in industry and the sciences, there has been a growing demand for Explainable AI. Interpretability and explanation methods for gaining a better understanding about the problem…

Machine Learning · Computer Science 2021-02-26 Wojciech Samek , Grégoire Montavon , Sebastian Lapuschkin , Christopher J. Anders , Klaus-Robert Müller

Neural networks for computer vision extract uninterpretable features despite achieving high accuracy on benchmarks. In contrast, humans can explain their predictions using succinct and intuitive descriptions. To incorporate explainability…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Khalid Saifullah , Yuxin Wen , Jonas Geiping , Micah Goldblum , Tom Goldstein

State of the art algorithms for many pattern recognition problems rely on deep network models. Training these models requires a large labeled dataset and considerable computational resources. Also, it is difficult to understand the working…

Artificial Intelligence · Computer Science 2019-09-25 Heather Riley , Mohan Sridharan