English
Related papers

Related papers: Interpreting Black-box Machine Learning Models for…

200 papers

The ubiquity of neural networks (NNs) in real-world applications, from healthcare to natural language processing, underscores their immense utility in capturing complex relationships within high-dimensional data. However, NNs come with…

Machine Learning · Computer Science 2024-07-08 Chang Yue , Niraj K. Jha

The last decade of machine learning has seen drastic increases in scale and capabilities. Deep neural networks (DNNs) are increasingly being deployed in the real world. However, they are difficult to analyze, raising concerns about using…

Machine Learning · Computer Science 2023-08-22 Tilman Räuker , Anson Ho , Stephen Casper , Dylan Hadfield-Menell

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

Deep neural networks (DNNs) are powerful black-box predictors that have achieved impressive performance on a wide variety of tasks. However, their accuracy comes at the cost of intelligibility: it is usually unclear how they make their…

Machine Learning · Computer Science 2021-10-26 Rishabh Agarwal , Levi Melnick , Nicholas Frosst , Xuezhou Zhang , Ben Lengerich , Rich Caruana , Geoffrey Hinton

Deep Neural Networks (DNNs) excel at many tasks, often rivaling or surpassing human performance. Yet their internal processes remain elusive, frequently described as "black boxes." While performance can be refined experimentally, achieving…

Disordered Systems and Neural Networks · Physics 2025-02-03 Sebastiano Ariosto

Complex nonlinear models such as deep neural network (DNNs) have become an important tool for image classification, speech recognition, natural language processing, and many other fields of application. These models however lack…

The ability of deep learning (DL) to improve the practice of medicine and its clinical outcomes faces a looming obstacle: model interpretation. Without description of how outputs are generated, a collaborating physician can neither resolve…

Machine Learning · Computer Science 2020-06-30 Christopher Snyder , Sriram Vishwanath

Deep neural networks (DNN) are black box algorithms. They are trained using a gradient descent back propagation technique which trains weights in each layer for the sole goal of minimizing training error. Hence, the resulting weights cannot…

Machine Learning · Computer Science 2018-11-05 Daniel Goldfarb

Deep neural networks (DNNs) have shown exceptional performances in a wide range of tasks and have become the go-to method for problems requiring high-level predictive power. There has been extensive research on how DNNs arrive at their…

Machine Learning · Computer Science 2023-02-21 Mattias Luber , Anton Thielmann , Benjamin Säfken

Not only are Deep Neural Networks (DNNs) black box models, but also we frequently conceptualize them as such. We lack good interpretations of the mechanisms linking inputs to outputs. Therefore, we find it difficult to analyze in…

Machine Learning · Computer Science 2020-06-29 Christopher Snyder , Sriram Vishwanath

Deep neural networks have achieved remarkable success in various challenging tasks. However, the black-box nature of such networks is not acceptable to critical applications, such as healthcare. In particular, the existence of adversarial…

Machine Learning · Computer Science 2019-09-12 Shaeke Salman , Seyedeh Neelufar Payrovnaziri , Xiuwen Liu , Pablo Rengifo-Moreno , Zhe He

Deep neural network (DNN) architecture based models have high expressive power and learning capacity. However, they are essentially a black box method since it is not easy to mathematically formulate the functions that are learned within…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Gaurav Goswami , Nalini Ratha , Akshay Agarwal , Richa Singh , Mayank Vatsa

Deep learning models are favored in many research and industry areas and have reached the accuracy of approximating or even surpassing human level. However they've long been considered by researchers as black-box models for their…

Machine Learning · Computer Science 2020-10-16 Xiaojian Wang , Jingyuan Wang , Ke Tang

Artificial Intelligence has emerged as a useful aid in numerous clinical applications for diagnosis and treatment decisions. Deep neural networks have shown same or better performance than clinicians in many tasks owing to the rapid…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Zohaib Salahuddin , Henry C Woodruff , Avishek Chatterjee , Philippe Lambin

Artificial neural networks are often very complex and too deep for a human to understand. As a result, they are usually referred to as black boxes. For a lot of real-world problems, the underlying pattern itself is very complicated, such…

Machine Learning · Computer Science 2020-11-26 Yang Li

Explainable AI has emerged to be a key component for black-box machine learning approaches in domains with a high demand for reliability or transparency. Examples are medical assistant systems, and applications concerned with the General…

Machine Learning · Computer Science 2021-05-18 Johannes Rabold , Gesina Schwalbe , Ute Schmid

Deep neural networks are effective feature extractors but they are prohibitively large for deployment scenarios. Due to the huge number of parameters, interpretability of parameters in different layers is not straight-forward. This is why…

Computation and Language · Computer Science 2021-12-23 Saeed Damadi

Theoretical understanding of deep learning is one of the most important tasks facing the statistics and machine learning communities. While deep neural networks (DNNs) originated as engineering methods and models of biological networks in…

Machine Learning · Statistics 2018-06-04 Adam S. Charles

This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations. Although deep neural networks have exhibited superior performance…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Quanshi Zhang , Song-Chun Zhu

Modern machine learning systems based on neural networks have shown great success in learning complex data patterns while being able to make good predictions on unseen data points. However, the limited interpretability of these systems…

Machine Learning · Computer Science 2020-07-22 Sarath Shekkizhar , Antonio Ortega