English
Related papers

Related papers: Leveraging Model Interpretability and Stability to…

200 papers

Deep neural networks are powerful tools to detect hidden patterns in data and leverage them to make predictions, but they are not designed to understand uncertainty and estimate reliable probabilities. In particular, they tend to be…

Machine Learning · Statistics 2022-11-10 Bat-Sheva Einbinder , Yaniv Romano , Matteo Sesia , Yanfei Zhou

Theoretical understanding of deep learning is one of the most important tasks facing the statistics and machine learning communities. While deep neural networks (DNNs) originated as engineering methods and models of biological networks in…

Machine Learning · Statistics 2018-06-04 Adam S. Charles

During training, the weights of a Deep Neural Network (DNN) are optimized from a random initialization towards a nearly optimum value minimizing a loss function. Only this final state of the weights is typically kept for testing, while the…

Machine Learning · Computer Science 2021-03-26 Gianni Franchi , Andrei Bursuc , Emanuel Aldea , Severine Dubuisson , Isabelle Bloch

Deep neural networks (DNNs) enable innovative applications of machine learning like image recognition, machine translation, or malware detection. However, deep learning is often criticized for its lack of robustness in adversarial settings…

Machine Learning · Computer Science 2018-03-14 Nicolas Papernot , Patrick McDaniel

Despite their unprecedented performance in various domains, utilization of Deep Neural Networks (DNNs) in safety-critical environments is severely limited in the presence of even small adversarial perturbations. The present work develops a…

Machine Learning · Computer Science 2020-10-19 Fatemeh Sheikholeslami , Swayambhoo Jain , Georgios B. Giannakis

Deep neural networks (NNs) are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in NNs is a challenging and yet unsolved problem. Bayesian NNs,…

Machine Learning · Statistics 2017-11-07 Balaji Lakshminarayanan , Alexander Pritzel , Charles Blundell

While researchers increasingly use deep neural networks (DNN) to analyze individual choices, overfitting and interpretability issues remain as obstacles in theory and practice. By using statistical learning theory, this study presents a…

General Economics · Economics 2019-09-18 Shenhao Wang , Qingyi Wang , Nate Bailey , Jinhua Zhao

Deep neural networks (DNNs) have been shown lack of robustness for the vulnerability of their classification to small perturbations on the inputs. This has led to safety concerns of applying DNNs to safety-critical domains. Several…

Machine Learning · Computer Science 2021-02-24 Jianlin Li , Pengfei Yang , Jiangchao Liu , Liqian Chen , Xiaowei Huang , Lijun Zhang

This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations. Although deep neural networks have exhibited superior performance…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Quanshi Zhang , Song-Chun Zhu

Deep Neural Networks (DNNs) can be represented as graphs whose links and vertices iteratively process data and solve tasks sub-optimally. Complex Network Theory (CNT), merging statistical physics with graph theory, provides a method for…

Machine Learning · Computer Science 2024-04-19 Emanuele La Malfa , Gabriele La Malfa , Giuseppe Nicosia , Vito Latora

Deep neural networks (DNNs) have proven to be highly effective in a variety of tasks, making them the go-to method for problems requiring high-level predictive power. Despite this success, the inner workings of DNNs are often not…

Machine Learning · Statistics 2024-03-04 Anton Thielmann , René-Marcel Kruse , Thomas Kneib , Benjamin Säfken

Deep neural networks (DNNs) have had many successes, but they suffer from two major issues: (1) a vulnerability to adversarial examples and (2) a tendency to elude human interpretation. Interestingly, recent empirical and theoretical…

Machine Learning · Computer Science 2020-12-07 Adam Noack , Isaac Ahern , Dejing Dou , Boyang Li

Machine learning models have been successfully applied to a wide range of applications including computer vision, natural language processing, and speech recognition. A successful implementation of these models however, usually relies on…

Machine Learning · Computer Science 2020-09-29 Arash Rahnama , Andrew Tseng

Deep neural networks (DNNs) have made a revolution in numerous fields during the last decade. However, in tasks with high safety requirements, such as medical or autonomous driving applications, providing an assessment of the models…

Machine Learning · Computer Science 2020-11-20 Omer Achrack , Raizy Kellerman , Ouriel Barzilay

For reliability, it is important that the predictions made by machine learning methods are interpretable by human. In general, deep neural networks (DNNs) can provide accurate predictions, although it is difficult to interpret why such…

Machine Learning · Computer Science 2021-12-16 Yuya Yoshikawa , Tomoharu Iwata

Quantifying uncertainty in a model's predictions is important as it enables the safety of an AI system to be increased by acting on the model's output in an informed manner. This is crucial for applications where the cost of an error is…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Aria Khoshsirat

The standard approach to providing interpretability to deep convolutional neural networks (CNNs) consists of visualizing either their feature maps, or the image regions that contribute the most to the prediction. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Krishna Kanth Nakka , Mathieu Salzmann

Despite the remarkable performance, Deep Neural Networks (DNNs) behave as black-boxes hindering user trust in Artificial Intelligence (AI) systems. Research on opening black-box DNN can be broadly categorized into post-hoc methods and…

Machine Learning · Computer Science 2021-06-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Despite the recent progress in deep neural networks (DNNs), it remains challenging to explain the predictions made by DNNs. Existing explanation methods for DNNs mainly focus on post-hoc explanations where another explanatory model is…

Machine Learning · Computer Science 2024-01-04 Wei Qian , Chenxu Zhao , Yangyi Li , Fenglong Ma , Chao Zhang , Mengdi Huai

In this paper, we propose Describe-and-Dissect (DnD), a novel method to describe the roles of hidden neurons in vision networks. DnD utilizes recent advancements in multimodal deep learning to produce complex natural language descriptions,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Nicholas Bai , Rahul A. Iyer , Tuomas Oikarinen , Akshay Kulkarni , Tsui-Wei Weng