English
Related papers

Related papers: An Information Theoretic Interpretation to Deep Ne…

200 papers

We propose a local modelling approach using deep convolutional neural networks (CNNs) for fine-grained image classification. Recently, deep CNNs trained from large datasets have considerably improved the performance of object recognition.…

Computer Vision and Pattern Recognition · Computer Science 2015-03-02 ZongYuan Ge , Chris McCool , Conrad Sanderson , Peter Corke

State of the art Deep Neural Networks (DNN) can now achieve above human level accuracy on image classification tasks. However their outstanding performances come along with a complex inference mechanism making them arduously interpretable…

Machine Learning · Computer Science 2019-11-07 Fei Wu , Thomas Michel , Alexandre Briot

Recent work by Lakshminarayanan and Singh [2020] provided a dual view for fully connected deep neural networks (DNNs) with rectified linear units (ReLU). It was shown that (i) the information in the gates is analytically characterised by a…

Machine Learning · Computer Science 2022-03-31 Chandrashekar Lakshminarayanan , Amit Vikram Singh , Arun Rajkumar

In this paper we propose an ensemble of local and deep features for object classification. We also compare and contrast effectiveness of feature representation capability of various layers of convolutional neural network. We demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Siddharth Srivastava , Prerana Mukherjee , Brejesh Lall , Kamlesh Jaiswal

Our proposed deeply-supervised nets (DSN) method simultaneously minimizes classification error while making the learning process of hidden layers direct and transparent. We make an attempt to boost the classification performance by studying…

Machine Learning · Statistics 2017-04-26 Chen-Yu Lee , Saining Xie , Patrick Gallagher , Zhengyou Zhang , Zhuowen Tu

Deep neural networks have been proven powerful at processing perceptual data, such as images and audio. However for tabular data, tree-based models are more popular. A nice property of tree-based models is their natural interpretability. In…

Machine Learning · Computer Science 2018-06-20 Yongxin Yang , Irene Garcia Morillo , Timothy M. Hospedales

Error backpropagation is a highly effective mechanism for learning high-quality hierarchical features in deep networks. Updating the features or weights in one layer, however, requires waiting for the propagation of error signals from…

Neural and Evolutionary Computing · Computer Science 2017-11-21 Hesham Mostafa , Vishwajith Ramesh , Gert Cauwenberghs

For reliability, it is important that the predictions made by machine learning methods are interpretable by human. In general, deep neural networks (DNNs) can provide accurate predictions, although it is difficult to interpret why such…

Machine Learning · Computer Science 2021-12-16 Yuya Yoshikawa , Tomoharu Iwata

Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript, we describe a custom DNN specially designed to solve problems in the RF…

Signal Processing · Electrical Eng. & Systems 2021-09-23 Brian Shevitski , Yijing Watkins , Nicole Man , Michael Girard

Deep neural networks (DNNs) are powerful black-box predictors that have achieved impressive performance on a wide variety of tasks. However, their accuracy comes at the cost of intelligibility: it is usually unclear how they make their…

Machine Learning · Computer Science 2021-10-26 Rishabh Agarwal , Levi Melnick , Nicholas Frosst , Xuezhou Zhang , Ben Lengerich , Rich Caruana , Geoffrey Hinton

For sake of reliability, it is necessary for models in real-world applications to be both powerful and globally interpretable. Simple classifiers, e.g., Logistic Regression (LR), are globally interpretable, but not powerful enough to model…

Machine Learning · Computer Science 2021-01-20 Zhaocheng Liu , Qiang Liu , Haoli Zhang , Yuntian Chen

Machine Learning with Deep Neural Networks (DNNs) has become a successful tool in solving tasks across various fields of application. However, the complexity of DNNs makes it difficult to understand how they solve their learned task. To…

Machine Learning · Computer Science 2023-06-16 Valerie Krug , Raihan Kabir Ratul , Christopher Olson , Sebastian Stober

As proteins with similar structures often have similar functions, analysis of protein structures can help predict protein functions and is thus important. We consider the problem of protein structure classification, which computationally…

Machine Learning · Statistics 2019-10-08 Hongyu Guo , Khalique Newaz , Scott Emrich , Tijana Milenkovic , Jun Li

Features play a crucial role in computer vision. Initially designed to detect salient elements by means of handcrafted algorithms, features are now often learned by different layers in Convolutional Neural Networks (CNNs). This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Loris Nanni , Stefano Ghidoni , Sheryl Brahnam

Feature extraction - the ability to identify relevant properties of data - is a key factor underlying the success of deep learning. Yet, it has proved difficult to elucidate its nature within existing predictive theories, to the extent that…

Disordered Systems and Neural Networks · Physics 2025-08-29 Andrea Corti , Rosalba Pacelli , Pietro Rotondo , Marco Gherardi

The history of deep learning has shown that human-designed problem-specific networks can greatly improve the classification performance of general neural models. In most practical cases, however, choosing the optimal architecture for a…

Machine Learning · Computer Science 2020-09-14 Nicolo Colombo , Yang Gao

Safe use of Deep Neural Networks (DNNs) requires careful testing. However, deployed models are often trained further to improve in performance. As rigorous testing and evaluation is expensive, triggers are in need to determine the degree of…

Machine Learning · Computer Science 2021-11-04 Konstantin Schürholt , Damian Borth

Deep neural networks (DNNs) achieve remarkable performance on a wide range of tasks, yet their mathematical analysis remains fragmented: stability and generalization are typically studied in disparate frameworks and on a case-by-case basis.…

Machine Learning · Statistics 2026-01-29 Jonathan Vacher

Interpreting neural networks is a crucial and challenging task in machine learning. In this paper, we develop a novel framework for detecting statistical interactions captured by a feedforward multilayer neural network by directly…

Machine Learning · Statistics 2018-02-28 Michael Tsang , Dehua Cheng , Yan Liu

Complex nonlinear models such as deep neural network (DNNs) have become an important tool for image classification, speech recognition, natural language processing, and many other fields of application. These models however lack…