English
Related papers

Related papers: Explaining Deep Neural Networks using Unsupervised…

200 papers

Deep neural networks (DNNs) are famous for their high prediction accuracy, but they are also known for their black-box nature and poor interpretability. We consider the problem of variable selection, that is, selecting the input variables…

Machine Learning · Statistics 2019-09-18 Zixuan Song , Jun Li

Neural networks are widely used in machine learning and data mining. Typically, these networks need to be trained, implying the adjustment of weights (parameters) within the network based on the input data. In this work, we propose a novel…

Machine Learning · Computer Science 2024-08-20 Xiaosheng Li , Wenjie Xi , Jessica Lin

The paper proposes a new testing approach for Deep Neural Networks (DNN) using gradient-free optimization to find perturbation chains that successfully falsify the tested DNN, going beyond existing grid-based or combinatorial testing.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Clemens Otte , Yinchong Yang , Danny Benlin Oswan

Current deep neural networks suffer from two problems; first, they are hard to interpret, and second, they suffer from overfitting. There have been many attempts to define interpretability in neural networks, but they typically lack…

Machine Learning · Computer Science 2019-08-15 Sean Tao

Deep neural networks (DNN) has received increasing attention in machine learning applications in the last several years. Recently, a non-asymptotic error bound has been developed to measure the performance of the fully connected DNN…

Machine Learning · Statistics 2024-05-15 Kejin Wu , Dimitris N. Politis

Deep Neural Networks (DNNs) do not inherently compute or exhibit empirically-justified task confidence. In mission critical applications, it is important to both understand associated DNN reasoning and its supporting evidence. In this…

Machine Learning · Computer Science 2024-03-14 Paul Ardis , Arjuna Flenner

Deep neural networks provide flexible frameworks for learning data representations and functions relating data to other properties and are often claimed to achieve 'super-human' performance in inferring relationships between input data and…

Materials Science · Physics 2021-05-26 Keith T. Butler , Manh Duc Le , Jeyarajan Thiyagalingam , Toby G. Perring

We propose a novel explanation method that explains the decisions of a deep neural network by investigating how the intermediate representations at each layer of the deep network were refined during the training process. This way we can a)…

Machine Learning · Computer Science 2021-09-14 Lukas Pfahler , Katharina Morik

Deep neural networks (DNN) are increasingly being used to perform algorithm-selection in combinatorial optimisation domains, particularly as they accommodate input representations which avoid designing and calculating features. Mounting…

Neural and Evolutionary Computing · Computer Science 2024-06-25 Emma Hart , Quentin Renau , Kevin Sim , Mohamad Alissa

We present a framework for efficient perceptual inference that explicitly reasons about the segmentation of its inputs and features. Rather than being trained for any specific segmentation, our framework learns the grouping process in an…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Klaus Greff , Antti Rasmus , Mathias Berglund , Tele Hotloo Hao , Jürgen Schmidhuber , Harri Valpola

Due to the powerful learning ability on high-rank and non-linear features, deep neural networks (DNNs) are being applied to data mining and machine learning in various fields, and exhibit higher discrimination performance than conventional…

Machine Learning · Computer Science 2023-02-21 Weiyu Guo , Zhijiang Yang , Shu Wu , Fu Chen

Deep neural networks (DNNs) have made a revolution in numerous fields during the last decade. However, in tasks with high safety requirements, such as medical or autonomous driving applications, providing an assessment of the models…

Machine Learning · Computer Science 2020-11-20 Omer Achrack , Raizy Kellerman , Ouriel Barzilay

Recent studies have demonstrated the effectiveness of clustering-based approaches for self-supervised and unsupervised learning. However, the application of clustering is often heuristic, and the optimal methodology remains unclear. In this…

Machine Learning · Computer Science 2025-11-10 Xiaodong Wang , Jing Huang , Kevin J Liang

Deep Convolutional Neural Networks (CNN) enforces supervised information only at the output layer, and hidden layers are trained by back propagating the prediction error from the output layer without explicit supervision. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Zhuolin Jiang , Yaming Wang , Larry Davis , Walt Andrews , Viktor Rozgic

We propose doubly nested network(DNNet) where all neurons represent their own sub-models that solve the same task. Every sub-model is nested both layer-wise and channel-wise. While nesting sub-models layer-wise is straight-forward with…

Machine Learning · Computer Science 2018-06-21 Jaehong Kim , Sungeun Hong , Yongseok Choi , Jiwon Kim

Owing to flexible architectures of deep convolutional neural networks (CNNs), CNNs are successfully used for image denoising. However, they suffer from the following drawbacks: (i) deep network architecture is very difficult to train. (ii)…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chunwei Tian , Yong Xu , Lunke Fei , Junqian Wang , Jie Wen , Nan Luo

In this paper, we propose an extremely simple deep model for the unsupervised nonlinear dimensionality reduction -- deep distributed random samplings, which performs like a stack of unsupervised bootstrap aggregating. First, its network…

Machine Learning · Computer Science 2013-12-17 Xiao-Lei Zhang

Generalization is essential for deep learning. In contrast to previous works claiming that Deep Neural Networks (DNNs) have an implicit regularization implemented by the stochastic gradient descent, we demonstrate explicitly Bayesian…

Machine Learning · Computer Science 2019-10-23 Xinjie Lan , Kenneth E. Barner

Explainability has been widely stated as a cornerstone of the responsible and trustworthy use of machine learning models. With the ubiquitous use of Deep Neural Network (DNN) models expanding to risk-sensitive and safety-critical domains,…

While neural networks have achieved vastly enhanced performance over traditional iterative methods in many cases, they are generally empirically designed and the underlying structures are difficult to interpret. The algorithm unrolling…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Yuelong Li , Mohammad Tofighi , Vishal Monga , Yonina C. Eldar