English
Related papers

Related papers: Confidence estimation in Deep Neural networks via …

200 papers

We propose a new approach for the problem of relative depth estimation from a single image. Instead of directly regressing over depth scores, we formulate the problem as estimation of a probability distribution over depth and aim to learn…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Alican Mertan , Yusuf Huseyin Sahin , Damien Jade Duff , Gozde Unal

Pruning neural networks has proven to be a successful approach to increase the efficiency and reduce the memory storage of deep learning models without compromising performance. Previous literature has shown that it is possible to achieve a…

Machine Learning · Computer Science 2024-08-12 Joaquin Alvarez

Deep neural networks (DNNs) have demonstrated remarkable success, yet their wide adoption is often hindered by their opaque decision-making. To address this, attribution methods have been proposed to assign relevance values to each part of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Danielle Cohen , Hila Chefer , Lior Wolf

Deep neural networks (DNNs) have proven to be powerful predictors and are widely used for various tasks. Credible uncertainty estimation of their predictions, however, is crucial for their deployment in many risk-sensitive applications. In…

Machine Learning · Computer Science 2021-12-03 Ido Galil , Ran El-Yaniv

In the field of medical image analysis, deep learning models have demonstrated remarkable success in enhancing diagnostic accuracy and efficiency. However, the reliability of these models is heavily dependent on the quality of training…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Maolin Li , Giacomo Tarroni

We present a new method for uncertainty estimation and out-of-distribution detection in neural networks with softmax output. We extend softmax layer with an additional constant input. The corresponding additional output is able to represent…

Machine Learning · Computer Science 2019-04-09 Marcin Możejko , Mateusz Susik , Rafał Karczewski

As humans, we inherently perceive images based on their predominant features, and ignore noise embedded within lower bit planes. On the contrary, Deep Neural Networks are known to confidently misclassify images corrupted with meticulously…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Sravanti Addepalli , Vivek B. S. , Arya Baburaj , Gaurang Sriramanan , R. Venkatesh Babu

A critical step to building trustworthy deep neural networks is trust quantification, where we ask the question: How much can we trust a deep neural network? In this study, we take a step towards simple, interpretable metrics for trust…

Machine Learning · Computer Science 2021-04-06 Alexander Wong , Xiao Yu Wang , Andrew Hryniowski

Miscalibration - a mismatch between a model's confidence and its correctness - of Deep Neural Networks (DNNs) makes their predictions hard to rely on. Ideally, we want networks to be accurate, calibrated and confident. We show that, as…

Machine Learning · Computer Science 2020-10-27 Jishnu Mukhoti , Viveka Kulharia , Amartya Sanyal , Stuart Golodetz , Philip H. S. Torr , Puneet K. Dokania

Deep neural networks can be roughly divided into deterministic neural networks and stochastic neural networks.The former is usually trained to achieve a mapping from input space to output space via maximum likelihood estimation for the…

This work investigates the detection of instabilities that may occur when utilizing deep learning models for image reconstruction tasks. Although neural networks often empirically outperform traditional reconstruction methods, their usage…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Jan Macdonald , Maximilian März , Luis Oala , Wojciech Samek

Recently, many studies have demonstrated deep neural network (DNN) classifiers can be fooled by the adversarial example, which is crafted via introducing some perturbations into an original sample. Accordingly, some powerful defense…

Cryptography and Security · Computer Science 2019-01-10 Bin Liang , Hongcheng Li , Miaoqiang Su , Xirong Li , Wenchang Shi , Xiaofeng Wang

In this article, we address the challenges of image super-resolution and noise reduction, which are crucial for enhancing the quality of images derived from low-resolution or noisy data. We compared and assessed several approaches for…

Disordered Systems and Neural Networks · Physics 2024-06-17 Ngoc-Giau Pham , Thanh-Hai Tong Le , Van-Hieu Duong , Hong-Ngoc Tran , Phuoc-Hung Vo

In this paper we address the issue of output instability of deep neural networks: small perturbations in the visual input can significantly distort the feature embeddings and output of a neural network. Such instability affects many deep…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Stephan Zheng , Yang Song , Thomas Leung , Ian Goodfellow

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou

Contrastive approaches to representation learning have recently shown great promise. In contrast to generative approaches, these contrastive models learn a deterministic encoder with no notion of uncertainty or confidence. In this paper, we…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Noah Goodman

Mixing (or prior) density estimation is an important problem in machine learning and statistics, especially in empirical Bayes $g$-modeling where accurately estimating the prior is necessary for making good posterior inferences. In this…

Machine Learning · Statistics 2024-06-11 Shijie Wang , Saptarshi Chakraborty , Qian Qin , Ray Bai

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

Given a deep neural network image classification model that we treat as a black box, and an unlabeled evaluation dataset, we develop an efficient strategy by which the classifier can be evaluated. Randomly sampling and labeling instances…

Machine Learning · Computer Science 2020-06-30 Walter Bennette , Karsten Maurer , Sean Sisti

Motivated by the need to identify erroneous disparity assignments, various approaches for uncertainty and confidence estimation of dense stereo matching have been presented in recent years. As in many other fields, especially deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Max Mehltretter