English
Related papers

Related papers: Deep Neural Network Calibration by Reducing Classi…

200 papers

As the development of neural networks, more and more deep neural networks are adopted in various tasks, such as image classification. However, as the huge computational overhead, these networks could not be applied on mobile devices or…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Yunteng Luan , Hanyu Zhao , Zhi Yang , Yafei Dai

The adoption of deep learning across various fields has been extensive, yet there is a lack of focus on evaluating the performance of deep learning pipelines. Typically, with the increased use of large datasets and complex models, the…

Machine Learning · Computer Science 2024-05-21 Yewen Fan , Nian Si , Xiangchen Song , Kun Zhang

Class probabilities predicted by most multiclass classifiers are uncalibrated, often tending towards over-confidence. With neural networks, calibration can be improved by temperature scaling, a method to learn a single corrective…

Machine Learning · Computer Science 2019-10-29 Meelis Kull , Miquel Perello-Nieto , Markus Kängsepp , Telmo Silva Filho , Hao Song , Peter Flach

Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use…

Machine Learning · Computer Science 2018-07-03 Volodymyr Kuleshov , Nathan Fenner , Stefano Ermon

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

Machine Learning · Computer Science 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

High demand for computation resources severely hinders deployment of large-scale Deep Neural Networks (DNN) in resource constrained devices. In this work, we propose a Structured Sparsity Learning (SSL) method to regularize the structures…

Neural and Evolutionary Computing · Computer Science 2016-10-19 Wei Wen , Chunpeng Wu , Yandan Wang , Yiran Chen , Hai Li

The success of modern deep learning algorithms for image segmentation heavily depends on the availability of large datasets with clean pixel-level annotations (masks), where the objects of interest are accurately delineated. Lack of time…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Ekaterina Redekop , Alexey Chernyavskiy

A machine learning model is calibrated if its predicted probability for an outcome matches the observed frequency for that outcome conditional on the model prediction. This property has become increasingly important as the impact of machine…

Machine Learning · Computer Science 2025-02-25 Muthu Chidambaram , Rong Ge

Deep Neural Networks (DNNs) are increasingly deployed in safety-critical applications including autonomous vehicles and medical diagnostics. To reduce the residual risk for unexpected DNN behaviour and provide evidence for their trustworthy…

Software Engineering · Computer Science 2019-02-19 Hasan Ferit Eniser , Simos Gerasimou , Alper Sen

Deep Learning (DL) has made remarkable achievements in computer vision and adopted in safety critical domains such as medical imaging or autonomous drive. Thus, it is necessary to understand the uncertainty of the model to effectively…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Hyekyoung Hwang , Jitae Shin

Model compression and model defense for deep neural networks (DNNs) have been extensively and individually studied. Considering the co-importance of model compactness and robustness in practical applications, several prior works have…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Huy Phan , Miao Yin , Yang Sui , Bo Yuan , Saman Zonouz

Instance segmentation plays a pivotal role in medical image analysis by enabling precise localization and delineation of lesions, tumors, and anatomical structures. Although deep learning models such as Mask R-CNN and BlendMask have…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Mengxia Dai , Wenqian Luo , Tianyang Li

In this paper, we approach the problem of uncertainty quantification in deep learning through a predictive framework, which captures uncertainty in model parameters by specifying our assumptions about the predictive distribution of unseen…

Machine Learning · Statistics 2024-03-20 Luhuan Wu , Sinead Williamson

Recent studies have shown that deep neural networks are not well-calibrated and often produce over-confident predictions. The miscalibration issue primarily stems from using cross-entropy in classifications, which aims to align predicted…

Machine Learning · Computer Science 2025-02-05 Daehwan Kim , Haejun Chung , Ikbeom Jang

Despite their impressive predictive performance, GNNs often exhibit poor confidence calibration, i.e., their predicted confidence scores do not accurately reflect true correctness likelihood. This issue raises concerns about their…

Machine Learning · Computer Science 2025-03-25 Yilong Wang , Jiahao Zhang , Tianxiang Zhao , Suhang Wang

Deep learning (DL) models have received particular attention in medical imaging due to their promising pattern recognition capabilities. However, Deep Neural Networks (DNNs) require a huge amount of data, and because of the lack of…

Image and Video Processing · Electrical Eng. & Systems 2021-07-27 Donya Khaledyan , AmirReza Tajally , Ali Sarkhosh , Afshar Shamsi , Hamzeh Asgharnezhad , Abbas Khosravi , Saeid Nahavandi

Neural models, with their ability to provide novel representations, have shown promising results in prediction tasks in healthcare. However, patient demographics, medical technology, and quality of care change over time. This often leads to…

Machine Learning · Computer Science 2022-12-02 Miguel Rios , Ameen Abu-Hanna

We study the tradeoff between computational effort and classification accuracy in a cascade of deep neural networks. During inference, the user sets the acceptable accuracy degradation which then automatically determines confidence…

Machine Learning · Computer Science 2020-11-12 Konstantin Berestizshevsky , Guy Even

In medical image classification tasks, it is common to find that the number of normal samples far exceeds the number of abnormal samples. In such class-imbalanced situations, reliable training of deep neural networks continues to be a major…

Machine Learning · Computer Science 2022-04-06 Sivaramakrishnan Rajaraman , Prasanth Ganesan , Sameer Antani

With the advancement of deep learning technology, neural networks have demonstrated their excellent ability to provide accurate predictions in many tasks. However, a lack of consideration for neural network calibration will not gain trust…

Machine Learning · Computer Science 2022-11-30 Lei Hsiung , Yung-Chen Tang , Pin-Yu Chen , Tsung-Yi Ho