English
Related papers

Related papers: Addressing Deep Learning Model Calibration Using E…

200 papers

Deploying deep learning (DL) models in medical applications relies on predictive performance and other critical factors, such as conveying trustworthy predictive uncertainty. Uncertainty estimation (UE) methods provide potential solutions…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Kudaibergen Abutalip , Numan Saeed , Ikboljon Sobirov , Vincent Andrearczyk , Adrien Depeursinge , Mohammad Yaqub

Model calibration is essential for ensuring that the predictions of deep neural networks accurately reflect true probabilities in real-world classification tasks. However, deep networks often produce over-confident or under-confident…

Machine Learning · Computer Science 2025-04-01 Jinxu Lin , Linwei Tao , Minjing Dong , Chang Xu

Neural networks are often overconfident about their predictions, which undermines their reliability and trustworthiness. In this work, we present a novel technique, named Error-Driven Uncertainty Aware Training (EUAT), which aims to enhance…

Machine Learning · Computer Science 2024-09-12 Pedro Mendes , Paolo Romano , David Garlan

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch

For speech classification tasks, deep learning models often achieve high accuracy but exhibit shortcomings in calibration, manifesting as classifiers exhibiting overconfidence. The significance of calibration lies in its critical role in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-27 Yaqian Hao , Chenguang Hu , Yingying Gao , Shilei Zhang , Junlan Feng

Background and Aim: Accurate classification of Magnetic Resonance Images (MRI) is essential to accurately predict Mild Cognitive Impairment (MCI) to Alzheimer's Disease (AD) conversion. Meanwhile, deep learning has been successfully…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Kshitiz Shrestha , Omar Hisham Alsadoon , Abeer Alsadoon , Tarik A. Rashid , Rasha S. Ali , P. W. C. Prasad , Oday D. Jerew

When dealing with deep neural network (DNN) applications on edge devices, continuously updating the model is important. Although updating a model with real incoming data is ideal, using all of them is not always feasible due to limits, such…

Machine Learning · Computer Science 2023-03-23 Yuya Senzaki , Christian Hamelain

Estimates of predictive uncertainty are important for accurate model-based planning and reinforcement learning. However, predictive uncertainties---especially ones derived from modern deep learning systems---can be inaccurate and impose a…

Machine Learning · Computer Science 2019-06-21 Ali Malik , Volodymyr Kuleshov , Jiaming Song , Danny Nemer , Harlan Seymour , Stefano Ermon

Deep Learning (DL) aims at learning the \emph{meaningful representations}. A meaningful representation refers to the one that gives rise to significant performance improvement of associated Machine Learning (ML) tasks by replacing the raw…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Yanan Sun , Gary G. Yen , Zhang Yi

Although deep neural network (DNN) has achieved many state-of-the-art results, estimating the uncertainty presented in the DNN model and the data is a challenging task. Problems related to uncertainty such as classifying unknown classes…

Machine Learning · Computer Science 2018-05-17 Buu Phan

Modern neural network architectures for large-scale learning tasks have substantially higher model complexities, which makes understanding, visualizing and training these architectures difficult. Recent contributions to deep learning…

Machine Learning · Computer Science 2024-10-30 Jayadeva , Himanshu Pant , Mayank Sharma , Abhimanyu Dubey , Sumit Soman , Suraj Tripathi , Sai Guruju , Nihal Goalla

Deep learning (DL) has proven to be an effective machine learning and computer vision technique. DL-based image segmentation, object recognition and classification will aid many in-situ Mars rover tasks such as path planning and artifact…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Daniel Lundstrom , Alexander Huyen , Arya Mevada , Kyongsik Yun , Thomas Lu

Deep neural networks are highly effective when a large number of labeled samples are available but fail with few-shot classification tasks. Recently, meta-learning methods have received much attention, which train a meta-learner on massive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yucan Zhou , Yu Wang , Jianfei Cai , Yu Zhou , Qinghua Hu , Weiping Wang

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

Machine Learning · Computer Science 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

Deep learning (DL) has achieved great success in many applications, but it has been less well analyzed from the theoretical perspective. The unexplainable success of black-box DL models has raised questions among scientists and promoted the…

Robotics · Computer Science 2023-08-25 Huu-Thiet Nguyen , Chien Chern Cheah , Kar-Ann Toh

Calibrating deep learning models to yield uncertainty-aware predictions is crucial as deep neural networks get increasingly deployed in safety-critical applications. While existing post-hoc calibration methods achieve impressive results on…

Machine Learning · Computer Science 2023-07-06 Christian Tomani , Futa Waseda , Yuesong Shen , Daniel Cremers

Recently, there has been a growing interest in applying machine learning methods to problems in engineering mechanics. In particular, there has been significant interest in applying deep learning techniques to predicting the mechanical…

Machine Learning · Computer Science 2023-03-15 Saeed Mohammadzadeh , Peerasait Prachaseree , Emma Lejeune

Standard deep learning methods, such as Ensemble Models, Bayesian Neural Networks and Quantile Regression Models provide estimates to prediction uncertainties for data-driven deep learning models. However, they can be limited in their…

Uncertainty calibration is crucial for various machine learning applications, yet it remains challenging. Many models exhibit hallucinations - confident yet inaccurate responses - due to miscalibrated confidence. Here, we show that the…

Machine Learning · Computer Science 2025-03-28 Jeonghwan Cheon , Se-Bum Paik

Fully convolutional neural networks (FCNs), and in particular U-Nets, have achieved state-of-the-art results in semantic segmentation for numerous medical imaging applications. Moreover, batch normalization and Dice loss have been used…

Image and Video Processing · Electrical Eng. & Systems 2020-07-06 Alireza Mehrtash , William M. Wells , Clare M. Tempany , Purang Abolmaesumi , Tina Kapur