English
Related papers

Related papers: Improvements on Uncertainty Quantification for Nod…

200 papers

Deep neural networks have proven to be extremely powerful, however, they are also vulnerable to adversarial attacks which can cause hazardous incorrect predictions in safety-critical applications. Certified robustness via randomized…

Machine Learning · Computer Science 2024-10-29 Sina Däubener , Kira Maag , David Krueger , Asja Fischer

Confidence calibration - the process to calibrate the output probability distribution of neural networks - is essential for safety-critical applications of such networks. Recent works verify the link between mis-calibration and overfitting.…

Machine Learning · Computer Science 2023-05-24 Linwei Tao , Minjing Dong , Daochang Liu , Changming Sun , Chang Xu

Normalization is an important and vastly investigated technique in deep learning. However, its role for Ordinary Differential Equation based networks (neural ODEs) is still poorly understood. This paper investigates how different…

Machine Learning · Computer Science 2020-04-29 Julia Gusak , Larisa Markeeva , Talgat Daulbaev , Alexandr Katrutsa , Andrzej Cichocki , Ivan Oseledets

Ensuring reliability is paramount in deep learning, particularly within the domain of medical imaging, where diagnostic decisions often hinge on model outputs. The capacity to separate out-of-distribution (OOD) samples has proven to be a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Anju Chhetri , Jari Korhonen , Prashnna Gyawali , Binod Bhattarai

Out-of-distribution (OOD) detection in deep learning has traditionally been framed as a binary task, where samples are either classified as belonging to the known classes or marked as OOD, with little attention given to the semantic…

Machine Learning · Computer Science 2025-03-28 Erik Wallin , Fredrik Kahl , Lars Hammarstrand

Deep neural networks (DNNs), especially convolutional neural networks, have achieved superior performance on image classification tasks. However, such performance is only guaranteed if the input to a trained model is similar to the training…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Liang Liang , Linhai Ma , Linchen Qian , Jiasong Chen

Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out-of-distribution inputs (OODs). This limitation is one of the key challenges in the adoption of DNNs in high-assurance systems such as…

Machine Learning · Computer Science 2021-08-21 Ramneet Kaur , Susmit Jha , Anirban Roy , Sangdon Park , Oleg Sokolsky , Insup Lee

Recent works have shown that deep neural networks can achieve super-human performance in a wide range of image classification tasks in the medical imaging domain. However, these works have primarily focused on classification accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Gongbo Liang , Yu Zhang , Xiaoqin Wang , Nathan Jacobs

The fusion of raw sensor data to create a Bird's Eye View (BEV) representation is critical for autonomous vehicle planning and control. Despite the growing interest in using deep learning models for BEV semantic segmentation, anticipating…

Machine Learning · Computer Science 2025-03-04 Linlin Yu , Bowen Yang , Tianhao Wang , Kangshuo Li , Feng Chen

Assessing the predictive uncertainty of deep neural networks is crucial for safety-related applications of deep learning. Although Bayesian deep learning offers a principled framework for estimating model uncertainty, the common approaches…

Machine Learning · Computer Science 2024-03-06 Yookoon Park , David M. Blei

Uncertainty quantification (UQ) is important for reliability assessment and enhancement of machine learning models. In deep learning, uncertainties arise not only from data, but also from the training procedure that often injects…

Machine Learning · Statistics 2023-11-13 Ziyi Huang , Henry Lam , Haofeng Zhang

Although the deep structure guarantees the powerful expressivity of deep networks (DNNs), it also triggers serious overfitting problem. To improve the generalization capacity of DNNs, many strategies were developed to improve the diversity…

Machine Learning · Computer Science 2021-04-06 Chenguang Zhang , Yuexian Hou , Dawei Song , Liangzhu Ge , Yaoshuai Yao

Graph clustering plays a crucial role in graph representation learning but often faces challenges in achieving feature-space diversity. While Deep Modularity Networks (DMoN) leverage modularity maximization and collapse regularization to…

Machine Learning · Computer Science 2025-11-04 Yasmin Salehi , Dennis Giannacopoulos

The inaccuracy of neural network models on inputs that do not stem from the training data distribution is both problematic and at times unrecognized. Model uncertainty estimation can address this issue, where uncertainty estimates are often…

Machine Learning · Computer Science 2020-02-14 Siddhartha Jain , Ge Liu , Jonas Mueller , David Gifford

Unsupervised continual learning aims to learn new tasks incrementally without requiring human annotations. However, most existing methods, especially those targeted on image classification, only work in a simplified scenario by assuming all…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Jiangpeng He , Fengqing Zhu

The discrepancy between in-distribution (ID) and out-of-distribution (OOD) samples can lead to \textit{distributional vulnerability} in deep neural networks, which can subsequently lead to high-confidence predictions for OOD samples. This…

Machine Learning · Computer Science 2023-10-03 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

Deep neural networks have achieved outstanding performance over various tasks, but they have a critical issue: over-confident predictions even for completely unknown samples. Many studies have been proposed to successfully filter out these…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Jihyo Kim , Jiin Koo , Sangheum Hwang

Image reconstruction methods based on deep neural networks have shown outstanding performance, equalling or exceeding the state-of-the-art results of conventional approaches, but often do not provide uncertainty information about the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Riccardo Barbano , Željko Kereta , Chen Zhang , Andreas Hauptmann , Simon Arridge , Bangti Jin

Knowing the uncertainty associated with the output of a deep neural network is of paramount importance in making trustworthy decisions, particularly in high-stakes fields like medical diagnosis and autonomous systems. Monte Carlo Dropout…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Hamzeh Asgharnezhad , Afshar Shamsi , Roohallah Alizadehsani , Arash Mohammadi , Hamid Alinejad-Rokny

Deep neural networks (DNNs) often exhibit overconfidence when encountering out-of-distribution (OOD) samples, posing significant challenges for deployment. Since DNNs are trained on in-distribution (ID) datasets, the information flow of ID…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Guide Yang , Chao Hou , Weilong Peng , Xiang Fang , Yongwei Nie , Peican Zhu , Keke Tang