English
Related papers

Related papers: Beyond In-Domain Scenarios: Robust Density-Aware C…

200 papers

Quantifying uncertainty in deep regression models is important both for understanding the confidence of the model and for safe decision-making in high-risk domains. Existing approaches that yield prediction intervals overlook distributional…

Machine Learning · Computer Science 2025-12-02 Adriel Sosa Marco , John Daniel Kirwan , Alexia Toumpa , Simos Gerasimou

Image-based diagnostic decision support systems (DDSS) utilizing deep learning have the potential to optimize clinical workflows. However, developing DDSS requires extensive datasets with expert annotations and is therefore costly.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Helen Schneider , Sebastian Nowak , Aditya Parikh , Yannik C. Layer , Maike Theis , Wolfgang Block , Alois M. Sprinkart , Ulrike Attenberger , Rafet Sifa

Since state-of-the-art uncertainty estimation methods are often computationally demanding, we investigate whether incorporating prior information can improve uncertainty estimates in conventional deep neural networks. Our focus is on…

Machine Learning · Computer Science 2025-03-21 Fabian Denoodt , José Oramas

Defect detection is a critical research area in artificial intelligence. Recently, synthetic data-based self-supervised learning has shown great potential on this task. Although many sophisticated synthesizing strategies exist, little…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Yuxuan Cai , Dingkang Liang , Dongliang Luo , Xinwei He , Xin Yang , Xiang Bai

Artificial neural networks (ANNs) are highly flexible predictive models. However, reliably quantifying uncertainty for their predictions is a continuing challenge. There has been much recent work on "recalibration" of predictive…

Methodology · Statistics 2024-03-12 R. Torres , D. J. Nott , S. A. Sisson , T. Rodrigues , J. G. Reis , G. S. Rodrigues

Out-of-distribution (OOD) generalization poses a serious challenge for modern deep learning (DL). OOD data consists of test data that is significantly different from the model's training data. DL models that perform well on in-domain test…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Skylar E. Stolte , Kyle Volle , Aprinda Indahlastari , Alejandro Albizu , Adam J. Woods , Kevin Brink , Matthew Hale , Ruogu Fang

Assessing the predictive uncertainty of deep neural networks is crucial for safety-related applications of deep learning. Although Bayesian deep learning offers a principled framework for estimating model uncertainty, the common approaches…

Machine Learning · Computer Science 2024-03-06 Yookoon Park , David M. Blei

Meta-learning aims to train models that can generalize to new tasks with limited labeled data by extracting shared features across diverse task datasets. Additionally, it accounts for prediction uncertainty during both training and…

Machine Learning · Computer Science 2025-03-03 Hyungi Lee , Chaeyun Jang , Dongbok Lee , Juho Lee

Miscalibration in deep learning refers to there is a discrepancy between the predicted confidence and performance. This problem usually arises due to the overfitting problem, which is characterized by learning everything presented in the…

Machine Learning · Computer Science 2024-07-16 Zongbo Han , Yifeng Yang , Changqing Zhang , Linjun Zhang , Joey Tianyi Zhou , Qinghua Hu

Label noise poses a serious threat to deep neural networks (DNNs). Employing robust loss functions which reconcile fitting ability with robustness is a simple but effective strategy to handle this problem. However, the widely-used static…

Machine Learning · Computer Science 2023-08-08 Xiu-Chuan Li , Xiaobo Xia , Fei Zhu , Tongliang Liu , Xu-Yao Zhang , Cheng-Lin Liu

We study model-agnostic post-hoc calibration methods intended to improve probabilistic predictions in supervised binary classification on real i.i.d. tabular data, with particular emphasis on conformal and Venn-based approaches that provide…

Machine Learning · Computer Science 2026-01-29 Valery Manokhin , Daniel Grønhaug

Deep neural networks have gained tremendous popularity in last few years. They have been applied for the task of classification in almost every domain. Despite the success, deep networks can be incredibly slow to train for even moderate…

Machine Learning · Computer Science 2018-10-11 Gaurav Singh , John Shawe-Taylor

Deep Learning methods are known to suffer from calibration issues: they typically produce over-confident estimates. These problems are exacerbated in the low data regime. Although the calibration of probabilistic models is well studied,…

Machine Learning · Statistics 2021-11-30 Rahul Rahaman , Alexandre H. Thiery

Image clustering is an important but challenging task in machine learning. As in most image processing areas, the latest improvements came from models based on the deep learning approach. However, classical deep learning methods have…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Thiago V. M. Souza , Cleber Zanchettin

Successful adoption of deep learning (DL) in the wild requires models to be: (1) compact, (2) accurate, and (3) robust to distributional shifts. Unfortunately, efforts towards simultaneously meeting these requirements have mostly been…

Machine Learning · Computer Science 2021-11-09 James Diffenderfer , Brian R. Bartoldson , Shreya Chaganti , Jize Zhang , Bhavya Kailkhura

Recently, deep neural networks have gained increasing popularity in the field of time series forecasting. A primary reason for their success is their ability to effectively capture complex temporal dynamics across multiple related time…

Machine Learning · Computer Science 2022-06-23 Xiaoyong Jin , Youngsuk Park , Danielle C. Maddix , Hao Wang , Yuyang Wang

The recent developments of complex deep learning models have led to unprecedented ability to accurately predict across multiple data representation types. Conformal prediction for uncertainty quantification of these models has risen in…

Deep neural networks achieve impressive results across diverse applications, yet their overconfidence on unseen inputs necessitates reliable epistemic uncertainty modelling. Existing methods for uncertainty modelling face a fundamental…

Machine Learning · Computer Science 2026-05-04 Yao Ni , Jeremie Houssineau , Yew Soon Ong , Piotr Koniusz

Out-of-domain (OOD) generalization is a significant challenge for machine learning models. Many techniques have been proposed to overcome this challenge, often focused on learning models with certain invariance properties. In this work, we…

Machine Learning · Computer Science 2022-01-13 Yoav Wald , Amir Feder , Daniel Greenfeld , Uri Shalit

Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in…

Machine Learning · Computer Science 2020-07-16 Juan Maroñas , Roberto Paredes , Daniel Ramos