English
Related papers

Related papers: Epistemic Uncertainty Quantification in Deep Learn…

200 papers

Accounting for the uncertainty in the predictions of modern neural networks is a challenging and important task in many domains. Existing algorithms for uncertainty estimation require modifying the model architecture and training procedure…

Machine Learning · Statistics 2022-05-09 Alexander Fishkov , Maxim Panov

While Deep Neural Networks (DNNs) achieve state-of-the-art accuracy in various applications, they often fall short in accurately estimating their predictive uncertainty and, in turn, fail to recognize when these predictions may be wrong.…

Machine Learning · Computer Science 2020-07-22 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

Semi-supervised classification based on active learning has made significant progress, but the existing methods often ignore the uncertainty estimation (or reliability) of the prediction results during the learning process, which makes it…

Machine Learning · Computer Science 2025-05-28 Shenkai Zhao , Xinao Zhang , Lipeng Pan , Xiaobin Xu , Danilo Pelusi

In this paper, we adopt a probability distribution estimation perspective to explore the optimization mechanisms of supervised classification using deep neural networks. We demonstrate that, when employing the Fenchel-Young loss, despite…

Machine Learning · Computer Science 2025-04-01 Binchuan Qi , Wei Gong , Li Li

Brain vessel segmentation of MR scans is a critical step in the diagnosis of cerebrovascular diseases. Due to the fine vessel structure, manual vessel segmentation is time consuming. Therefore, automatic deep learning (DL) based…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Omini Rathore , Richard Paul , Abigail Morrison , Hanno Scharr , Elisabeth Pfaehler

Motivated by the need to identify erroneous disparity assignments, various approaches for uncertainty and confidence estimation of dense stereo matching have been presented in recent years. As in many other fields, especially deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Max Mehltretter

Uncertainty quantification (UQ) in scientific machine learning is increasingly critical as neural networks are widely adopted to tackle complex problems across diverse scientific disciplines. For physics-informed neural networks (PINNs), a…

Machine Learning · Statistics 2025-10-20 Frank Shih , Zhenghao Jiang , Faming Liang

Rankings are central to decision-making in fields ranging from education to online platforms, yet classical deterministic methods such as the Borda count method or Copeland-type pairwise methods ignore uncertainty due to sampling noise or…

Methodology · Statistics 2026-05-20 Shunpu Zhang

Applications of large language models often involve the generation of free-form responses, in which case uncertainty quantification becomes challenging. This is due to the need to identify task-specific uncertainties (e.g., about the…

Computation and Language · Computer Science 2024-10-21 Ziyu Wang , Chris Holmes

In the context of deep learning, many optimization methods use gradient covariance information in order to accelerate the convergence of Stochastic Gradient Descent. In particular, starting with Adagrad, a seemingly endless line of research…

Machine Learning · Computer Science 2020-12-08 Nikolaos Tselepidis , Jonas Kohler , Antonio Orvieto

Breast cancer is a heterogeneous disease with different molecular subtypes, clinical behavior, treatment responses as well as survival outcomes. The development of a reliable, accurate, available and inexpensive method to predict the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Mohaddeseh Chegini , Ali Mahloojifar

Uncertainty quantification (UQ) is a crucial but challenging task in many high-dimensional regression or learning problems to increase the confidence of a given predictor. We develop a new data-driven approach for UQ in regression that…

Machine Learning · Computer Science 2024-07-19 Frederik Hoppe , Claudio Mayrink Verdun , Hannah Laus , Felix Krahmer , Holger Rauhut

In this PhD thesis, we propose a novel framework for uncertainty quantification in machine learning, which is based on proper scores. Uncertainty quantification is an important cornerstone for trustworthy and reliable machine learning…

Machine Learning · Computer Science 2025-08-26 Sebastian G. Gruber

Although deep neural network (DNN) has achieved many state-of-the-art results, estimating the uncertainty presented in the DNN model and the data is a challenging task. Problems related to uncertainty such as classifying unknown classes…

Machine Learning · Computer Science 2018-05-17 Buu Phan

We are interested in estimating the uncertainties of deep neural networks, which play an important role in many scientific and engineering problems. In this paper, we present a striking new finding that an ensemble of neural networks with…

Machine Learning · Computer Science 2022-12-05 Jayaraman J. Thiagarajan , Rushil Anirudh , Vivek Narayanaswamy , Peer-Timo Bremer

In context-specific applications such as robotics, telecommunications, and healthcare, artificial intelligence systems often face the challenge of limited training data. This scarcity introduces epistemic uncertainty, i.e., reducible…

Information Theory · Computer Science 2026-03-17 Osvaldo Simeone , Yaniv Romano

Accurately identifying student misconceptions is crucial for personalized education but faces three challenges: (1) data scarcity with long-tail distribution, where authentic student reasoning is difficult to synthesize; (2) fuzzy…

Machine Learning · Computer Science 2026-05-15 Qirui Liu , Hao Chen , Weijie Shi , Jiajie Xu , Jia Zhu

Self-supervised contrastive learning has predominantly adopted deterministic methods, which are not suited for environments characterized by uncertainty and noise. This paper introduces a new perspective on incorporating uncertainty into…

Machine Learning · Computer Science 2024-05-28 Hongwei Bran Li , Cheng Ouyang , Tamaz Amiranashvili , Matthew S. Rosen , Bjoern Menze , Juan Eugenio Iglesias

Fisher Discriminant Analysis (FDA) is a subspace learning method which minimizes and maximizes the intra- and inter-class scatters of data, respectively. Although, in FDA, all the pairs of classes are treated the same way, some classes are…

Machine Learning · Statistics 2020-07-01 Benyamin Ghojogh , Milad Sikaroudi , H. R. Tizhoosh , Fakhri Karray , Mark Crowley

Tensor methods have become a promising tool to solve high-dimensional problems in the big data era. By exploiting possible low-rank tensor factorization, many high-dimensional model-based or data-driven problems can be solved to facilitate…

Optimization and Control · Mathematics 2019-08-22 Chunfeng Cui , Cole Hawkins , Zheng Zhang