English

Uncertainty Quantification in Probabilistic Machine Learning Models: Theory, Methods, and Insights

Machine Learning 2025-09-11 v2 Artificial Intelligence Machine Learning

Abstract

Uncertainty Quantification (UQ) is essential in probabilistic machine learning models, particularly for assessing the reliability of predictions. In this paper, we present a systematic framework for estimating both epistemic and aleatoric uncertainty in probabilistic models. We focus on Gaussian Process Latent Variable Models and employ scalable Random Fourier Features-based Gaussian Processes to approximate predictive distributions efficiently. We derive a theoretical formulation for UQ, propose a Monte Carlo sampling-based estimation method, and conduct experiments to evaluate the impact of uncertainty estimation. Our results provide insights into the sources of predictive uncertainty and illustrate the effectiveness of our approach in quantifying the confidence in the predictions.

Keywords

Cite

@article{arxiv.2509.05877,
  title  = {Uncertainty Quantification in Probabilistic Machine Learning Models: Theory, Methods, and Insights},
  author = {Marzieh Ajirak and Anand Ravishankar and Petar M. Djuric},
  journal= {arXiv preprint arXiv:2509.05877},
  year   = {2025}
}

Comments

Accepted to EUSIPCO 2025

R2 v1 2026-07-01T05:24:43.423Z