English
Related papers

Related papers: Zero-Shot Uncertainty Quantification using Diffusi…

200 papers

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying…

In the context of an increasing popularity of data-driven models to represent dynamical systems, many machine learning-based implementations of the Koopman operator have recently been proposed. However, the vast majority of those works are…

Machine Learning · Computer Science 2024-03-14 Anthony Frion , Lucas Drumetz , Guillaume Tochon , Mauro Dalla Mura , Albdeldjalil Aïssa El Bey

In modern process industries, data-driven models are important tools for real-time monitoring when key performance indicators are difficult to measure directly. While accurate predictions are essential, reliable uncertainty quantification…

Machine Learning · Computer Science 2026-04-07 Yiran Ma , Jerome Le Ny , Zhichao Chen , Zhihuan Song

Epistemic uncertainty is crucial for safety-critical applications and data acquisition tasks. Yet, we find an important phenomenon in deep learning models: an epistemic uncertainty collapse as model complexity increases, challenging the…

Machine Learning · Computer Science 2025-05-27 Andreas Kirsch

This paper presents an ensemble data assimilation method using the pseudo ensembles generated by denoising diffusion probabilistic model. Since the model is trained against noisy and sparse observation data, this model can produce divergent…

Machine Learning · Computer Science 2023-08-15 Yuuichi Asahi , Yuta Hasegawa , Naoyuki Onodera , Takashi Shimokawabe , Hayato Shiba , Yasuhiro Idomura

Numerous studies have focused on learning and understanding the dynamics of physical systems from video data, such as spatial intelligence. Artificial intelligence requires quantitative assessments of the uncertainty of the model to ensure…

Machine Learning · Computer Science 2024-12-18 Aoming Liang , Qi Liu , Lei Xu , Fahad Sohrab , Weicheng Cui , Changhui Song , Moncef Gabbouj

Data-driven methods based on machine learning have the potential to accelerate computational analysis of atomic structures. In this context, reliable uncertainty estimates are important for assessing confidence in predictions and enabling…

Machine Learning · Computer Science 2021-11-04 Jonas Busk , Peter Bjørn Jørgensen , Arghya Bhowmik , Mikkel N. Schmidt , Ole Winther , Tejs Vegge

Decomposing prediction uncertainty into aleatoric (irreducible) and epistemic (reducible) components is critical for the reliable deployment of machine learning systems. While the mutual information between the response variable and model…

Machine Learning · Statistics 2026-02-10 Anchit Jain , Stephen Bates

One of the main challenges of the machine reading comprehension (MRC) models is their fragile out-of-domain generalization, which makes these models not properly applicable to real-world general-purpose question answering problems. In this…

Computation and Language · Computer Science 2021-07-01 Razieh Baradaran , Hossein Amirkhani

Predictions and forecasts of machine learning models should take the form of probability distributions, aiming to increase the quantity of information communicated to end users. Although applications of probabilistic prediction and…

Machine Learning · Statistics 2024-03-19 Hristos Tyralis , Georgia Papacharalampous

While Deep Neural Networks (DNNs) achieve state-of-the-art accuracy in various applications, they often fall short in accurately estimating their predictive uncertainty and, in turn, fail to recognize when these predictions may be wrong.…

Machine Learning · Computer Science 2020-07-22 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

Ensembles of neural networks achieve superior performance compared to stand-alone networks in terms of accuracy, uncertainty calibration and robustness to dataset shift. \emph{Deep ensembles}, a state-of-the-art method for uncertainty…

Machine Learning · Computer Science 2022-02-23 Sheheryar Zaidi , Arber Zela , Thomas Elsken , Chris Holmes , Frank Hutter , Yee Whye Teh

Despite the huge success of deep neural networks (NNs), finding good mechanisms for quantifying their prediction uncertainty is still an open problem. Bayesian neural networks are one of the most popular approaches to uncertainty…

Machine Learning · Statistics 2020-01-01 Agustinus Kristiadi , Sina Däubener , Asja Fischer

Denoising diffusion models have spurred significant gains in density modeling and image generation, precipitating an industrial revolution in text-guided AI art generation. We introduce a new mathematical foundation for diffusion models…

Machine Learning · Computer Science 2023-02-09 Xianghao Kong , Rob Brekelmans , Greg Ver Steeg

Data assimilation (DA) improves prediction of chaotic systems by combining model forecasts with sparse, noisy observations. Many DA methods are inherently probabilistic, but accurate probabilistic DA is often computationally expensive…

Fluid Dynamics · Physics 2026-04-24 Aditya Sai Pranith Ayapilla , Kazuya Miyashita , Yuki Yasuda , Ryo Onishi

Downscaling, or super-resolution, provides decision-makers with detailed, high-resolution information about the potential risks and impacts of climate change, based on climate model output. Machine learning algorithms are proving themselves…

Atmospheric and Oceanic Physics · Physics 2024-04-30 Robbie A. Watt , Laura A. Mansfield

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several studies have proposed…

Machine Learning · Computer Science 2024-05-30 Yifei Shen , Xinyang Jiang , Yezhen Wang , Yifan Yang , Dongqi Han , Dongsheng Li

Predictions in the form of probability distributions are crucial for effective decision-making. Quantile regression enables such predictions within spatial prediction settings that aim to create improved precipitation datasets by merging…

Machine Learning · Computer Science 2025-08-05 Georgia Papacharalampous , Hristos Tyralis , Nikolaos Doulamis , Anastasios Doulamis

Quantifying forecast uncertainty is a key aspect of state-of-the-art numerical weather prediction and data assimilation systems. Ensemble-based data assimilation systems incorporate state-dependent uncertainty quantification based on…

Atmospheric and Oceanic Physics · Physics 2023-05-17 Maximiliano A. Sacco , Manuel Pulido , Juan J. Ruiz , Pierre Tandeo

Limited by the encoder-decoder architecture, learning-based edge detectors usually have difficulty predicting edge maps that satisfy both correctness and crispness. With the recent success of the diffusion probabilistic model (DPM), we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yunfan Ye , Kai Xu , Yuhang Huang , Renjiao Yi , Zhiping Cai