English
Related papers

Related papers: An Entropy-Based Test and Development Framework fo…

200 papers

Data stream mining problem has caused widely concerns in the area of machine learning and data mining. In some recent studies, ensemble classification has been widely used in concept drift detection, however, most of them regard…

Data Structures and Algorithms · Computer Science 2017-08-14 Junhong Wang , Shuliang Xu , Bingqian Duan , Caifeng Liu , Jiye Liang

The inaccuracy of neural network models on inputs that do not stem from the training data distribution is both problematic and at times unrecognized. Model uncertainty estimation can address this issue, where uncertainty estimates are often…

Machine Learning · Computer Science 2020-02-14 Siddhartha Jain , Ge Liu , Jonas Mueller , David Gifford

We show that ensembles of deep neural networks, called deep ensembles, can be used to perform quantum parameter estimation while also providing a means for quantifying uncertainty in parameter estimates, which is a key advantage of using…

Quantum Physics · Physics 2026-03-09 Amanuel Anteneh

Deep learning models struggle with uncertainty estimation. Many approaches are either computationally infeasible or underestimate uncertainty. We investigate \textit{BatchEnsemble} as a general and scalable method for uncertainty estimation…

Machine Learning · Computer Science 2026-01-30 Morten Blørstad , Herman Jangsett Mostein , Nello Blaser , Pekka Parviainen

We present a critical survey on the consistency of uncertainty quantification used in deep learning and highlight partial uncertainty coverage and many inconsistencies. We then provide a comprehensive and statistically consistent framework…

Machine Learning · Computer Science 2026-01-14 Peter Jan van Leeuwen , J. Christine Chiu , C. Kevin Yang

Ensemble forecasting is, so far, the most successful approach to produce relevant forecasts with an estimation of their uncertainty. The main limitations of ensemble forecasting are the high computational cost and the difficulty to capture…

Machine Learning · Computer Science 2022-12-21 Maximiliano A. Sacco , Juan J. Ruiz , Manuel Pulido , Pierre Tandeo

Recently, deep learning has emerged as a promising tool for statistical downscaling, the set of methods for generating high-resolution climate fields from coarse low-resolution variables. Nevertheless, their ability to generalize to climate…

Machine Learning · Computer Science 2023-05-03 Jose González-Abad , Jorge Baño-Medina

We present batching as an omnibus device for uncertainty quantification using simulation output. We consider the classical context of a simulationist performing uncertainty quantification on an estimator $\theta_n$ (of an unknown fixed…

Methodology · Statistics 2024-08-27 Yongseok Jeon , Yi Chu , Raghu Pasupathy , Sara Shashaani

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when…

Methodology · Statistics 2020-09-18 Paul A. Parker , Scott H. Holan

This paper presents first steps toward robust models for crisis prediction. We conduct a horse race of conventional statistical methods and more recent machine learning methods as early-warning models. As individual models are in the…

Statistical Finance · Quantitative Finance 2016-04-04 Markus Holopainen , Peter Sarlin

This work addresses the challenge of providing consistent explanations for predictive models in the presence of model indeterminacy, which arises due to the existence of multiple (nearly) equally well-performing models for a given dataset…

Machine Learning · Computer Science 2023-06-14 Dan Ley , Leonard Tang , Matthew Nazari , Hongjin Lin , Suraj Srinivas , Himabindu Lakkaraju

In this paper, we study the problem of uncertainty estimation and calibration for LLMs. We begin by formulating the uncertainty estimation problem, a relevant yet underexplored area in existing literature. We then propose a supervised…

Machine Learning · Computer Science 2024-10-24 Linyu Liu , Yu Pan , Xiaocheng Li , Guanting Chen

Uncertainty estimation is critical for numerous applications of deep neural networks and draws growing attention from researchers. Here, we demonstrate an uncertainty quantification approach for deep neural networks used in inverse problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Luzhe Huang , Jianing Li , Xiaofu Ding , Yijie Zhang , Hanlong Chen , Aydogan Ozcan

Entropy estimation plays a crucial role in various fields, such as information theory, statistical data science, and machine learning. However, traditional entropy estimation methods often struggle with complex data distributions.…

Methodology · Statistics 2025-05-16 Luca Scrucca

Learning-based approaches to verifying unknown Markov decision processes (MDPs) often employ uncertain MDPs. These models use, for example, confidence intervals to capture transition uncertainty and allow synthesis of policies that are…

Machine Learning · Computer Science 2026-05-05 Yannik Schnitzer , Alessandro Abate , David Parker

Assessing uncertainty is an important step towards ensuring the safety and reliability of machine learning systems. Existing uncertainty estimation techniques may fail when their modeling assumptions are not met, e.g. when the data…

Machine Learning · Computer Science 2017-01-24 Volodymyr Kuleshov , Stefano Ermon

Process mining is a discipline which concerns the analysis of execution data of operational processes, the extraction of models from event data, the measurement of the conformance between event data and normative models, and the enhancement…

Data Structures and Algorithms · Computer Science 2022-04-09 Marco Pegoraro , Merih Seran Uysal , Wil M. P. van der Aalst

Many important problems in the real world don't have unique solutions. It is thus important for machine learning models to be capable of proposing different plausible solutions with meaningful probability measures. In this work we introduce…

Machine Learning · Computer Science 2020-07-28 Di Qiu , Lok Ming Lui

Stochastic simulation has been widely used to analyze the performance of complex stochastic systems and facilitate decision making in those systems. Stochastic simulation is driven by the input model, which is a collection of probability…

Risk Management · Quantitative Finance 2020-02-14 Tianyi Liu , Enlu Zhou

This paper proposes a data-driven approximate Bayesian computation framework for parameter estimation and uncertainty quantification of epidemic models, which incorporates two novelties: (i) the identification of the initial conditions by…

Applications · Statistics 2023-06-28 Americo Cunha , David A. W. Barton , Thiago G. Ritto