English
Related papers

Related papers: Uncertainty Quantification and the Marginal MDP Mo…

200 papers

In system analysis and design optimization, multiple computational models are typically available to represent a given physical system. These models can be broadly classified as high-fidelity models, which provide highly accurate…

Machine Learning · Computer Science 2024-11-01 Ruda Zhang , Negin Alemazkoor

A discretization scheme for nonnegative diffusion processes is proposed and the convergence of the corresponding sequence of approximate processes is proved using the martingale problem framework. Motivations for this scheme come typically…

Computational Finance · Quantitative Finance 2010-11-16 Chantal Labbé , Bruno Rémillard , Jean-François Renaud

Markov decision processes (MDP) are useful to model optimisation problems in concurrent systems. To verify MDPs with efficient Monte Carlo techniques requires that their nondeterminism be resolved by a scheduler. Recent work has introduced…

Data Structures and Algorithms · Computer Science 2016-11-15 Pedro D'Argenio , Axel Legay , Sean Sedwards , Louis-Marie Traonouez

In this paper, we propose a general theory of ambiguity-averse MDPs, which treats the uncertain transition probabilities as random variables and evaluates a policy via a risk measure applied to its random return. This ambiguity-averse MDP…

Computer Science and Game Theory · Computer Science 2026-02-04 Axel Benyamine , Julien Grand-Clément , Marek Petrik , Michael I. Jordan , Alain Durmus

Sampling from complicated probability distributions is a hard computational problem arising in many fields, including statistical physics, optimization, and machine learning. Quantum computers have recently been used to sample from…

The aim of this work is to give an introduction to the theoretical background and computational complexity of Markov chain Monte Carlo methods. Most of the mathematical results related to the convergence are not found in most of the…

Computation · Statistics 2020-04-16 Izhar Asael Alonzo Matamoros

We introduce a novel Multi-Order Monte Carlo approach for uncertainty quantification in the context of multiscale time-dependent partial differential equations. The new framework leverages Implicit-Explicit Runge-Kutta time integrators to…

Numerical Analysis · Mathematics 2026-04-08 Giulia Bertaglia , Walter Boscheri , Lorenzo Pareschi

Deep neural networks achieve impressive results across diverse applications, yet their overconfidence on unseen inputs necessitates reliable epistemic uncertainty modelling. Existing methods for uncertainty modelling face a fundamental…

Machine Learning · Computer Science 2026-05-04 Yao Ni , Jeremie Houssineau , Yew Soon Ong , Piotr Koniusz

Effectively measuring and modeling the reliability of a trained model is essential to the real-world deployment of monocular depth estimation (MDE) models. However, the intrinsic ill-posedness and ordinal-sensitive nature of MDE pose major…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Mochu Xiang , Jing Zhang , Nick Barnes , Yuchao Dai

Robust Markov Decision Processes (MDPs) are receiving much attention in learning a robust policy which is less sensitive to environment changes. There are an increasing number of works analyzing sample-efficiency of robust MDPs. However,…

Machine Learning · Statistics 2023-09-13 Wenhao Yang , Han Wang , Tadashi Kozuno , Scott M. Jordan , Zhihua Zhang

It is important to estimate the errors of probabilistic inference algorithms. Existing diagnostics for Markov chain Monte Carlo methods assume inference is asymptotically exact, and are not appropriate for approximate methods like…

Machine Learning · Computer Science 2021-03-02 Justin Domke

In this paper, we present a formal quantification of epistemic uncertainty induced by numerical solutions of ordinary and partial differential equation models. Numerical solutions of differential equations contain inherent uncertainties due…

Markov decision processes (MDPs) are a popular model for performance analysis and optimization of stochastic systems. The parameters of stochastic behavior of MDPs are estimates from empirical observations of a system; their values are not…

Artificial Intelligence · Computer Science 2017-10-26 Dimitri Scheftelowitsch , Peter Buchholz , Vahid Hashemi , Holger Hermanns

Data integration is a notoriously difficult and heuristic-driven process, especially when ground-truth data are not readily available. This paper presents a measure of uncertainty by providing maximal and minimal ranges of a query outcome…

Databases · Computer Science 2023-09-12 Deniz Turkcapar , Sanjay Krishnan

Among the many ways of quantifying uncertainty in a regression setting, specifying the full quantile function is attractive, as quantiles are amenable to interpretation and evaluation. A model that predicts the true conditional quantiles…

Machine Learning · Computer Science 2021-12-10 Youngseog Chung , Willie Neiswanger , Ian Char , Jeff Schneider

Data-driven modeling is useful for reconstructing nonlinear dynamical systems when the underlying process is unknown or too expensive to compute. Having reliable uncertainty assessment of the forecast enables tools to be deployed to predict…

Methodology · Statistics 2023-11-01 Mengyang Gu , Yizi Lin , Victor Chang Lee , Diana Qiu

Numerous kinds of uncertainties may affect an economy, e.g. economic, political, and environmental ones. We model the aggregate impact by the uncertainties on an economy and its associated financial market by randomised mixtures of L\'evy…

General Finance · Quantitative Finance 2011-12-12 Andrea Macrina , Priyanka A. Parbhoo

Cumulative prospect theory (CPT) is the first theory for decision-making under uncertainty that combines full theoretical soundness and empirically realistic features [P.P. Wakker - Prospect theory: For risk and ambiguity, Page 2]. While…

Logic in Computer Science · Computer Science 2025-05-15 Thomas Brihaye , Krishnendu Chatterjee , Stefanie Mohr , Maximilian Weininger

We introduce a new class of Monte Carlo based approximations of expectations of random variables such that their laws are only available via certain discretizations. Sampling from the discretized versions of these laws can typically…

Computation · Statistics 2017-10-17 Dan Crisan , Pierre Del Moral , Jeremie Houssineau , Ajay Jasra

Machine learning models have emerged as a very effective strategy to sidestep time-consuming electronic-structure calculations, enabling accurate simulations of greater size, time scale and complexity. Given the interpolative nature of…