English
Related papers

Related papers: Deterministic Gibbs Sampling via Ordinary Differen…

200 papers

The paper proposes a Riemannian Manifold Hamiltonian Monte Carlo sampler to resolve the shortcomings of existing Monte Carlo algorithms when sampling from target densities that may be high dimensional and exhibit strong correlations. The…

Computation · Statistics 2019-12-18 Mark Girolami , Ben Calderhead , Siu A. Chin

In this paper, an approach to estimating a nonlinear deterministic model is presented. We introduce a stochastic model with extremely small variances so that the deterministic and stochastic models are essentially indistinguishable from…

Methodology · Statistics 2015-11-13 Spyridon J. Hatjispyros , Stephen G. Walker

Optimal experimental design (OED) aims to choose the observations in an experiment to be as informative as possible, according to certain statistical criteria. In the linear case (when the observations depend linearly on the unknown…

Numerical Analysis · Mathematics 2026-02-25 Ruhui Jin , Martin Guerra , Qin Li , Stephen Wright

Hamiltonian Monte Carlo and underdamped Langevin Monte Carlo are state-of-the-art methods for taking samples from high-dimensional distributions with a differentiable density function. To generate samples, they numerically integrate…

Computation · Statistics 2025-05-20 Jakob Robnik , Reuben Cohn-Gordon , Uroš Seljak

The problem of sampling constrained continuous distributions has frequently appeared in many machine/statistical learning models. Many Monte Carlo Markov Chain (MCMC) sampling methods have been adapted to handle different types of…

Computation · Statistics 2023-02-21 Shiwei Lan , Lulu Kang

A deterministic-stochastic coupling scheme is developed for simulating rarefied gas flows, where the key process is the alternative solving of the macroscopic synthetic equations [Su et al., J. Comput. Phys., 407 (2020) 109245] and the…

Computational Physics · Physics 2024-06-26 Liyan Luo , Qi Li , Fei Fei , Lei Wu

Importance sampling is a technique that is commonly used to speed up Monte Carlo simulation of rare events. However, little is known regarding the design of efficient importance sampling algorithms in the context of queueing networks. The…

Probability · Mathematics 2009-09-29 Paul Dupuis , Ali Devin Sezer , Hui Wang

In this paper, we investigate combining blocking and collapsing -- two widely used strategies for improving the accuracy of Gibbs sampling -- in the context of probabilistic graphical models (PGMs). We show that combining them is not…

Artificial Intelligence · Computer Science 2013-09-27 Deepak Venugopal , Vibhav Gogate

Many segmentation tasks, such as medical image segmentation or future state prediction, are inherently ambiguous, meaning that multiple predictions are equally correct. Current methods typically rely on generative models to capture this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Sebastian Gerard , Josephine Sullivan

Monte Carlo (MC) sampling methods are widely applied in Bayesian inference, system simulation and optimization problems. The Markov Chain Monte Carlo (MCMC) algorithms are a well-known class of MC methods which generate a Markov chain with…

Methodology · Statistics 2024-06-21 Luca Martino , Victor Elvira

Robust Markov Decision Processes (MDPs) are receiving much attention in learning a robust policy which is less sensitive to environment changes. There are an increasing number of works analyzing sample-efficiency of robust MDPs. However,…

Machine Learning · Statistics 2023-09-13 Wenhao Yang , Han Wang , Tadashi Kozuno , Scott M. Jordan , Zhihua Zhang

We revisit two basic Direct Simulation Monte Carlo Methods to model aggregation kinetics and extend them for aggregation processes with collisional fragmentation (shattering). We test the performance and accuracy of the extended methods and…

Numerical Analysis · Mathematics 2022-07-27 A. Kalinov , A. I. Osinsky , S. A. Matveev , W. Otieno , N. V. Brilliantov

In this work we demonstrate that SVD-based model reduction techniques known for ordinary differential equations, such as the proper orthogonal decomposition, can be extended to stochastic differential equations in order to reduce the…

Numerical Analysis · Mathematics 2024-02-01 Tomasz M. Tyranowski

We propose a new sampling method, the thermostat-assisted continuously-tempered Hamiltonian Monte Carlo, for Bayesian learning on large datasets and multimodal distributions. It simulates the Nos\'e-Hoover dynamics of a…

Machine Learning · Statistics 2019-01-29 Rui Luo , Jianhong Wang , Yaodong Yang , Zhanxing Zhu , Jun Wang

Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, but instead learning them via machine learning. However, the…

1. Bayesian inference is difficult because it often requires time consuming tuning of samplers. Differential evolution Monte-Carlo (DEMC) is a self-tuning multi-chain sampling approach which requires minimal input from the operator as…

Methodology · Statistics 2022-09-22 Willem Bonnaffé

Monte Carlo simulations are widely used to simulate complex molecular systems, but standard approaches suffer from metastability. Lately, the use of non-local proposal updates in a collective-variable (CV) space has been proposed in several…

Statistical Mechanics · Physics 2026-04-20 Christoph Schönle , Davide Carbone , Marylou Gabrié , Tony Lelièvre , Gabriel Stoltz

Adaptive Monte Carlo schemes developed over the last years usually seek to ensure ergodicity of the sampling process in line with MCMC tradition. This poses constraints on what is possible in terms of adaptation. In the general case…

Machine Learning · Statistics 2015-07-22 Ingmar Schuster

We describe and analyze some Monte Carlo methods for manifolds in Euclidean space defined by equality and inequality constraints. First, we give an MCMC sampler for probability distributions defined by un-normalized densities on such…

Numerical Analysis · Mathematics 2017-09-21 Emilio Zappa , Miranda Holmes-Cerfon , Jonathan Goodman

We develop a real-time Full Configuration Interaction Quantum Monte Carlo approach for the modeling of driven-dissipative open quantum systems. The method enables stochastic sampling of the Liouville-von-Neumann time evolution of the…

Quantum Physics · Physics 2018-06-06 Alexandra Nagy , Vincenzo Savona