English
Related papers

Related papers: On embedded hidden Markov models and particle Mark…

200 papers

We introduce Preconditioned Monte Carlo (PMC), a novel Monte Carlo method for Bayesian inference that facilitates efficient sampling of probability distributions with non-trivial geometry. PMC utilises a Normalising Flow (NF) in order to…

Instrumentation and Methods for Astrophysics · Physics 2022-08-24 Minas Karamanis , Florian Beutler , John A. Peacock , David Nabergoj , Uros Seljak

The Hidden Quantum Markov Model (HQMM) has significant potential for analyzing time-series data and studying stochastic processes in the quantum domain as an upgrading option with potential advantages over classical Markov models. In this…

Quantum Physics · Physics 2024-11-01 Xiao-Yu Li , Qin-Sheng Zhu , Yong Hu , Hao Wu , Guo-Wu Yang , Lian-Hui Yu , Geng Chen

We propose a new computationally efficient sampling scheme for Bayesian inference involving high dimensional probability distributions. Our method maps the original parameter space into a low-dimensional latent space, explores the latent…

Computation · Statistics 2019-10-15 Babak Shahbaba , Luis Martinez Lomeli , Tian Chen , Shiwei Lan

An irreversible Markov-chain Monte Carlo (MCMC) algorithm with skew detailed balance conditions originally proposed by Turitsyn et al. is extended to general discrete systems on the basis of the Metropolis-Hastings scheme. To evaluate the…

Statistical Mechanics · Physics 2016-04-21 Yuji Sakai , Koji Hukushima

In this work, we propose a new flow-matching Markov chain Monte Carlo (FM-MCMC) algorithm for estimating the orbital parameters of exoplanetary systems, especially for those only one exoplanet is involved. Compared to traditional methods…

Earth and Planetary Astrophysics · Physics 2025-11-10 Bo Liang , Hanlin Song , Chang Liu , Tianyu Zhao , Yuxiang Xu , Zihao Xiao , Manjia Liang , Minghui Du , Wei-Liang Qian , Li-e Qiang , Peng Xu , Ziren Luo

MCMC methods (Monte Carlo Markov Chain) are a class of methods used to perform simulations per a probability distribution $P$. These methods are often used when we have difficulties to directly sample per a given probability distribution…

Methodology · Statistics 2014-01-21 Papa Ngom , Badiassiatta Don Bosco Diatta

Performing Bayesian inference via Markov chain Monte Carlo (MCMC) can be exceedingly expensive when posterior evaluations invoke the evaluation of a computationally expensive model, such as a system of partial differential equations. In…

Computation · Statistics 2017-12-27 Patrick Conrad , Andrew Davis , Youssef Marzouk , Natesh Pillai , Aaron Smith

There is a lack of methodological results to design efficient Markov chain Monte Carlo (MCMC) algorithms for statistical models with discrete-valued high-dimensional parameters. Motivated by this consideration, we propose a simple framework…

Computation · Statistics 2017-11-21 Giacomo Zanella

The filtering distribution in hidden Markov models evolves according to the law of a mean-field model in state-observation space. The ensemble Kalman filter (EnKF) approximates this mean-field model with an ensemble of interacting…

Machine Learning · Statistics 2025-12-25 Eviatar Bach , Ricardo Baptista , Edoardo Calvello , Bohan Chen , Andrew Stuart

State-of-the-art methods for Bayesian inference in state-space models are (a) conditional sequential Monte Carlo (CSMC) algorithms; (b) sophisticated 'classical' MCMC algorithms like MALA, or mGRAD from Titsias and Papaspiliopoulos (2018,…

Computation · Statistics 2024-01-29 Adrien Corenflos , Axel Finke

We introduce the energy-stepping Monte Carlo (ESMC) method, a Markov chain Monte Carlo (MCMC) algorithm based on the conventional dynamical interpretation of the proposal stage but employing an energy-stepping integrator. The…

Mathematical Physics · Physics 2023-12-13 Ignacio Romero , Michael Ortiz

Markov Chain Monte Carlo (MCMC) is a powerful method for drawing samples from non-standard probability distributions and is utilized across many fields and disciplines. Methods such as Metropolis-Adjusted Langevin (MALA) and Hamiltonian…

Computation · Statistics 2024-10-28 Lee Devlin , Paul Horridge , Peter L. Green , Simon Maskell

We propose a sequential Markov chain Monte Carlo (SMCMC) algorithm to sample from a sequence of probability distributions, corresponding to posterior distributions at different times in on-line applications. SMCMC proceeds as in usual MCMC…

Statistics Theory · Mathematics 2013-08-20 Yun Yang , David B. Dunson

Markov Chain Monte Carlo (MCMC) is a class of algorithms to sample complex and high-dimensional probability distributions. The Metropolis-Hastings (MH) algorithm, the workhorse of MCMC, provides a simple recipe to construct reversible…

We propose a class of discrete state sampling algorithms based on Nesterov's accelerated gradient method, which extends the classical Metropolis-Hastings (MH) algorithm. The evolution of the discrete states probability distribution governed…

Optimization and Control · Mathematics 2026-02-10 Bohan Zhou , Shu Liu , Xinzhe Zuo , Wuchen Li

Markov chain Monte Carlo (MCMC) methods are foundational algorithms for Bayesian inference and probabilistic modeling. However, most MCMC algorithms are inherently sequential and their time complexity scales linearly with the sequence…

Computation · Statistics 2025-12-03 David M. Zoltowski , Skyler Wu , Xavier Gonzalez , Leo Kozachkov , Scott W. Linderman

The standard technique for measurement of random uncertainties of star formation histories (SFHs) is the bootstrap Monte Carlo, in which the color-magnitude diagram (CMD) is repeatedly resampled. The variation in SFHs measured from the…

Instrumentation and Methods for Astrophysics · Physics 2015-06-16 Andrew E. Dolphin

Being the most classical generative model for serial data, state-space models (SSM) are fundamental in AI and statistical machine learning. In SSM, any form of parameter learning or latent state inference typically involves the computation…

Machine Learning · Statistics 2024-07-04 Alessandro Mastrototaro , Jimmy Olsson

Proximal Markov Chain Monte Carlo is a novel construct that lies at the intersection of Bayesian computation and convex optimization, which helped popularize the use of nondifferentiable priors in Bayesian statistics. Existing formulations…

Computation · Statistics 2023-01-24 Qiang Heng , Hua Zhou , Eric C. Chi

Probabilistic programming languages can simplify the development of machine learning techniques, but only if inference is sufficiently scalable. Unfortunately, Bayesian parameter estimation for highly coupled models such as regressions and…

Machine Learning · Statistics 2015-03-10 Yutian Chen , Vikash Mansinghka , Zoubin Ghahramani