English
Related papers

Related papers: Improved Bound for Mixing Time of Parallel Temperi…

200 papers

Improved EM strategies, based on the idea of efficient data augmentation (Meng and van Dyk 1997, 1998), are presented for ML estimation of mixture proportions. The resulting algorithms inherit the simplicity, ease of implementation, and…

Computation · Statistics 2010-02-22 Yaming Yu

Detectability of failures of linear programming (LP) decoding and the potential for improvement by adding new constraints motivate the use of an adaptive approach in selecting the constraints for the underlying LP problem. In this paper, we…

Information Theory · Computer Science 2007-07-13 Mohammad H. Taghavi , Paul H. Siegel

Sequential Monte Carlo (SMC) methods, also known as particle filters, constitute a class of algorithms used to approximate expectations with respect to a sequence of probability distributions as well as the normalising constants of those…

Computation · Statistics 2026-01-14 Axel Finke , Arnaud Doucet , Adam M. Johansen

In this paper, we propose a new upper bound on the error probability performance of maximum-likelihood (ML) detection. The proposed approach provides a much tighter upper bound when compared to the traditionally used union bound, especially…

Information Theory · Computer Science 2022-08-01 Tian Han , Rajitha Senanayake , Peter Smith , Jamie Evans

Understanding the local structure of a graph provides valuable insights about the underlying phenomena from which the graph has originated. Sampling and examining k-subgraphs is a widely used approach to understand the local structure of a…

Data Structures and Algorithms · Computer Science 2020-01-28 Ryuta Matsuno , Aristides Gionis

In this work, we extend the hybrid Chernoff tau-leap method to the multilevel Monte Carlo (MLMC) setting. Inspired by the work of Anderson and Higham on the tau-leap MLMC method with uniform time steps, we develop a novel algorithm that is…

Numerical Analysis · Mathematics 2014-11-24 Alvaro Moraes , Raul Tempone , Pedro Vilanova

Multicanonical MCMC (Multicanonical Markov Chain Monte Carlo; Multicanonical Monte Carlo) is discussed as a method of rare event sampling. Starting from a review of the generic framework of importance sampling, multicanonical MCMC is…

Statistical Mechanics · Physics 2014-10-20 Yukito Iba , Nen Saito , Akimasa Kitajima

A parallel splitting method is proposed for solving systems of coupled monotone inclusions in Hilbert spaces. Convergence is established for a wide class of coupling schemes. Unlike classical alternating algorithms, which are limited to two…

Optimization and Control · Mathematics 2009-02-26 H. Attouch , L. M. Briceno-Arias , P. L. Combettes

Markov chain Monte Carlo (MCMC) algorithms are simple and extremely powerful techniques to sample from almost arbitrary distributions. The flaw in practice is that it can take a large and/or unknown amount of time to converge to the…

Machine Learning · Computer Science 2014-11-13 Xianghang Liu , Justin Domke

Fast and accurate sampling method is in high demand, in order to bridge the large gaps between molecular dynamic simulations and experimental observations. Recently, integrated tempering enhanced sampling method (ITS) has been proposed and…

Numerical Analysis · Mathematics 2018-06-22 Zhiyi You , Liying Li , Jianfeng Lu , Hao Ge

In this paper, we present a generalisation of the Multilevel Monte Carlo (MLMC) method to a setting where the level parameter is a continuous variable. This Continuous Level Monte Carlo (CLMC) estimator provides a natural framework in PDE…

Numerical Analysis · Mathematics 2018-02-22 Gianluca Detommaso , Tim Dodwell , Rob Scheichl

Sampling-based model predictive control (MPC) algorithms, such as model predictive path integral (MPPI), enable approximate, gradient-free solutions to optimal control problems by drawing samples from a proposal distribution, evaluating…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Markus Walker , Marcel Reith-Braun , Daniel Frisch , Uwe D. Hanebeck

We show how to combine Fourier analysis with coupling arguments to bound the mixing times of a variety of Markov chains. The mixing time is the number of steps a Markov chain takes to approach its equilibrium distribution. One application…

Probability · Mathematics 2012-06-19 David Bruce Wilson

Masked diffusion models (MDMs) offer a compelling alternative to autoregressive models (ARMs) for discrete text generation because they enable parallel token sampling, rather than sequential, left-to-right generation. This means potentially…

Machine Learning · Computer Science 2025-10-28 Iskander Azangulov , Teodora Pandeva , Niranjani Prasad , Javier Zazo , Sushrut Karmalkar

The spectral gap of a Markov chain can be bounded by the spectral gaps of constituent "restriction" chains and a "projection" chain, and the strength of such a bound is the content of various decomposition theorems. In this paper, we…

Data Structures and Algorithms · Computer Science 2019-10-14 Sarah Miracle , Amanda Pascoe Streib , Noah Streib

Informed Markov chain Monte Carlo (MCMC) methods have been proposed as scalable solutions to Bayesian posterior computation on high-dimensional discrete state spaces, but theoretical results about their convergence behavior in general…

Computation · Statistics 2022-02-01 Quan Zhou , Aaron Smith

Integer Linear Programming (ILP) serves as a versatile framework for modeling a wide range of combinatorial optimization problems, typically addressed by sophisticated exact solvers or heuristics. While learning-based approaches have…

Machine Learning · Computer Science 2026-05-29 Kyuil Sim , Sanghyeok Choi , Jinkyoo Park

Parallel tempering, or replica exchange, is a popular method for simulating complex systems. The idea is to run parallel simulations at different temperatures, and at a given swap rate exchange configurations between the parallel…

Probability · Mathematics 2016-04-20 J. D. Doll , Paul Dupuis , Pierre Nyquist

We propose model predictive funnel control, a novel model predictive control (MPC) scheme building upon recent results in funnel control. The latter is a high-gain feedback methodology that achieves evolution of the measured output within…

Optimization and Control · Mathematics 2025-05-27 Jens Göbel , Dario Dennstädt , Lukas Lanza , Karl Worthmann , Thomas Berger , Tobias Damm

We apply a recently developed adaptive algorithm that systematically improves the efficiency of parallel tempering or replica exchange methods in the numerical simulation of small proteins. Feedback iterations allow us to identify an…

Quantitative Methods · Quantitative Biology 2007-05-23 Simon Trebst , Matthias Troyer , Ulrich H. E. Hansmann