English
Related papers

Related papers: Parallelization of Markov chain generation and its…

200 papers

Recent developments in parallel Markov chain Monte Carlo (MCMC) algorithms allow us to run thousands of chains almost as quickly as a single chain, using hardware accelerators such as GPUs. While each chain still needs to forget its initial…

We present a new framework to derandomise certain Markov chain Monte Carlo (MCMC) algorithms. As in MCMC, we first reduce counting problems to sampling from a sequence of marginal distributions. For the latter task, we introduce a method…

Data Structures and Algorithms · Computer Science 2023-04-05 Weiming Feng , Heng Guo , Chunyang Wang , Jiaheng Wang , Yitong Yin

Kingman's coalescent is a widely used process to model sample genealogies in population genetics. Recently there have been studies on the inference of quantities related to the genealogy of additional individuals given a known sample. This…

Probability · Mathematics 2024-02-29 Linglong Yuan

Due to the escalating growth of big data sets in recent years, new Bayesian Markov chain Monte Carlo (MCMC) parallel computing methods have been developed. These methods partition large data sets by observations into subsets. However, for…

Methodology · Statistics 2019-01-21 Zheng Wei , Erin M. Conlon

Integration over non-negative integrands is a central problem in machine learning (e.g. for model averaging, (hyper-)parameter marginalisation, and computing posterior predictive distributions). Bayesian Quadrature is a probabilistic…

Machine Learning · Statistics 2018-12-05 Ed Wagstaff , Saad Hamid , Michael Osborne

The main purpose of this work is to study self-similar branching Markov chains. First we will construct such a process. Then we will establish certain Limit Theorems using the theory of self-similar Markov processes.

Probability · Mathematics 2008-01-24 Nathalie Krell

We consider parallel asynchronous Markov Chain Monte Carlo (MCMC) sampling for problems where we can leverage (stochastic) gradients to define continuous dynamics which explore the target distribution. We outline a solution strategy for…

Machine Learning · Statistics 2016-12-09 Jost Tobias Springenberg , Aaron Klein , Stefan Falkner , Frank Hutter

In this paper, first we give a sequential linear-time algorithm for the longest path problem in meshes. This algorithm can be considered as an improvement of [13]. Then based on this sequential algorithm, we present a constant-time parallel…

Data Structures and Algorithms · Computer Science 2012-01-24 Fatemeh Keshavarz-Kohjerdi , Alireza Bagheri

We present a polynomial-time Markov chain Monte Carlo algorithm for estimating the partition function of the antiferromagnetic Ising model on any line graph. The analysis of the algorithm exploits the "winding" technology devised by…

Data Structures and Algorithms · Computer Science 2021-03-17 Martin Dyer , Marc Heinrich , Mark Jerrum , Haiko Müller

Mixed packing and covering problems are problems that can be formulated as linear programs using only non-negative coefficients. Examples include multicommodity network flow, the Held-Karp lower bound on TSP, fractional relaxations of set…

Data Structures and Algorithms · Computer Science 2016-01-19 Neal E. Young

The time to converge to the steady state of a finite Markov chain can be greatly reduced by a lifting operation, which creates a new Markov chain on an expanded state space. For a class of quadratic objectives, we show an analogous behavior…

Machine Learning · Statistics 2017-03-14 Guilherme França , José Bento

In this work, we present an extension of Gaussian process (GP) models with sophisticated parallelization and GPU acceleration. The parallelization scheme arises naturally from the modular computational structure w.r.t. datapoints in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-10-21 Zhenwen Dai , Andreas Damianou , James Hensman , Neil Lawrence

In this paper we develop a general framework for constructing and analysing coupled Markov chain Monte Carlo samplers, allowing for both (possibly degenerate) diffusion and piecewise deterministic Markov processes. For many performance…

Probability · Mathematics 2018-06-29 N. Nuesken , G. A. Pavliotis

We initiate the study of graph algorithms in the streaming setting on massive distributed and parallel systems inspired by practical data processing systems. The objective is to design algorithms that can efficiently process evolving graphs…

Data Structures and Algorithms · Computer Science 2025-01-20 Artur Czumaj , Gopinath Mishra , Anish Mukherjee

Parallel parameterized complexity theory studies how fixed-parameter tractable (fpt) problems can be solved in parallel. Previous theoretical work focused on parallel algorithms that are very fast in principle, but did not take into account…

Data Structures and Algorithms · Computer Science 2019-02-21 Max Bannach , Malte Skambath , Till Tantau

Markov chain Monte Carlo (MCMC) methods provide consistent of integrals as the number of iterations goes to infinity. MCMC estimators are generally biased after any fixed number of iterations. We propose to remove this bias by using…

Methodology · Statistics 2019-07-18 Pierre E. Jacob , John O'Leary , Yves F. Atchadé

Meshless methods are used to solve partial differential equations by approximating differential operators at a node as a weighted sum of values at its neighbours. One of the algorithms for generating nodes suitable for meshless numerical…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-11 Jon Vehovar , Miha Rot , Matjaž Depolli , Gregor Kosec

We study the problem of generating connected random graphs with no self-loops or multiple edges and that, in addition, have a given degree sequence. The generation method we focus on is the edge-switching Markov-chain method, whose…

Discrete Mathematics · Computer Science 2011-07-01 Alexandre O. Stauffer , Valmir C. Barbosa

A rescaled Markov chain converges uniformly in probability to the solution of an ordinary differential equation, under carefully specified assumptions. The presentation is much simpler than those in the outside literature. The result may be…

Probability · Mathematics 2007-05-23 R. W. R. Darling

Filtering---estimating the state of a partially observable Markov process from a sequence of observations---is one of the most widely studied problems in control theory, AI, and computational statistics. Exact computation of the posterior…

Artificial Intelligence · Computer Science 2013-01-07 Bhaskara Marthi , Hanna Pasula , Stuart Russell , Yuval Peres