English
Related papers

Related papers: Novel Matrix Hit and Run for Sampling Polytopes an…

200 papers

A new Monte Carlo algorithm for phase-space sampling, named (MC)**3, is presented. It is based on Markov Chain Monte Carlo techniques but at the same time incorporates prior knowledge about the target distribution in the form of suitable…

High Energy Physics - Phenomenology · Physics 2015-06-12 Kevin Kroeninger , Steffen Schumann , Benjamin Willenberg

The Metropolis-Hastings (MH) algorithm is one of the most widely used Markov Chain Monte Carlo schemes for generating samples from Bayesian posterior distributions. The algorithm is asymptotically exact, flexible and easy to implement.…

Methodology · Statistics 2026-03-10 Estevão Prado , Christopher Nemeth , Chris Sherlock

Piecewise deterministic Markov processes (PDMPs) are a class of continuous-time Markov processes that were recently used to develop a new class of Markov chain Monte Carlo algorithms. However, the implementation of the processes is…

Computation · Statistics 2024-08-08 Charly Andral , Kengo Kamatani

The uniform sampling of convex polytopes is an interesting computational problem with many applications in inference from linear constraints, but the performances of sampling algorithms can be affected by ill-conditioning. This is the case…

Statistical Mechanics · Physics 2014-10-09 Daniele De Martino , Matteo Mori , Valerio Parisi

This paper considers the problem of completing a rating matrix based on sub-sampled matrix entries as well as observed social graphs and hypergraphs. We show that there exists a \emph{sharp threshold} on the sample probability for the task…

Machine Learning · Computer Science 2026-05-29 Zhongtian Ma , Qiaosheng Zhang , Zhen Wang

We give a simple, multiplicative-weight update algorithm for learning undirected graphical models or Markov random fields (MRFs). The approach is new, and for the well-studied case of Ising models or Boltzmann machines, we obtain an…

Machine Learning · Computer Science 2017-06-21 Adam Klivans , Raghu Meka

We present ParaDRAM, a high-performance Parallel Delayed-Rejection Adaptive Metropolis Markov Chain Monte Carlo software for optimization, sampling, and integration of mathematical objective functions encountered in scientific inference.…

Computational Engineering, Finance, and Science · Computer Science 2020-08-24 Amir Shahmoradi , Fatemeh Bagheri

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

Computation · Statistics 2021-08-17 Yves Atchadé , Liwei Wang

We propose the Hit-and-Run algorithm for planning and sampling problems in non-convex spaces. For sampling, we show the first analysis of the Hit-and-Run algorithm in non-convex spaces and show that it mixes fast as long as certain…

Computation · Statistics 2016-10-28 Yasin Abbasi-Yadkori , Peter L. Bartlett , Victor Gabillon , Alan Malek

Along with the fast evolution of deep neural networks, the hardware system is also developing rapidly. As a promising solution achieving high scalability and low manufacturing cost, multi-accelerator systems widely exist in data centers,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-25 Guan Shen , Jieru Zhao , Zeke Wang , Zhe Lin , Wenchao Ding , Chentao Wu , Quan Chen , Minyi Guo

Hamiltonian Monte Carlo (HMC) is a popular Markov Chain Monte Carlo (MCMC) algorithm to sample from an unnormalized probability distribution. A leapfrog integrator is commonly used to implement HMC in practice, but its performance can be…

Computation · Statistics 2021-10-28 Marcel Hirt , Michalis K. Titsias , Petros Dellaportas

We introduce the Hamming Ball Sampler, a novel Markov Chain Monte Carlo algorithm, for efficient inference in statistical models involving high-dimensional discrete state spaces. The sampling scheme uses an auxiliary variable construction…

Methodology · Statistics 2015-05-05 Michalis K. Titsias , Christopher Yau

Manifold Markov chain Monte Carlo algorithms have been introduced to sample more effectively from challenging target densities exhibiting multiple modes or strong correlations. Such algorithms exploit the local geometry of the parameter…

Machine Learning · Statistics 2021-05-11 Theodore Papamarkou , Alexey Lindo , Eric B. Ford

We present a framework for learning to guide geometric task and motion planning (GTAMP). GTAMP is a subclass of task and motion planning in which the goal is to move multiple objects to target regions among movable obstacles. A standard…

Robotics · Computer Science 2022-03-10 Beomjoon Kim , Luke Shimanuki , Leslie Pack Kaelbling , Tomás Lozano-Pérez

Determinantal point processes (DPPs) are distributions over sets of items that model diversity using kernels. Their applications in machine learning include summary extraction and recommendation systems. Yet, the cost of sampling from a DPP…

Machine Learning · Statistics 2022-03-22 Guillaume Gautier , Rémi Bardenet , Michal Valko

Markov chain Monte Carlo methods have become standard tools in statistics to sample from complex probability measures. Many available techniques rely on discrete-time reversible Markov chains whose transition kernels build up over the…

Methodology · Statistics 2017-02-21 Alexandre Bouchard-Côté , Sebastian J. Vollmer , Arnaud Doucet

Various Markov chain Monte Carlo (MCMC) methods are studied to improve upon random walk Metropolis sampling, for simulation from complex distributions. Examples include Metropolis-adjusted Langevin algorithms, Hamiltonian Monte Carlo, and…

Computation · Statistics 2020-05-19 Zexi Song , Zhiqiang Tan

We propose new Markov Chain Monte Carlo algorithms to sample probability distributions on submanifolds, which generalize previous methods by allowing the use of set-valued maps in the proposal step of the MCMC algorithms. The motivation for…

Numerical Analysis · Mathematics 2021-10-07 Tony Lelièvre , Gabriel Stoltz , Wei Zhang

In this work we present a non-reversible, tuning- and rejection-free Markov chain Monte Carlo which naturally fits in the framework of hit-and-run. The sampler only requires access to the gradient of the log-density function, hence the…

Computation · Statistics 2018-10-31 Amir Sepehri , Jelena Markovic

We develop an efficient algorithm for sampling the eigenvalues of random matrices distributed according to the Haar measure over the orthogonal or unitary group. Our technique samples directly a factorization of the Hessenberg form of such…

Numerical Analysis · Mathematics 2021-02-25 Massimiliano Fasi , Leonardo Robol