English
Related papers

Related papers: Faster Sampling from Log-Concave Densities over Po…

200 papers

We consider the problem of constructing exact goodness-of-fit tests for discrete exponential family models. This classical problem remains practically unsolved for many types of structured or sparse data, as it rests on a computationally…

Machine Learning · Statistics 2025-12-31 Ivan Gvozdanović , Sonja Petrović

We provide a new convergence analysis of stochastic gradient Langevin dynamics (SGLD) for sampling from a class of distributions that can be non-log-concave. At the core of our approach is a novel conductance analysis of SGLD using an…

Machine Learning · Computer Science 2021-02-24 Difan Zou , Pan Xu , Quanquan Gu

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

Computation · Statistics 2021-08-17 Yves Atchadé , Liwei Wang

We present a highly efficient proximal Markov chain Monte Carlo methodology to perform Bayesian computation in imaging problems. Similarly to previous proximal Monte Carlo approaches, the proposed method is derived from an approximation of…

Computation · Statistics 2020-03-20 Luis Vargas , Marcelo Pereyra , Konstantinos C. Zygalakis

Can linear systems be solved faster than matrix multiplication? While there has been remarkable progress for the special cases of graph structured linear systems, in the general setting, the bit complexity of solving an $n \times n$ linear…

Data Structures and Algorithms · Computer Science 2021-01-08 Richard Peng , Santosh Vempala

Markov Chain Monte Carlo (MCMC) techniques have long been studied in computational geometry subjects whereabouts the problems to be studied are complex geometric objects which by their nature require optimized techniques to be deployed or…

Computational Geometry · Computer Science 2022-06-24 Christos Karras , Aristeidis Karras

We introduce new Gaussian proposals to improve the efficiency of the standard Hastings-Metropolis algorithm in Markov chain Monte Carlo (MCMC) methods, used for the sampling from a target distribution in large dimension $d$. The improved…

Numerical Analysis · Mathematics 2016-11-28 Alain Durmus , Gareth O. Roberts , Gilles Vilmart , Konstantinos C. Zygalakis

In this work, we propose a first-order sampling method called the Metropolis-adjusted Preconditioned Langevin Algorithm for approximate sampling from a target distribution whose support is a proper convex subset of $\mathbb{R}^{d}$. Our…

Computation · Statistics 2025-02-27 Vishwak Srinivasan , Andre Wibisono , Ashia Wilson

We study the problem of computing the maximum likelihood estimator (MLE) of multivariate log-concave densities. Our main result is the first computationally efficient algorithm for this problem. In more detail, we give an algorithm that, on…

Data Structures and Algorithms · Computer Science 2018-12-14 Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart

We study the problem of approximate sampling from non-log-concave distributions, e.g., Gaussian mixtures, which is often challenging even in low dimensions due to their multimodality. We focus on performing this task via Markov chain Monte…

Machine Learning · Statistics 2024-05-30 Tim Tsz-Kit Lau , Han Liu , Thomas Pock

Formulated is a new systematic method for obtaining higher order corrections in numerical simulation of stochastic differential equations (SDEs), i.e., Langevin equations. Random walk step algorithms within a given order of finite $\Delta…

High Energy Physics - Lattice · Physics 2009-10-28 H. Nakajima , S. Furui

In large-data applications, such as the inference process of diffusion models, it is desirable to design sampling algorithms with a high degree of parallelization. In this work, we study the adaptive complexity of sampling, which is the…

Data Structures and Algorithms · Computer Science 2025-05-21 Huanjian Zhou , Baoxiang Wang , Masashi Sugiyama

This paper proposes a new sampling scheme based on Langevin dynamics that is applicable within pseudo-marginal and particle Markov chain Monte Carlo algorithms. We investigate this algorithm's theoretical properties under standard…

Methodology · Statistics 2016-05-30 Christopher Nemeth , Chris Sherlock , Paul Fearnhead

We investigate the problem of best-policy identification in discounted Markov Decision Processes (MDPs) when the learner has access to a generative model. The objective is to devise a learning algorithm returning the best policy as early as…

Machine Learning · Statistics 2021-05-11 Aymen Al Marjani , Alexandre Proutiere

We propose a computationally efficient random walk on a convex body which rapidly mixes and closely tracks a time-varying log-concave distribution. We develop general theoretical guarantees on the required number of steps; this number can…

Machine Learning · Statistics 2013-09-25 Hariharan Narayanan , Alexander Rakhlin

I show how Markov chain sampling with the Metropolis-Hastings algorithm can be modified so as to take bigger steps when the distribution being sampled from has the characteristic that its density can be quickly recomputed for a new point if…

Statistics Theory · Mathematics 2007-06-13 Radford M. Neal

Sampling from various kinds of distributions is an issue of paramount importance in statistics since it is often the key ingredient for constructing estimators, test procedures or confidence intervals. In many situations, the exact sampling…

Computation · Statistics 2016-12-06 Arnak S. Dalalyan

We study the problem of sampling from a distribution $\mu$ with density $\propto e^{-V}$ for some potential function $V:\mathbb R^d\to \mathbb R$ with query access to $V$ and $\nabla V$. We start with the following standard assumptions: (1)…

Data Structures and Algorithms · Computer Science 2026-02-10 Yuchen He , Zhehan Lei , Jianan Shao , Chihao Zhang

We study the mixing time of the Metropolis-adjusted Langevin algorithm (MALA) for sampling from a log-smooth and strongly log-concave distribution. We establish its optimal minimax mixing time under a warm start. Our main contribution is…

Machine Learning · Statistics 2022-10-04 Keru Wu , Scott Schmidler , Yuansi Chen

We revisit the problem of sampling from a target distribution that has a smooth strongly log-concave density everywhere in $\mathbb R^p$. In this context, if no additional density information is available, the randomized midpoint…

Statistics Theory · Mathematics 2023-06-19 Lu Yu , Avetik Karagulyan , Arnak Dalalyan