English
Related papers

Related papers: Theoretical guarantees for approximate sampling fr…

200 papers

Given a sequence of convex functions $f_0, f_1, \ldots, f_T$, we study the problem of sampling from the Gibbs distribution $\pi_t \propto e^{-\sum_{k=0}^tf_k}$ for each epoch $t$ in an online manner. Interest in this problem derives from…

Machine Learning · Computer Science 2019-12-06 Holden Lee , Oren Mangoubi , Nisheeth K. Vishnoi

In this work, we propose a first-order sampling method called the Metropolis-adjusted Preconditioned Langevin Algorithm for approximate sampling from a target distribution whose support is a proper convex subset of $\mathbb{R}^{d}$. Our…

Computation · Statistics 2025-02-27 Vishwak Srinivasan , Andre Wibisono , Ashia Wilson

This paper is concerned with sampling from probability distributions $\pi$ on $\mathbb{R}^d$ admitting a density of the form $\pi(x) \propto e^{-U(x)}$, where $U(x)=F(x)+G(Kx)$ with $K$ being a linear operator and $G$ being…

Optimization and Control · Mathematics 2024-05-28 Andreas Habring , Martin Holler , Thomas Pock

It is well known that if the power spectral density of a continuous time stationary stochastic process does not have a compact support, data sampled from that process at any uniform sampling rate leads to biased and inconsistent spectrum…

Statistics Theory · Mathematics 2010-06-09 Radhendushka Srivastava , Debasis Sengupta

We consider the problem of sampling from a density of the form $p(x) \propto \exp(-f(x)- g(x))$, where $f: \mathbb{R}^d \rightarrow \mathbb{R}$ is a smooth and strongly convex function and $g: \mathbb{R}^d \rightarrow \mathbb{R}$ is a…

Machine Learning · Statistics 2019-10-02 Wenlong Mou , Nicolas Flammarion , Martin J. Wainwright , Peter L. Bartlett

Motivated by the success of score-based generative models, a number of diffusion-based algorithms have recently been proposed for the problem of sampling from a probability measure whose unnormalized density can be accessed. Among them,…

Machine Learning · Computer Science 2026-04-01 Jakob Kellermann

This paper presents a new Metropolis-adjusted Langevin algorithm (MALA) that uses convex analysis to simulate efficiently from high-dimensional densities that are log-concave, a class of probability distributions that is widely used in…

Methodology · Statistics 2015-04-06 Marcelo Pereyra

Given samples from an unknown distribution $p$, is it possible to distinguish whether $p$ belongs to some class of distributions $\mathcal{C}$ versus $p$ being far from every distribution in $\mathcal{C}$? This fundamental question has…

Data Structures and Algorithms · Computer Science 2015-12-09 Jayadev Acharya , Constantinos Daskalakis , Gautam Kamath

In this paper we consider a new probability sampling methods based on Langevin diffusion dynamics to resolve the problem of existing Monte Carlo algorithms when draw samples from high dimensional target densities. We extent…

Machine Learning · Computer Science 2025-03-31 Z. Zarezadeh , N. Zarezadeh

Demand for high-performance, robust, and safe autonomous systems has grown substantially in recent years. These objectives motivate the desire for efficient safety-theoretic reasoning that can be embedded in core decision-making tasks such…

Robotics · Computer Science 2022-12-27 Kristoffer M. Frey , Ted J. Steiner , Jonathan P. How

Analogue to the well-known Langevin Monte Carlo method, in this article we provide a method to sample from a target distribution \(\pi\) by simulating a solution of a stochastic differential equation. Hereby, the stochastic differential…

Probability · Mathematics 2023-03-15 David Oechsler

A novel computational approach to log-concave density estimation is proposed. Previous approaches utilize the piecewise-affine parametrization of the density induced by the given sample set. The number of parameters as well as non-smooth…

Computation · Statistics 2019-02-21 Fabian Rathke , Christoph Schnörr

Score based approaches to sampling have shown much success as a generative algorithm to produce new samples from a target density given a pool of initial samples. In this work, we consider if we have no initial samples from the target…

Machine Learning · Statistics 2022-12-08 Curtis McDonald , Andrew Barron

This work considers the problem of sampling from a probability distribution known up to a normalization constant while satisfying a set of statistical constraints specified by the expected values of general nonlinear functions. This problem…

Machine Learning · Statistics 2025-01-08 Luiz F. O. Chamon , Mohammad Reza Karimi , Anna Korba

Log-concave sampling has witnessed remarkable algorithmic advances in recent years, but the corresponding problem of proving lower bounds for this task has remained elusive, with lower bounds previously known only in dimension one. In this…

Statistics Theory · Mathematics 2023-10-31 Sinho Chewi , Jaume de Dios Pont , Jerry Li , Chen Lu , Shyam Narayanan

We study the problem of estimating multivariate log-concave probability density functions. We prove the first sample complexity upper bound for learning log-concave densities on $\mathbb{R}^d$, for all $d \geq 1$. Prior to our work, no…

Machine Learning · Computer Science 2017-06-07 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We study the underdamped Langevin diffusion when the log of the target distribution is smooth and strongly concave. We present a MCMC algorithm based on its discretization and show that it achieves $\varepsilon$ error (in 2-Wasserstein…

Machine Learning · Statistics 2018-01-30 Xiang Cheng , Niladri S. Chatterji , Peter L. Bartlett , Michael I. Jordan

Understanding the complexity of sampling from a strongly log-concave and log-smooth distribution $\pi$ on $\mathbb{R}^d$ to high accuracy is a fundamental problem, both from a practical and theoretical standpoint. In practice, high-accuracy…

Statistics Theory · Mathematics 2023-02-22 Jason M. Altschuler , Sinho Chewi

Sampling from multimodal distributions is a challenging task in scientific computing. When a distribution has an exact symmetry between the modes, direct jumps among them can accelerate the samplings significantly. However, the…

Numerical Analysis · Mathematics 2024-01-05 Lexing Ying

Sampling from constrained statistical distributions is a fundamental task in various fields including Bayesian statistics, computational chemistry, and statistical physics. This article considers the cases where the constrained distribution…

Machine Learning · Computer Science 2025-10-28 Kijung Jeon , Michael Muehlebach , Molei Tao
‹ Prev 1 4 5 6 7 8 10 Next ›