English
Related papers

Related papers: Speeding Up Nonsmooth Bayesian MCMC Sampling via I…

200 papers

We consider the problem of sampling distributions stemming from non-convex potentials with Unadjusted Langevin Algorithm (ULA). We prove the stability of the discrete-time ULA to drift approximations under the assumption that the potential…

Machine Learning · Statistics 2025-09-01 Marien Renaud , Valentin De Bortoli , Arthur Leclaire , Nicolas Papadakis

In order to solve tasks like uncertainty quantification or hypothesis tests in Bayesian imaging inverse problems, we often have to draw samples from the arising posterior distribution. For the usually log-concave but high-dimensional…

Computation · Statistics 2025-01-23 Matthias J. Ehrhardt , Lorenz Kuger , Carola-Bibiane Schönlieb

We propose efficient Langevin Monte Carlo algorithms for sampling distributions with nonsmooth convex composite potentials, which is the sum of a continuously differentiable function and a possibly nonsmooth function. We devise such…

Machine Learning · Statistics 2022-07-12 Tim Tsz-Kit Lau , Han Liu

We present a significant advancement in the field of Langevin Monte Carlo (LMC) methods by introducing the Inexact Proximal Langevin Algorithm (IPLA). This novel algorithm broadens the scope of problems that LMC can effectively address…

Machine Learning · Statistics 2024-12-16 Matej Benko , Iwona Chlebicka , Jørgen Endal , Błażej Miasojedow

Purpose: The Unadjusted Langevin Algorithm (ULA) in combination with diffusion models can generate high quality MRI reconstructions with uncertainty estimation from highly undersampled k-space data. However, sampling methods such as…

Medical Physics · Physics 2026-05-26 Moritz Blumenthal , Tina Holliber , Jonathan I. Tamir , Martin Uecker

Discretization of continuous-time diffusion processes is a widely recognized method for sampling. However, the canonical Euler Maruyama discretization of the Langevin diffusion process, referred as Unadjusted Langevin Algorithm (ULA),…

Computation · Statistics 2021-07-28 Dao Nguyen , Xin Dang , Yixin Chen

In this paper, we analyse a proximal method based on the idea of forward-backward splitting for sampling from distributions with densities that are not necessarily smooth. In particular, we study the non-asymptotic properties of the…

Numerical Analysis · Mathematics 2022-01-25 Armin Eftekhari , Luis Vargas , Konstantinos Zygalakis

This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed…

We propose a new algorithm---Stochastic Proximal Langevin Algorithm (SPLA)---for sampling from a log concave distribution. Our method is a generalization of the Langevin algorithm to potentials expressed as the sum of one stochastic smooth…

Machine Learning · Statistics 2020-06-17 Adil Salim , Dmitry Kovalev , Peter Richtárik

In this work, we examine sampling problems with non-smooth potentials. We propose a novel Markov chain Monte Carlo algorithm for sampling from non-smooth potentials. We provide a non-asymptotical analysis of our algorithm and establish a…

Machine Learning · Computer Science 2022-02-11 Jiaming Liang , Yongxin Chen

Posterior sampling has been shown to be a powerful Bayesian approach for solving imaging inverse problems. The recent plug-and-play unadjusted Langevin algorithm (PnP-ULA) has emerged as a promising method for Monte Carlo sampling and…

Machine Learning · Statistics 2025-08-13 Marien Renaud , Jiaming Liu , Valentin de Bortoli , Andrés Almansa , Ulugbek S. Kamilov

This paper proposes a new inexact manifold proximal linear (IManPL) algorithm for solving nonsmooth, nonconvex composite optimization problems over an embedded submanifold. At each iteration, IManPL solves a convex subproblem inexactly,…

Optimization and Control · Mathematics 2025-11-11 Zhong Zheng , Xin Yu , Shiqian Ma , Lingzhou Xue

This paper concerns a class of DC composite optimization problems which, as an extension of convex composite optimization problems and DC programs with nonsmooth components, often arises in robust factorization models of low-rank matrix…

Optimization and Control · Mathematics 2025-10-08 Ting Tao , Ruyu Liu , Shaohua Pan

This paper proposes and establishes the iteration-complexity of an inexact proximal accelerated augmented Lagrangian (IPAAL) method for solving linearly constrained smooth nonconvex composite optimization problems. Each IPAAL iteration…

Optimization and Control · Mathematics 2020-06-16 Jefferson G. Melo , Renato D. C. Monteiro , Hairong Wang

We study the problem of approximate sampling from non-log-concave distributions, e.g., Gaussian mixtures, which is often challenging even in low dimensions due to their multimodality. We focus on performing this task via Markov chain Monte…

Machine Learning · Statistics 2024-05-30 Tim Tsz-Kit Lau , Han Liu , Thomas Pock

In this paper, we consider nonsmooth composite optimization over compact embedded submanifolds defined by nonlinear equality constraints. We propose a feasibility-safeguarded inexact proximal linearized method (FSIPL), which allows…

Optimization and Control · Mathematics 2026-05-26 Xiyua Xie , Qia Li

We introduce a class of algorithms, termed proximal interacting particle Langevin algorithms (PIPLA), for inference and learning in latent variable models whose joint probability density is non-differentiable. Leveraging proximal Markov…

Computation · Statistics 2025-05-30 Paula Cordero Encinar , Francesca R. Crucinio , O. Deniz Akyildiz

We consider the problem of sampling from a posterior distribution arising in Bayesian inverse problems in science, engineering, and imaging. Our method belongs to the family of independence Metropolis-Hastings (IMH) sampling algorithms,…

Machine Learning · Computer Science 2026-05-19 Youguang Chen , George Biros

Sampling from constrained statistical distributions is a fundamental task in various fields including Bayesian statistics, computational chemistry, and statistical physics. This article considers the cases where the constrained distribution…

Machine Learning · Computer Science 2025-10-28 Kijung Jeon , Michael Muehlebach , Molei Tao

This paper presents a multilevel framework for inertial and inexact proximal algorithms, that encompasses multilevel versions of classical algorithms such as forward-backward and FISTA. The methods are supported by strong theoretical…

Optimization and Control · Mathematics 2024-04-03 Guillaume Lauga , Elisa Riccietti , Nelly Pustelnik , Paulo Gonçalves
‹ Prev 1 2 3 10 Next ›