English
Related papers

Related papers: The Forward-Backward Envelope for Sampling with th…

200 papers

We study three kinetic Langevin samplers including the Euler discretization, the BU and the UBU splitting scheme. We provide contraction results in $L^1$-Wasserstein distance for non-convex potentials. These results are based on a carefully…

Probability · Mathematics 2025-08-20 Katharina Schuh , Peter A. Whalley

We propose Decentralized Proximal Stochastic Gradient Langevin Dynamics (DE-PSGLD), a decentralized Markov chain Monte Carlo (MCMC) algorithm for sampling from a log-concave probability distribution constrained to a convex domain.…

Machine Learning · Statistics 2026-05-04 Mohammad Rafiqul Islam , Lingjiong Zhu

Reflected diffusions in polyhedral domains are commonly used as approximate models for stochastic processing networks in heavy traffic. Stationary distributions of such models give useful information on the steady state performance of the…

Probability · Mathematics 2012-05-24 Amarjit Budhiraja , Jiang Chen , Sylvain Rubenthaler

Sampling from score-based diffusion models incurs bias due to both time discretisation and the approximation of the score function. A common strategy for reducing this bias is to apply corrector steps based on the unadjusted Langevin…

Machine Learning · Statistics 2026-05-12 Kevin H. Lam , Tyler Farghly , Christopher Williams , Jun Yang , Yee Whye Teh , Arnaud Doucet

We propose an algorithm for the efficient and robust sampling of the posterior probability distribution in Bayesian inference problems. The algorithm combines the local search capabilities of the Manifold Metropolis Adjusted Langevin…

Adaptive or dynamic signal sampling in sensing systems can adapt subsequent sampling strategies based on acquired signals, thereby potentially improving image quality and speed. This paper proposes a Bayesian method for adaptive sampling…

Signal Processing · Electrical Eng. & Systems 2023-02-28 Guanhua Wang , Douglas C. Noll , Jeffrey A. Fessler

We study Langevin-type algorithms for sampling from Gibbs distributions such that the potentials are dissipative and their weak gradients have finite moduli of continuity not necessarily convergent to zero. Our main result is a…

Statistics Theory · Mathematics 2024-03-01 Shogo Nakakita

In this paper, we propose an efficient pseudo-marginal Markov chain Monte Carlo (MCMC) sampling approach to draw samples from posterior shape distributions for image segmentation. The computation time of the proposed approach is independent…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Ertunc Erdil , Sinan Yildirim , Tolga Tasdizen , Mujdat Cetin

The paper develops new methods of non-parametric estimation a compound Poisson distribution. Such a problem arise, in particular, in the inference of a Levy process recorded at equidistant time intervals. Our key estimator is based on…

Statistics Theory · Mathematics 2015-10-19 Alexey Lindo , Sergei Zuyev , Serik Sagitov

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

Joint deconvolution and segmentation of ultrasound images is a challenging problem in medical imaging. By adopting a hierarchical Bayesian model, we propose an accelerated Markov chain Monte Carlo scheme where the tissue reflectivity…

Image and Video Processing · Electrical Eng. & Systems 2020-01-23 Corbineau Marie-Caroline , Kouamé Denis , Chouzenoux Emilie , Tourneret Jean-Yves , Pesquet Jean-Christophe

Distribution matching (DM) is a versatile domain-invariant representation learning technique that has been applied to tasks such as fair classification, domain adaptation, and domain translation. Non-parametric DM methods struggle with…

Machine Learning · Computer Science 2025-06-18 Ziyu Gong , Jim Lim , David I. Inouye

We consider the problem of unconstrained minimization of a smooth objective function in $\R^n$ in a setting where only function evaluations are possible. While importance sampling is one of the most popular techniques used by machine…

Optimization and Control · Mathematics 2020-04-03 Adel Bibi , El Houcine Bergou , Ozan Sener , Bernard Ghanem , Peter Richtárik

Bayesian formulation of modern day signal processing problems has called for improved Markov chain Monte Carlo (MCMC) sampling algorithms for inference. The need for efficient sampling techniques has become indispensable for high…

Computation · Statistics 2025-10-28 Apratim Shukla , Dootika Vats , Eric C. Chi

We present a randomized maximum a posteriori (rMAP) method for generating approximate samples of posteriors in high dimensional Bayesian inverse problems governed by large-scale forward problems. We derive the rMAP approach by: 1) casting…

Computation · Statistics 2016-02-12 Kainan Wang , Tan Bui-Thanh , Omar Ghattas

Given a sample from a discretely observed compound Poisson process, we consider non-parametric estimation of the density $f_0$ of its jump sizes, as well as of its intensity $\lambda_0.$ We take a Bayesian approach to the problem and…

Statistics Theory · Mathematics 2023-02-27 Shota Gugushvili , Frank van der Meulen , Peter Spreij

Each training step for a variational autoencoder (VAE) requires us to sample from the approximate posterior, so we usually choose simple (e.g. factorised) approximate posteriors in which sampling is an efficient computation that fully…

Machine Learning · Statistics 2018-05-29 Laurence Aitchison , Vincent Adam , Srinivas C. Turaga

Suppose X is a multivariate diffusion process that is observed discretely in time. At each observation time, a transformation of the state of the process is observed with noise. The smoothing problem consists of recovering the path of the…

Computation · Statistics 2024-09-04 Marcin Mider , Moritz Schauer , Frank van der Meulen

The forward-backward splitting algorithm is a popular operator-splitting method for solving monotone inclusion of the sum of a maximal monotone operator and a cocoercive operator. In this paper, we present a new convergence analysis of a…

Functional Analysis · Mathematics 2019-08-30 Fuying Cui , Yuchao Tang , Chuanxi Zhu

Dual decomposition is a powerful technique for deriving decomposition schemes for convex optimization problems with separable structure. Although the Augmented Lagrangian is computationally more stable than the ordinary Lagrangian, the…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Johan A. K. Suykens
‹ Prev 1 8 9 10 Next ›