English
Related papers

Related papers: Multilevel-Langevin pathwise average for Gibbs app…

200 papers

The maximum a-posteriori (MAP) perturbation framework has emerged as a useful approach for inference and learning in high dimensional complex models. By maximizing a randomly perturbed potential function, MAP perturbations generate unbiased…

Machine Learning · Computer Science 2013-10-17 Francesco Orabona , Tamir Hazan , Anand D. Sarwate , Tommi Jaakkola

Underdamped Langevin dynamics (ULD) is a widely-used sampler for Gibbs distributions $\pi\propto e^{-V}$, and is often empirically effective in high dimensions. However, existing non-asymptotic convergence guarantees for discretized ULD…

Machine Learning · Computer Science 2026-03-04 Shiyuan Zhang , Qiwei Di , Xuheng Li , Quanquan Gu

In this paper, we accelerate Langevin Monte Carlo sampling from Gibbs measures $\pi\propto \exp(-U)$ by adding a large drift that preserves the invariant measure. For warm-start initial data, we characterize the sharp asymptotic decay rate…

Probability · Mathematics 2026-04-28 Yuanyuan Feng , Lei Li , Jian-Guo Liu , Xiaoqian Xu

For the task of sampling from a density $\pi \propto \exp(-V)$ on $\mathbb{R}^d$, where $V$ is possibly non-convex but $L$-gradient Lipschitz, we prove that averaged Langevin Monte Carlo outputs a sample with $\varepsilon$-relative Fisher…

Statistics Theory · Mathematics 2022-02-11 Krishnakumar Balasubramanian , Sinho Chewi , Murat A. Erdogdu , Adil Salim , Matthew Zhang

We study parameter inference in large-scale latent variable models. We first propose an unified treatment of online inference for latent variable models from a non-canonical exponential family, and draw explicit links between several…

Machine Learning · Computer Science 2018-02-01 Christophe Dupuy , Francis Bach

We build and study a recursive algorithm based on the occupation measure of an Euler scheme with decreasing step for the numerical approximation of the quasistationary distribution (QSD) of an elliptic diffusion in a bounded domain. We…

Probability · Mathematics 2025-10-17 Fabien Panloup , Julien Reygner

In this paper, we are presenting a method for estimation of market parameters modeled by jump diffusion process. The method proposed is based on Gibbs sampler, while the market parameters are the drift, the volatility, the jump intensity…

Pricing of Securities · Quantitative Finance 2017-12-22 Kein Joe Lau , Yong Kheng Goh , An-Chow Lai

Discrete diffusion models have achieved strong empirical performance in text and other symbolic domains, but, especially for uniform-rate models, they often require many steps to generate a single sample. Existing acceleration methods…

Machine Learning · Computer Science 2026-05-27 Yuchen Liang , Ness Shroff , Yingbin Liang

We introduce a novel framework for efficient sampling from complex, unnormalised target distributions by exploiting multiscale dynamics. Traditional score-based sampling methods either rely on learned approximations of the score function or…

Computation · Statistics 2025-11-04 Paula Cordero-Encinar , Andrew B. Duncan , Sebastian Reich , O. Deniz Akyildiz

Biochemical reaction networks are often modelled using discrete-state, continuous-time Markov chains. System statistics of these Markov chains usually cannot be calculated analytically and therefore estimates must be generated via…

Quantitative Methods · Quantitative Biology 2016-04-19 Daniel Wilson , Ruth E. Baker

We propose a novel estimation framework for path-dependent functionals of Levy processes from discretely observed data. Traditional approaches rely on Monte Carlo simulation of full paths, which requires complete model specification and…

Methodology · Statistics 2025-09-03 Yasutaka Shimizu , Hiroshi Shiraishi

This paper provides a general and abstract approach to approximate ergodic regimes of Markov and Feller processes. More precisely, we show that the recursive algorithm presented in Lamberton & Pages (2002) and based on simulation algorithms…

Probability · Mathematics 2018-01-17 Gilles Pagès , Clément Rey

We propose a novel diffusion map particle system (DMPS) for generative modeling, based on diffusion maps and Laplacian-adjusted Wasserstein gradient descent (LAWGD). Diffusion maps are used to approximate the generator of the corresponding…

Machine Learning · Statistics 2024-12-19 Fengyi Li , Youssef Marzouk

We provide the first polynomial-time convergence guarantees for the probability flow ODE implementation (together with a corrector step) of score-based generative modeling. Our analysis is carried out in the wake of recent results obtaining…

Machine Learning · Computer Science 2023-05-22 Sitan Chen , Sinho Chewi , Holden Lee , Yuanzhi Li , Jianfeng Lu , Adil Salim

In this paper we describe how MAP inference can be used to sample efficiently from Gibbs distributions. Specifically, we provide means for drawing either approximate or unbiased samples from Gibbs' distributions by introducing low…

Machine Learning · Computer Science 2013-10-01 Tamir Hazan , Subhransu Maji , Tommi Jaakkola

Approximate Bayesian computation methods are useful for generative models with intractable likelihoods. These methods are however sensitive to the dimension of the parameter space, requiring exponentially increasing resources as this…

Computation · Statistics 2026-02-09 Grégoire Clarté , Christian P. Robert , Robin Ryder , Julien Stoehr

We investigate robust parameter estimation and testing procedure for multivariate diffusion processes observed at high frequency via the minimum density power divergence estimator (MDPDE). Within a general diffusion framework and under…

Methodology · Statistics 2026-03-17 Sourojyoti Barick

The Stochastic Gradient Langevin Dynamics (SGLD) are popularly used to approximate Bayesian posterior distributions in statistical learning procedures with large-scale data. As opposed to many usual Markov chain Monte Carlo (MCMC)…

Machine Learning · Statistics 2024-04-30 Kexin Jin , Chenguang Liu , Jonas Latz

We study the problem of sampling from a probability distribution $\pi$ on $\rset^d$ which has a density \wrt\ the Lebesgue measure known up to a normalization factor $x \mapsto \rme^{-U(x)} / \int_{\rset^d} \rme^{-U(y)} \rmd y$. We analyze…

Statistics Theory · Mathematics 2019-09-17 M. Barkhagen , N. H. Chau , É. Moulines , M. Rásonyi , S. Sabanis , Y. Zhang

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero
‹ Prev 1 4 5 6 7 8 10 Next ›