English
Related papers

Related papers: Jump-Diffusion Langevin Dynamics for Multimodal Po…

200 papers

Priors with non-smooth log-densities, such as the l1-prior, are widely used in Bayesian inverse problems for their sparsity-inducing properties. Existing Langevin-based sampling methods typically rely on proximal mappings or smooth…

Numerical Analysis · Mathematics 2026-05-05 Ivan Cheltsov , Federico Cornalba , Clarice Poon , Tony Shardlow

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

We analyze the posterior contraction rates of parameters in Bayesian models via the Langevin diffusion process, in particular by controlling moments of the stochastic process and taking limits. Analogous to the non-asymptotic analysis of…

Statistics Theory · Mathematics 2022-08-18 Wenlong Mou , Nhat Ho , Martin J. Wainwright , Peter Bartlett , Michael I. Jordan

The stochastic gradient Langevin Dynamics is one of the most fundamental algorithms to solve sampling problems and non-convex optimization appearing in several machine learning applications. Especially, its variance reduced versions have…

Machine Learning · Computer Science 2022-11-22 Yuri Kinoshita , Taiji Suzuki

We consider the problem of sampling from a strongly log-concave density in $\mathbb{R}^d$, and prove a non-asymptotic upper bound on the mixing time of the Metropolis-adjusted Langevin algorithm (MALA). The method draws samples by…

Machine Learning · Statistics 2019-12-12 Raaz Dwivedi , Yuansi Chen , Martin J. Wainwright , Bin Yu

We introduce the Velocity Jumps approach, denoted as JUMP, a new class of Molecular dynamics integrators, replacing the Langevin dynamics by a hybrid model combining a classical Langevin diffusion and a piecewise deterministic Markov…

In this paper, we introduce a new approach for integrating score-based models with the Metropolis-Hastings algorithm. While traditional score-based diffusion models excel in accurately learning the score function from data points, they lack…

Machine Learning · Computer Science 2025-04-01 Ahmed Aloui , Ali Hasan , Juncheng Dong , Zihao Wu , Vahid Tarokh

Understanding how adult humans learn non-native speech categories such as tone information has shed novel insights into the mechanisms underlying experience-dependent brain plasticity. Scientists have traditionally examined these questions…

Methodology · Statistics 2020-06-16 Giorgio Paulon , Fernando Llanos , Bharath Chandrasekaran , Abhra Sarkar

We propose a reflection-free Langevin framework for sampling and optimization on compact polyhedra. The method is based on the inverse Hessian of the logarithmic barrier, which defines a Dikin--Langevin diffusion whose drift and noise adapt…

Computation · Statistics 2026-03-17 James Chok , Domenic Petzinna

Despite recent advances, sampling-based inference for Bayesian Neural Networks (BNNs) remains a significant challenge in probabilistic deep learning. While sampling-based approaches do not require a variational distribution assumption,…

Machine Learning · Computer Science 2025-02-11 Emanuel Sommer , Jakob Robnik , Giorgi Nozadze , Uros Seljak , David Rügamer

This paper is concerned with sampling from probability distributions $\pi$ on $\mathbb{R}^d$ admitting a density of the form $\pi(x) \propto e^{-U(x)}$, where $U(x)=F(x)+G(Kx)$ with $K$ being a linear operator and $G$ being…

Optimization and Control · Mathematics 2024-05-28 Andreas Habring , Martin Holler , Thomas Pock

In this work, we propose a Bayesian type sparse deep learning algorithm. The algorithm utilizes a set of spike-and-slab priors for the parameters in the deep neural network. The hierarchical Bayesian mixture will be trained using an…

Numerical Analysis · Mathematics 2021-03-17 Yating Wang , Wei Deng , Lin Guang

Markov Chain Monte Carlo (MCMC) methods have a drawback when working with a target distribution or likelihood function that is computationally expensive to evaluate, specially when working with big data. This paper focuses on…

Machine Learning · Computer Science 2019-10-22 Asif J. Chowdhury , Gabriel Terejanu

Sampling from the posterior is a key technical problem in Bayesian statistics. Rigorous guarantees are difficult to obtain for Markov Chain Monte Carlo algorithms of common use. In this paper, we study an alternative class of algorithms…

Statistics Theory · Mathematics 2024-08-26 Andrea Montanari , Yuchen Wu

Uncertainty estimation is a key issue when considering the application of deep neural network methods in science and engineering. In this work, we introduce a novel algorithm that quantifies epistemic uncertainty via Monte Carlo sampling…

Machine Learning · Statistics 2024-12-06 Sebastian Bieringer , Gregor Kasieczka , Maximilian F. Steffen , Mathias Trabs

We propose a Bayesian inference approach for a class of latent Markov models. These models are widely used for the analysis of longitudinal categorical data, when the interest is in studying the evolution of an individual unobservable…

Methodology · Statistics 2011-01-05 Francesco Bartolucci , Silvia Pandolfi

Biochemical reaction networks are an amalgamation of reactions where each reaction represents the interaction of different species. Generally, these networks exhibit a multi-scale behavior caused by the high variability in reaction rates…

Quantitative Methods · Quantitative Biology 2023-04-14 Derya Altıntan , Bastian Alt , Heinz Koeppl

One of the well-known challenges in optimal experimental design is how to efficiently estimate the nested integrations of the expected information gain. The Gaussian approximation and associated importance sampling have been shown to be…

Computation · Statistics 2021-08-17 Quan Long

Monte Carlo sampling for Bayesian posterior inference is a common approach used in machine learning. The Markov Chain Monte Carlo procedures that are used are often discrete-time analogues of associated stochastic differential equations…

Machine Learning · Statistics 2020-02-14 Xiaocheng Shang , Zhanxing Zhu , Benedict Leimkuhler , Amos J. Storkey

Markov Chain Monte Carlo (MCMC) algorithms are commonly used for their versatility in sampling from complicated probability distributions. However, as the dimension of the distribution gets larger, the computational costs for a satisfactory…

Cosmology and Nongalactic Astrophysics · Physics 2020-12-01 Hector J. Hortua , Riccardo Volpi , Dimitri Marinelli , Luigi Malago