English
Related papers

Related papers: Second Order Ensemble Langevin Method for Sampling…

200 papers

In this paper, we study a class of generalized inverse mixed variational inequality problems (GIMVIPs). We propose a novel projection-based second-order time-varying dynamical system for solving GIMVIPs. Under the assumptions that the…

Optimization and Control · Mathematics 2026-01-23 Nam Van Tran

In this paper we will study the approximation of arbitrary law invariant risk measures. As a starting point, we approximate the average value at risk using stochastic gradient Langevin dynamics, which can be seen as a variant of the…

Risk Management · Quantitative Finance 2023-02-13 Jiarui Chu , Ludovic Tangpi

We consider the numerical approximation of the ill-posed data assimilation problem for stationary convection-diffusion equations and extend our previous analysis in [Numer. Math. 144, 451--477, 2020] to the convection-dominated regime.…

Numerical Analysis · Mathematics 2022-02-22 Erik Burman , Mihai Nechita , Lauri Oksanen

In this paper, we provide a multiscale perspective on the problem of maximum marginal likelihood estimation. We consider and analyse a diffusion-based maximum marginal likelihood estimation scheme using ideas from multiscale dynamics. Our…

Computation · Statistics 2024-06-11 O. Deniz Akyildiz , Michela Ottobre , Iain Souttar

We study the equivalence of ensembles for stationary measures of interacting particle systems with two conserved quantities and unbounded local state space. The main motivation is a condensation transition in the zero-range process which…

Mathematical Physics · Physics 2018-04-26 Stefan Grosskinsky

For continuous-time linear stochastic dynamical systems driven by Wiener processes, we consider the problem of designing ensemble filters when the observation process is randomly time-sampled. We propose a continuous-discrete McKean--Vlasov…

Optimization and Control · Mathematics 2024-06-21 Aneel Tanwani , Olga Yufereva

In many applications of statistical estimation via sampling, one may wish to sample from a high-dimensional target distribution that is adaptively evolving to the samples already seen. We study an example of such dynamics, given by a…

Statistics Theory · Mathematics 2025-11-04 Zhou Fan , Justin Ko , Bruno Loureiro , Yue M. Lu , Yandi Shen

For the task of sampling from a density $\pi \propto \exp(-V)$ on $\mathbb{R}^d$, where $V$ is possibly non-convex but $L$-gradient Lipschitz, we prove that averaged Langevin Monte Carlo outputs a sample with $\varepsilon$-relative Fisher…

Statistics Theory · Mathematics 2022-02-11 Krishnakumar Balasubramanian , Sinho Chewi , Murat A. Erdogdu , Adil Salim , Matthew Zhang

In this paper, we study the problem of sampling from log-concave distributions supported on convex, compact sets, with a particular focus on the randomized midpoint discretization of both vanilla and kinetic Langevin diffusions in this…

Machine Learning · Statistics 2025-05-27 Yifeng Yu , Lu Yu

The measured time series from complex systems are renowned for their intricate stochastic behavior, characterized by random fluctuations stemming from external influences and nonlinear interactions. These fluctuations take diverse forms,…

Statistical Mechanics · Physics 2025-03-19 Pyei Phyo Lin , Matthias Wächter , Joachim Peinke , M. Reza Rahimi Tabar

Supervised topic models with a logistic likelihood have two issues that potentially limit their practical use: 1) response variables are usually over-weighted by document word counts; and 2) existing variational inference methods make…

Machine Learning · Computer Science 2013-10-10 Jun Zhu , Xun Zheng , Bo Zhang

Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian…

Numerical Analysis · Mathematics 2025-02-10 Tony Lelièvre , Grigorios A. Pavliotis , Geneviève Robin , Régis Santet , Gabriel Stoltz

Many complex systems, ranging from migrating cells to animal groups, exhibit stochastic dynamics described by the underdamped Langevin equation. Inferring such an equation of motion from experimental data can provide profound insight into…

Biological Physics · Physics 2026-04-17 David B. Brückner , Pierre Ronceray , Chase P. Broedersz

Nonlinear, multiplicative Langevin equations for a complete set of slow variables in equilibrium systems are generally derived on the basis of the separation of time scales. The form of the equations is universal and equivalent to that…

Statistical Mechanics · Physics 2017-03-07 Masato Itami , Shin-ichi Sasa

A fully Bayesian treatment of complicated predictive models (such as deep neural networks) would enable rigorous uncertainty quantification and the automation of higher-level tasks including model selection. However, the intractability of…

We study the problem of approximate sampling from non-log-concave distributions, e.g., Gaussian mixtures, which is often challenging even in low dimensions due to their multimodality. We focus on performing this task via Markov chain Monte…

Machine Learning · Statistics 2024-05-30 Tim Tsz-Kit Lau , Han Liu , Thomas Pock

We proposed a new technique to accelerate sampling methods for solving difficult optimization problems. Our method investigates the intrinsic connection between posterior distribution sampling and optimization with Langevin dynamics, and…

Machine Learning · Computer Science 2023-01-31 Junlong Lyu , Zhitang Chen , Wenlong Lyu , Jianye Hao

In this paper, we consider the stochastic Langevin equation with additive noises, which possesses both conformal symplectic geometric structure and ergodicity. We propose a methodology of constructing high weak order conformal symplectic…

Numerical Analysis · Mathematics 2017-02-27 Jialin Hong , Liying Sun , Xu Wang

We consider the problem of inferring the conditional independence graph (CIG) of a high-dimensional stationary multivariate Gaussian time series. A sparse-group lasso based frequency-domain formulation of the problem has been considered in…

Machine Learning · Statistics 2022-05-02 Jitendra K Tugnait

We introduce a new generative model where samples are produced via Langevin dynamics using gradients of the data distribution estimated with score matching. Because gradients can be ill-defined and hard to estimate when the data resides on…

Machine Learning · Computer Science 2020-10-13 Yang Song , Stefano Ermon