English
Related papers

Related papers: Sampling from the Mean-Field Stationary Distributi…

200 papers

Mean-Field is an efficient way to approximate a posterior distribution in complex graphical models and constitutes the most popular class of Bayesian variational approximation methods. In most applications, the mean field distribution…

Machine Learning · Computer Science 2015-02-23 Pierre Baqué , Jean-Hubert Hours , François Fleuret , Pascal Fua

Langevin dynamics has become a popular tool to simulate the Boltzmann equilibrium distribution. When the repartition of the Langevin equation involves the exact realization of the Ornstein-Uhlenbeck noise, in addition to the conventional…

Chemical Physics · Physics 2017-11-15 Dezhang Li , Xu Han , Yichen Chai , Cong Wang , Zifei Chen , Zhijun Zhang , Jian Liu , Jiushu Shao

Studying sample path behaviour of stochastic fields/processes is a classical research topic in probability theory and related areas such as fractal geometry. To this end, many methods have been developed since a long time in Gaussian…

Probability · Mathematics 2016-06-13 Antoine Ayache , Geoffrey Boutard

We propose a novel method for sampling from unnormalized Boltzmann densities based on a probability flow ordinary differential equation (ODE) derived from linear stochastic interpolants. The key innovation of our approach is the use of a…

Numerical Analysis · Mathematics 2026-03-12 Chenguang Duan , Yuling Jiao , Gabriele Steidl , Christian Wald , Jerry Zhijian Yang , Ruizhe Zhang

It is proposed to use stochastic differential equations with state-dependent switching rates (SDEwS) for sampling from finite mixture distributions. An Euler scheme with constant time step for SDEwS is considered. It is shown that the…

Numerical Analysis · Mathematics 2025-05-08 M. V. Tretyakov

In the context of non-convex optimization, we let the temperature of a Langevin diffusion to depend on the diffusion's own density function. The rationale is that the induced density captures to some extent the landscape imposed by the…

Optimization and Control · Mathematics 2025-08-22 Yu-Jui Huang , Zachariah Malik

In this paper we analyze the probability of consistency of sensor data distribution systems (SDDS), and determine suitable evaluation models. This problem is typically difficult, since a reliable model taking into account all parameters and…

Networking and Internet Architecture · Computer Science 2016-11-17 Mauro Femminella , Gianluca Reali

Sampling from binary quadratic distributions (BQDs) is a fundamental but challenging problem in discrete optimization and probabilistic inference. Previous work established theoretical guarantees for stochastic localization (SL) in…

Statistics Theory · Mathematics 2025-05-27 Chenguang Wang , Kaiyuan Cui , Weichen Zhao , Tianshu Yu

We introduce a mean-field framework for the study of systems of interacting particles sharing a conserved quantity. The work generalises and unites the existing fields of asset-exchange models, often applied to socio-economic systems, and…

Physics and Society · Physics 2021-06-14 Dominic T Robson , Andreas CW Baas , Alessia Annibale

Sampling from log-concave distributions is a well researched problem that has many applications in statistics and machine learning. We study the distributions of the form $p^{*}\propto\exp(-f(x))$, where…

Machine Learning · Computer Science 2019-09-13 Ruoqi Shen , Yin Tat Lee

The problem of communicating sensor measurements over shared networks is prevalent in many modern large-scale distributed systems such as cyber-physical systems, wireless sensor networks, and the internet of things. Due to bandwidth…

Systems and Control · Electrical Eng. & Systems 2021-12-14 Marcos M. Vasconcelos

A key task in Bayesian statistics is sampling from distributions that are only specified up to a partition function (i.e., constant of proportionality). However, without any assumptions, sampling (even approximately) can be #P-hard, and few…

Machine Learning · Computer Science 2018-12-03 Rong Ge , Holden Lee , Andrej Risteski

Stochastic interacting particle systems are widely used to model collective phenomena across diverse fields, including statistical physics, biology, and social dynamics. The McKean-Vlasov equation arises as the mean-field limit of such…

Computational Physics · Physics 2025-09-17 Zhiqiang Cai , Chengyu Liu , Xiang Zhou

Analytical description of propagation phenomena on random networks has flourished in recent years, yet more complex systems have mainly been studied through numerical means. In this paper, a mean-field description is used to coherently…

Statistical Mechanics · Physics 2010-10-08 Laurent Hébert-Dufresne , Pierre-André Noël , Vincent Marceau , Antoine Allard , Louis J. Dubé

We consider the problem of estimating parameters of stochastic differential equations (SDEs) with discrete-time observations that are either completely or partially observed. The transition density between two observations is generally…

Methodology · Statistics 2015-09-09 Libo Sun , Chihoon Lee , Jennifer A. Hoeting

We study mean field stochastic differential equations with a diffusion coefficient that depends on the distribution function of the unknown process in a discontinuous manner, which is a type of distribution dependent regime switching. To…

Probability · Mathematics 2025-03-28 Jani Nykänen

Mean-field Langevin dynamics (MFLD) is an optimization method derived by taking the mean-field limit of noisy gradient descent for two-layer neural networks in the mean-field regime. Recently, the propagation of chaos (PoC) for MFLD has…

Machine Learning · Statistics 2025-08-19 Atsushi Nitanda , Anzelle Lee , Damian Tan Xing Kai , Mizuki Sakaguchi , Taiji Suzuki

Stochastic saddle point (SSP) problems are, in general, less studied compared to stochastic minimization problems. However, SSP problems emerge from machine learning (adversarial training, e.g., GAN, AUC maximization), statistics (robust…

Optimization and Control · Mathematics 2023-12-14 Vitali Pirau

Sampling from various kinds of distributions is an issue of paramount importance in statistics since it is often the key ingredient for constructing estimators, test procedures or confidence intervals. In many situations, the exact sampling…

Computation · Statistics 2016-12-06 Arnak S. Dalalyan

We address the problem of simulation and parameter inference for chemical reaction networks described by the chemical Langevin equation, a stochastic differential equation (SDE) representation of the dynamics of the chemical species. This…

Methodology · Statistics 2025-08-18 Petar Jovanovski , Andrew Golightly , Umberto Picchini , Massimiliano Tamborrino