English
Related papers

Related papers: Sampling from the Mean-Field Stationary Distributi…

200 papers

We propose a new approach to deriving quantitative mean field approximations for any probability measure $P$ on $\mathbb{R}^n$ with density proportional to $e^{f(x)}$, for $f$ strongly concave. We bound the mean field approximation for the…

Probability · Mathematics 2022-06-06 Daniel Lacker , Sumit Mukherjee , Lane Chun Yeung

The mean-field Langevin dynamics (MFLD) is a nonlinear generalization of the Langevin dynamics that incorporates a distribution-dependent drift, and it naturally arises from the optimization of two-layer neural networks via (noisy) gradient…

Machine Learning · Computer Science 2023-06-13 Taiji Suzuki , Denny Wu , Atsushi Nitanda

For algorithms based on interacting particle systems that admit a mean-field description, convergence analysis is often more accessible at the mean-field level. In order to transfer convergence results obtained at the mean-field level to…

Probability · Mathematics 2025-11-03 Nicolai Jurek Gerber , Franca Hoffmann , Urbain Vaes

A dynamical model of an ecological community is analyzed within a "mean-field approximation" in which one of the species interacts with the combination of all of the other species in the community. Within this approximation the model may be…

Adaptation and Self-Organizing Systems · Physics 2009-10-31 Alan McKane , David Alonso , Ricard V. Sole

Bayesian sampling is an important task in statistics and machine learning. Over the past decade, many ensemble-type sampling methods have been proposed. In contrast to the classical Markov chain Monte Carlo methods, these new methods deploy…

Numerical Analysis · Mathematics 2024-05-14 Shi Chen , Zhiyan Ding , Qin Li

The usual Langevin approach to describe systems driven by noise fails to describe the long time behavior of systems with multiple attractors. The solution of the associated linear Fokker-Planck equation is always unique, even though it…

Statistical Mechanics · Physics 2017-06-20 M. Morillo , J. M. Casado

We propose a new method called the N-particle underdamped Langevin algorithm for optimizing a special class of non-linear functionals defined over the space of probability measures. Examples of problems with this formulation include…

Computation · Statistics 2024-02-07 Qiang Fu , Ashia Wilson

The sampling of probability distributions specified up to a normalization constant is an important problem in both machine learning and statistical mechanics. While classical stochastic sampling methods such as Markov Chain Monte Carlo…

Machine Learning · Statistics 2020-10-27 Hao Wu , Jonas Köhler , Frank Noé

Continuous-time Bayesian networks is a natural structured representation language for multicomponent stochastic processes that evolve continuously over time. Despite the compact representation, inference in such models is intractable even…

Artificial Intelligence · Computer Science 2012-05-14 Ido Cohn , Tal El-Hay , Nir Friedman , Raz Kupferman

This work studies how to estimate the mean-field density of large-scale systems in a distributed manner. Such problems are motivated by the recent swarm control technique that uses mean-field approximations to represent the collective…

Systems and Control · Electrical Eng. & Systems 2021-12-21 Tongjia Zheng , Qing Han , Hai Lin

In this work, we formulate an abstract framework to study mean-field systems. In contrast to most approaches in the available literature which primarily rely on the analysis of SDEs, ours is based on optimal transport and semigroup theory.…

Analysis of PDEs · Mathematics 2025-08-05 Tau Shean Lim , Chao Dun Teoh

Sampling from a high-dimensional distribution is a fundamental task in statistics, engineering, and the sciences. A canonical approach is the Langevin Algorithm, i.e., the Markov chain for the discretized Langevin Diffusion. This is the…

Statistics Theory · Mathematics 2022-11-01 Jason M. Altschuler , Kunal Talwar

We study the complexity of sampling, rounding, and integrating arbitrary logconcave functions. Our new approach provides the first complexity improvements in nearly two decades for general logconcave functions for all three problems, and…

Data Structures and Algorithms · Computer Science 2024-11-21 Yunbum Kook , Santosh S. Vempala

We propose a mean-field method to calculate approximately the spacing distribution functions $p^{(n)}(s)$ in 1D classical many-particle systems. We compare our method with two other commonly used methods, the independent interval…

Statistical Mechanics · Physics 2015-01-12 Diego Luis González , Alberto Pimpinelli , T. L. Einstein

The main difficulty that arises in the analysis of most machine learning algorithms is to handle, analytically and numerically, a large number of interacting random variables. In this Ph.D manuscript, we revisit an approach based on the…

Disordered Systems and Neural Networks · Physics 2021-03-11 Benjamin Aubin

Although real-world complex systems typically interact through sparse and heterogeneous networks, analytic solutions of their dynamics are limited to models with all-to-all interactions. Here, we solve the dynamics of a broad range of…

Disordered Systems and Neural Networks · Physics 2025-01-28 Fernando L. Metz

The processes of interplant competition within a field are still poorly understood. However, they explain a large part of the heterogeneity in a field and may have longer-term consequences, especially in mixed stands. Modeling can help to…

Analysis of PDEs · Mathematics 2019-06-05 Antonin Della Noce , Amélie Mathieu , Paul-Henry Cournède

Via constructing an asymptotic coupling by reflection, in this paper we establish uniform-in-time estimates on probability distances for mean-field type SDEs, where the drift terms under consideration are dissipative merely in the long…

Probability · Mathematics 2024-09-26 Jianhai Bao , Jiaqing Hao

Deterministic models of vegetation often summarize, at a macroscopic scale, a multitude of intrinsically random events occurring at a microscopic scale. We bridge the gap between these scales by demonstrating convergence to a mean-field…

Dynamical Systems · Mathematics 2021-05-20 Denis D. Patterson , Simon A. Levin , A. Carla Staver , Jonathan D. Touboul

A recent dynamic mean-field theory for sequence processing in fully connected neural networks of Hopfield-type (During, Coolen and Sherrington, 1998) is extended and analized here for a symmetrically diluted network with finite connectivity…

Disordered Systems and Neural Networks · Physics 2009-11-10 W. K. Theumann
‹ Prev 1 2 3 10 Next ›