English
Related papers

Related papers: Mean Field Optimization Problem Regularized by Fis…

200 papers

We study the problem of policy optimization for infinite-horizon discounted Markov Decision Processes with softmax policy and nonlinear function approximation trained with policy gradient algorithms. We concentrate on the training dynamics…

Machine Learning · Computer Science 2020-10-23 Andrea Agazzi , Jianfeng Lu

The Schr\"{o}dinger Bridge Problem (SBP), which can be understood as an entropy-regularized optimal transport, seeks to compute stochastic dynamic mappings connecting two given distributions. SBP has shown significant theoretical importance…

Optimization and Control · Mathematics 2025-03-25 Yang Jing , Lei Li , Jingtong Zhang

Learning robust models that generalize well under changes in the data distribution is critical for real-world applications. To this end, there has been a growing surge of interest to learn simultaneously from multiple training domains -…

Machine Learning · Computer Science 2022-06-02 Alexandre Rame , Corentin Dancette , Matthieu Cord

A statistical model of self-organization in a generic class of one-dimensional nonlinear Schrodinger (NLS) equations on a bounded interval is developed. The main prediction of this model is that the statistically preferred state for such…

chao-dyn · Physics 2009-10-31 Richard Jordan , Bruce Turkington , Craig Zirbel

The optimization of large portfolios displays an inherent instability to estimation error. This poses a fundamental problem, because solutions that are not stable under sample fluctuations may look optimal for a given sample, but are, in…

Portfolio Management · Quantitative Finance 2015-05-14 Susanne Still , Imre Kondor

In this paper we consider a continuous description based on stochastic differential equations of the popular particle swarm optimization (PSO) process for solving global optimization problems and derive in the large particle limit the…

Numerical Analysis · Mathematics 2020-12-11 Sara Grassi , Lorenzo Pareschi

In arXiv:1004.1407, Flandoli, Gubinelli, and Priola proposed a stochastic variant of the classical point vortex system of Helmholtz and Kirchoff in which multiplicative noise of transport-type is added to the dynamics. An open problem in…

Probability · Mathematics 2020-11-25 Matthew Rosenzweig

We propose a new method called the N-particle underdamped Langevin algorithm for optimizing a special class of non-linear functionals defined over the space of probability measures. Examples of problems with this formulation include…

Computation · Statistics 2024-02-07 Qiang Fu , Ashia Wilson

Approximating a probability distribution using a set of particles is a fundamental problem in machine learning and statistics, with applications including clustering and quantization. Formally, we seek a weighted mixture of Dirac measures…

Machine Learning · Statistics 2026-04-24 Ayoub Belhadji , Daniel Sharp , Youssef Marzouk

We study the optimal stopping problem of McKean-Vlasov diffusions when the criterion is a function of the law of the stopped process. A remarkable new feature in this setting is that the stopping time also impacts the dynamics of the…

Probability · Mathematics 2023-01-18 Mehdi Talbi , Nizar Touzi , Jianfeng Zhang

In this article, we provide sufficient conditions under which the controlled vector fields solution of optimal control problems formulated on continuity equations are Lipschitz regular in space. Our approach involves a novel combination of…

Optimization and Control · Mathematics 2021-02-09 Benoît Bonnet , Francesco Rossi

In this short note we review the dynamical Schr\"odinger problem on the non-commutative Fisher-Rao space of positive semi-definite matrix-valued measures. The presentation is meant to be self-contained, and we discuss in particular…

Statistics Theory · Mathematics 2022-01-20 Léonard Monsaingeon , Dmitry Vorotnikov

Mean-field games (MFGs) are a modeling framework for systems with a large number of interacting agents. They have applications in economics, finance, and game theory. Normalizing flows (NFs) are a family of deep generative models that…

Optimization and Control · Mathematics 2023-05-24 Han Huang , Jiajia Yu , Jie Chen , Rongjie Lai

This paper is devoted to the numerical resolution of McKean-Vlasov control problems via the class of mean-field neural networks introduced in our companion paper [25] in order to learn the solution on the Wasserstein space. We propose…

Optimization and Control · Mathematics 2024-03-20 Huyên Pham , Xavier Warin

The mean-field Langevin dynamics (MFLD) minimizes an entropy-regularized nonlinear convex functional on the Wasserstein space over $\mathbb{R}^d$, and has gained attention recently as a model for the gradient descent dynamics of interacting…

Machine Learning · Computer Science 2026-05-19 Anming Gu , Juno Kim

A relationship between the Fisher information and the characteristic function is established with the help of two inequalities. A necessary and sufficient condition for equality is found. These results are used to determine the asymptotic…

Information Theory · Computer Science 2010-07-12 Cihan Tepedelenlioglu , Mahesh K. Banavar , Andreas Spanias

Gradient flows play a substantial role in addressing many machine learning problems. We examine the convergence in continuous-time of a \textit{Fisher-Rao} (Mean-Field Birth-Death) gradient flow in the context of solving convex-concave…

Optimization and Control · Mathematics 2024-09-19 Razvan-Andrei Lascu , Mateusz B. Majka , Łukasz Szpruch

The estimation of continuous parameters from measured data plays a central role in many fields of physics. A key tool in understanding and improving such estimation processes is the concept of Fisher information, which quantifies how…

This paper studies the convergence of mean field games with finite state space to mean field games with a continuous state space. We examine a space discretization of a diffusive dynamics, which is reminiscent of the Markov chain…

Optimization and Control · Mathematics 2024-01-18 Charles Bertucci , Alekos Cecchin

Mean Field inference is central to statistical physics. It has attracted much interest in the Computer Vision community to efficiently solve problems expressible in terms of large Conditional Random Fields. However, since it models the…

Computer Vision and Pattern Recognition · Computer Science 2016-11-24 Pierre Baqué , François Fleuret , Pascal Fua