English
Related papers

Related papers: Mean Field Optimization Problem Regularized by Fis…

200 papers

We propose to align distributional data from the perspective of Wasserstein means. We raise the problem of regularizing Wasserstein means and propose several terms tailored to tackle different problems. Our formulation is based on the…

Machine Learning · Computer Science 2020-02-24 Liang Mi , Wen Zhang , Yalin Wang

Mean-field variational inference is a method for approximate Bayesian posterior inference. It approximates a full posterior distribution with a factorized set of distributions by maximizing a lower bound on the marginal likelihood. This…

Machine Learning · Computer Science 2012-07-03 John Paisley , David Blei , Michael Jordan

This paper studies a type of rank-based mean field game in which competing agents strategically switch among multiple effort regimes. We propose an entropy regularized auxiliary problem where the switching decisions are randomized to the…

Optimization and Control · Mathematics 2026-05-29 Zongxia Liang , Shu Wang , Xiang Yu

We propose a new iterative unfolding method for experimental data, making use of a regularization function. The use of this function allows one to build an improved normalization procedure for Monte Carlo spectra, unbiased by the presence…

Data Analysis, Statistics and Probability · Physics 2009-07-23 Bogdan Malaescu

Mean field control (MFC) problems have been introduced to study social optima in very large populations of strategic agents. The main idea is to consider an infinite population and to simplify the analysis by using a mean field…

Optimization and Control · Mathematics 2023-03-01 Sebastian Baudelet , Brieuc Frénais , Mathieu Laurière , Amal Machtalay , Yuchen Zhu

Mean field theory is a device to analyze the collective behavior of a dynamical system comprising many interacting particles. The theory allows to reduce the behavior of the system to the properties of a handful of parameters. In neural…

Neurons and Cognition · Quantitative Biology 2022-06-10 Giancarlo La Camera

The optimal transport problem has recently developed into a powerful framework for various applications in estimation and control. Many of the recent advances in the theory and application of optimal transport are based on regularizing the…

Optimization and Control · Mathematics 2021-03-12 Isabel Haasler , Axel Ringh , Yongxin Chen , Johan Karlsson

In this brief note we compute the Fisher information of a family of generalized normal distributions. Fisher information is usually defined for regular distributions, i.e. continuously differentiable (log) density functions whose support…

Information Theory · Computer Science 2020-11-18 Precious Ugo Abara , Sandra Hirche

This PhD thesis is organized as follows. In the first two chapters I will review some basic notions of statistical physics of disordered systems, such as random graph theory, the mean-field approximation, spin glasses and combinatorial…

Disordered Systems and Neural Networks · Physics 2019-10-15 Enrico M. Malatesta

In this work, we investigate a stochastic control framework for global optimization over both Euclidean spaces and the Wasserstein space of probability measures, where the objective function may be non-convex and/or non-differentiable. In…

Optimization and Control · Mathematics 2026-04-21 Jinniao Qiu

Mean Field Games provide a powerful framework to analyze the dynamics of a large number of controlled agents in interaction. Here we consider such systems when the interactions between agents result in a negative coordination and analyze…

Physics and Society · Physics 2020-10-28 Thibault Bonnemain , Thierry Gobron , Denis Ullmo

In performative learning, the data distribution reacts to the deployed model - for example, because strategic users adapt their features to game it - which creates a more complex dynamic than in classical supervised learning. One should…

Machine Learning · Computer Science 2025-10-15 Edwige Cyffers , Alireza Mirrokni , Marco Mondelli

This paper introduces a drift optimization model of stochastic optimization problems driven by regulated stochastic processes. A broad range of problems across operations research, machine learning, and statistics can be viewed as…

Optimization and Control · Mathematics 2025-06-10 Zihe Zhou , Harsha Honnappa , Raghu Pasupathy

Regularization is essential for avoiding over-fitting to training data in network optimization, leading to better generalization of the trained networks. The label noise provides a strong implicit regularization by replacing the target…

Machine Learning · Computer Science 2022-05-04 Kensuke Nakamura , Bong-Soo Sohn , Kyoung-Jae Won , Byung-Woo Hong

We present a method enabling a large number of agents to learn how to flock, which is a natural behavior observed in large populations of animals. This problem has drawn a lot of interest but requires many structural assumptions and is…

Multiagent Systems · Computer Science 2021-05-18 Sarah Perrin , Mathieu Laurière , Julien Pérolat , Matthieu Geist , Romuald Élie , Olivier Pietquin

Detailed mean field and Monte Carlo studies of the dynamic magnetization-reversal transition in the Ising model in its ordered phase under a competing external magnetic field of finite duration have been presented here. Approximate…

Statistical Mechanics · Physics 2009-10-31 Arkajyoti Misra , Bikas K Chakrabarti

There has been considerable recent interest in the mean-field dynamics of various atom-interferometry schemes designed for precision sensing. In the field of quantum metrology, the standard tools for evaluating metrological sensitivity are…

Quantum Physics · Physics 2016-06-13 Simon A. Haine

In this work we survey some recent results on the global minimization of a non-convex and possibly non-smooth high dimensional objective function by means of particle based gradient-free methods. Such problems arise in many situations of…

Optimization and Control · Mathematics 2021-08-21 Sara Grassi , Hui Huang , Lorenzo Pareschi , Jinniao Qiu

We develop a framework for the analysis of deep neural networks and neural ODE models that are trained with stochastic gradient algorithms. We do that by identifying the connections between control theory, deep learning and theory of…

Probability · Mathematics 2021-03-18 Jean-François Jabir , David Šiška , Łukasz Szpruch

Entropy regularization is commonly used to improve policy optimization in reinforcement learning. It is believed to help with \emph{exploration} by encouraging the selection of more stochastic policies. In this work, we analyze this claim…

Machine Learning · Computer Science 2019-06-11 Zafarali Ahmed , Nicolas Le Roux , Mohammad Norouzi , Dale Schuurmans
‹ Prev 1 3 4 5 6 7 10 Next ›