English
Related papers

Related papers: Mean Field Optimization Problem Regularized by Fis…

200 papers

We consider a minimax problem motivated by distributionally robust optimization (DRO) when the worst-case distribution is continuous, leading to significant computational challenges due to the infinite-dimensional nature of the optimization…

Machine Learning · Statistics 2024-12-31 Linglingzhi Zhu , Yao Xie

For continuous phase transitions characterized by power-law divergences, Fisher renormalization prescribes how to obtain the critical exponents for a system under constraint from their ideal counterparts. In statistical mechanics, such…

Statistical Mechanics · Physics 2009-11-13 Ralph Kenna , Hsiao-Ping Hsu , Christian von Ferber

The Fisher information matrix summarizes the amount of information in a set of data relative to the quantities of interest. There are many applications of the information matrix in statistical modeling, system identification and parameter…

Computation · Statistics 2014-05-08 Xumeng Cao

Mean field theory has provided theoretical insights into various algorithms by letting the problem size tend to infinity. We argue that the applications of mean-field theory go beyond theoretical insights as it can inspire the design of…

Machine Learning · Computer Science 2023-02-14 Hadi Daneshmand , Francis Bach

In this paper, we present an innovative particle system characterized by moderate interactions, designed to accurately approximate kinetic flocking models that incorporate singular interaction forces and local alignment mechanisms. We…

Analysis of PDEs · Mathematics 2024-04-23 Jinhuan Wang , Keyu Li , Hui Huang

Motivated by recent interest in graphon mean field games and their applications, this paper provides a comprehensive probabilistic analysis of graphon mean field control (GMFC) problems, where the controlled dynamics are governed by a…

Optimization and Control · Mathematics 2025-12-19 Zhongyuan Cao , Mathieu Laurière

Skewness is often present in a wide range of spatial prediction problems, and modeling it in the spatial context remains a challenging problem. In this study a skew-Gaussian random field is considered. The skew-Gaussian random field is…

Methodology · Statistics 2014-02-06 Kjartan Rimstad , Henning Omre

We study a mean field optimal control problem with general non-Markovian dynamics, including both common noise and jumps. We show that its minimizers are Nash equilibria of an associated mean field game of controls. These types of games are…

Optimization and Control · Mathematics 2025-05-12 Felix Höfer , H. Mete Soner

When underlying probability density functions of nonlinear dynamic systems are unknown, the filtering problem is known to be a challenging problem. This paper attempts to make progress on this problem by proposing a new class of filtering…

Statistics Theory · Mathematics 2016-06-17 Zhiguo Wang , Xiaojing Shen , Yunmin Zhu , Jianxin Pan

We propose a family of relaxations of the optimal transport problem which regularize the problem by introducing an additional minimization step over a small region around one of the underlying transporting measures. The type of…

Machine Learning · Statistics 2019-06-11 Saied Mahdian , Jose Blanchet , Peter Glynn

Wasserstein distributionally robust optimization (DRO) has recently achieved empirical success for various applications in operations research and machine learning, owing partly to its regularization effect. Although connection between…

Machine Learning · Computer Science 2020-11-02 Rui Gao , Xi Chen , Anton J. Kleywegt

We investigate the effect of explicitly enforcing the Lipschitz continuity of neural networks with respect to their inputs. To this end, we provide a simple technique for computing an upper bound to the Lipschitz constant---for multiple…

Machine Learning · Statistics 2020-08-11 Henry Gouk , Eibe Frank , Bernhard Pfahringer , Michael J. Cree

We present an early investigation into the use of neural diffusion processes for global optimisation, focusing on Zhang et al.'s Path Integral Sampler. One can use the Boltzmann distribution to formulate optimization as solving a…

Machine Learning · Computer Science 2025-06-10 Max McGuinness , Eirik Fladmark , Francisco Vargas

A central problem in quantum mechanics involves solving the Electronic Schrodinger Equation for a molecule or material. The Variational Monte Carlo approach to this problem approximates a particular variational objective via sampling, and…

Chemical Physics · Physics 2025-01-22 Daniel Freedman , Eyal Rozenberg , Alex Bronstein

This paper presents state estimation and stochastic optimal control gathered in one global optimization problem generating dual effect i.e. the control can improve the future estimation. As the optimal policy is impossible to compute, a…

Optimization and Control · Mathematics 2023-03-27 Emilien Flayac , Karim Dahia , Bruno Hérissé , Frédéric Jean

Dynamic optimization of mean and variance in Markov decision processes (MDPs) is a long-standing challenge caused by the failure of dynamic programming. In this paper, we propose a new approach to find the globally optimal policy for…

Optimization and Control · Mathematics 2023-02-28 Li Xia , Shuai Ma

In this work, we consider a novel inverse problem in mean-field games (MFG). We aim to recover the MFG model parameters that govern the underlying interactions among the population based on a limited set of noisy partial observations of the…

Numerical Analysis · Mathematics 2022-04-12 Yat Tin Chow , Samy Wu Fung , Siting Liu , Levon Nurbekyan , Stanley Osher

The goal of this paper is to show existence of short-time classical solutions to the so called Master Equation of \emph{first order} Mean Field Games, which can be thought of as the limit of the corresponding master equation of a stochastic…

Analysis of PDEs · Mathematics 2019-08-20 Sergio Mayorga

This paper presents a particle-based optimization method designed for addressing minimization problems with equality constraints, particularly in cases where the loss function exhibits non-differentiability or non-convexity. The proposed…

Optimization and Control · Mathematics 2026-03-31 José A. Carrillo , Shi Jin , Haoyu Zhang , Yuhua Zhu

Psychological disorders like major depressive disorder can be seen as complex dynamical systems. By looking at symptom activation patterns, we can investigate the dynamic behaviour of individuals to see whether or not they are at risk for…

Applications · Statistics 2018-07-11 Jolanda J Kossakowski , Marijke CM Gordijn , Harriette Riese , Lourens J Waldorp