English
Related papers

Related papers: Gradient Flows as Optimal Controlled Evolutions: F…

200 papers

We study data-driven decision problems where historical observations are generated by a time-evolving distribution whose consecutive shifts are bounded in Wasserstein distance. We address this nonstationarity using a distributionally robust…

Optimization and Control · Mathematics 2025-12-25 Dominic S. T. Keehan , Edward J. Anderson , Wolfram Wiesemann

Recent results have shown that for two-layer fully connected neural networks, gradient flow converges to a global optimum in the infinite width limit, by making a connection between the mean field dynamics and the Wasserstein gradient flow.…

Optimization and Control · Mathematics 2020-07-16 Walid Krichene , Kenneth F. Caluya , Abhishek Halder

We reveal a precise mathematical framework about a new family of generative models which we call Gradient Flow Drifting. With this framework, we prove an equivalence between the recently proposed Drifting Model and the Wasserstein gradient…

Machine Learning · Computer Science 2026-03-12 Jiarui Cao , Zixuan Wei , Yuxin Liu

For free energies of the form \[ F(\mu) = E(\mu) + \sigma\int_\Omega \mu\log\mu\,dx, \quad \sigma > 0, \] we study the Wasserstein gradient flow, a continuity equation also known as mean-field Langevin dynamics, around a stationary state…

Optimization and Control · Mathematics 2026-03-17 Dante Kalise , Lucas M. Moschen , Grigorios A. Pavliotis

Performativity means that the deployment of a predictive model incentivizes agents to strategically adapt their behavior, thereby inducing a model-dependent distribution shift. Practitioners often repeatedly retrain the model on data…

Optimization and Control · Mathematics 2026-02-09 Siyi Wang , Zifan Wang , Karl H. Johansson

Likelihood-based policy gradient methods are the dominant approach for training robot control policies from rewards. These methods rely on differentiable action likelihoods, which constrain policy outputs to simple distributions like…

This thesis analyze the Wasserstein gradient flow of a functional defined as a double convolution of a non-smooth repulsive interaction potential. To be more precise, the potential under investigation has a -|x| behavior close to the…

Analysis of PDEs · Mathematics 2013-10-15 Giovanni A. Bonaschi

Wasserstein Gradient Flow (WGF) describes the gradient dynamics of probability density within the Wasserstein space. WGF provides a promising approach for conducting optimization over the probability distributions. Numerically approximating…

Machine Learning · Computer Science 2024-06-04 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

We address the problem of sampling from terminally constrained distributions with pre-trained flow-based generative models through an optimal control formulation. Theoretically, we characterize the value function by a…

Machine Learning · Computer Science 2026-01-15 Weiguo Gao , Ming Li , Qianxiao Li

We investigate a stochastic program with expected value constraints, addressing the problem in a general context through Distributionally Robust Optimization (DRO) approach using Wasserstein distances, where the ambiguity set depends on the…

Optimization and Control · Mathematics 2023-04-18 Diego Fonseca , Mauricio Junca

We study the implicit regularization of mini-batch stochastic gradient descent, when applied to the fundamental problem of least squares regression. We leverage a continuous-time stochastic differential equation having the same moments as…

Machine Learning · Statistics 2020-06-23 Alnur Ali , Edgar Dobriban , Ryan J. Tibshirani

We study the JKO scheme for the total variation, characterize the optimizers, prove some of their qualitative properties (in particular a form of maximum principle and in some cases, a minimum principle as well). Finally, we establish a…

Analysis of PDEs · Mathematics 2018-07-09 Guillaume Carlier , Clarice Poon

Neuron models have attracted a lot of attention recently, both in mathematics and neuroscience. We are interested in studying long-time and large-population emerging properties in a simplified toy model. From a mathematical perspective,…

Probability · Mathematics 2024-01-31 Maxime Herda , Pierre Monmarché , Benoît Perthame

Inverse problems in physical or biological sciences often involve recovering an unknown parameter that is random. The sought-after quantity is a probability distribution of the unknown parameter, that produces data that aligns with…

Machine Learning · Statistics 2024-10-02 Qin Li , Maria Oprea , Li Wang , Yunan Yang

Model Updating is frequently used in Structural Health Monitoring to determine structures' operating conditions and whether maintenance is required. Data collected by sensors are used to update the values of some initially unknown…

Computation · Statistics 2024-01-23 Felipe Igea , Alice Cicirello

Despite the widespread success of Transformers across various domains, their optimization guarantees in large-scale model settings are not well-understood. This paper rigorously analyzes the convergence properties of gradient flow in…

Machine Learning · Statistics 2024-11-01 Cheng Gao , Yuan Cao , Zihao Li , Yihan He , Mengdi Wang , Han Liu , Jason Matthew Klusowski , Jianqing Fan

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

We study the modeling of a compressible two-phase flow in a porous medium. The governing free boundary problem is known as the Verigin problem with phase transition. We introduce a novel variational framework to construct weak solutions.…

Analysis of PDEs · Mathematics 2026-01-29 Anna Kubin , Tim Laux , Alice Marveggio

The performance of machine learning (ML) models critically depends on the quality and representativeness of the training data. In applications with multiple heterogeneous data generating sources, standard ML methods often learn spurious…

A simple model to handle the flow of people in emergency evacuation situations is considered: at every point x, the velocity U(x) that individuals at x would like to realize is given. Yet, the incompressibility constraint prevents this…

Analysis of PDEs · Mathematics 2010-02-04 Bertrand Maury , Aude Roudneff-Chupin , Filippo Santambrogio