English
Related papers

Related papers: Fisher information regularization schemes for Wass…

200 papers

Policy optimization is a core component of reinforcement learning (RL), and most existing RL methods directly optimize parameters of a policy based on maximizing the expected total reward, or its surrogate. Though often achieving…

Machine Learning · Computer Science 2018-08-10 Ruiyi Zhang , Changyou Chen , Chunyuan Li , Lawrence Carin

We present a discretization-free scalable framework for solving a large class of mass-conserving partial differential equations (PDEs), including the time-dependent Fokker-Planck equation and the Wasserstein gradient flow. The main…

Machine Learning · Computer Science 2023-11-15 Lingxiao Li , Samuel Hurault , Justin Solomon

Data-driven distributionally robust optimization is a recently emerging paradigm aimed at finding a solution that is driven by sample data but is protected against sampling errors. An increasingly popular approach, known as Wasserstein…

Optimization and Control · Mathematics 2022-07-20 Jonathan Yu-Meng Li , Tiantian Mao

Since the early nineties, it has been observed that the Schroedinger bridge problem can be formulated as a stochastic control problem with atypical boundary constraints. This in turn has a fluid dynamic counterpart where the flow of…

Probability · Mathematics 2016-01-20 Yongxin Chen , Tryphon Georgiou , Michele Pavon

The sliced Wasserstein flow (SWF), a nonparametric and implicit generative gradient flow, is transformed into a Liouville partial differential equation (PDE)-based formalism. First, the stochastic diffusive term from the Fokker-Planck…

Machine Learning · Statistics 2026-05-12 Jayshawn Cooper , Pilhwa Lee

We employ the principle of minimum pressure gradient to transform problems in unsteady computational fluid dynamics (CFD) into a convex optimization framework subject to linear constraints. This formulation permits solving, for the first…

Fluid Dynamics · Physics 2025-01-15 Hussam Sababha , Haithem Taha , Mohammed Daqaq

The dynamics of two variants of quantum Fisher information under decoherence are investigated from a geometrical point of view. We first derive the explicit formulas of these two quantities for a single qubit in terms of the Bloch vector.…

Quantum Physics · Physics 2013-02-27 Wei Zhong , Zhe Sun , Jian Ma , Xiaoguang Wang , Franco Nori

We study a natural Wasserstein gradient flow on manifolds of probability distributions with discrete sample spaces. We derive the Riemannian structure for the probability simplex from the dynamical formulation of the Wasserstein distance on…

Optimization and Control · Mathematics 2021-04-19 Wuchen Li , Guido Montufar

We show that the continuous-time gradient descent in Rn can be viewed as an optimal controlled evolution for a suitable action functional; a similar result holds for stochastic gradient descent. We then provide an analogous characterization…

Optimization and Control · Mathematics 2025-11-03 Yongxin Chen , Tryphon Georgiou , Michele Pavon

Distributionally Robust Optimization (DRO) is a popular framework for decision-making under uncertainty, but its adversarial nature can lead to overly conservative solutions. To address this, we study ex-ante Distributionally Robust Regret…

Optimization and Control · Mathematics 2025-04-22 Lukas-Benedikt Fiechtner , Jose Blanchet

We consider the problem of sampling from a probability distribution $\pi$. It is well known that this can be written as an optimisation problem over the space of probability distributions in which we aim to minimise the Kullback--Leibler…

Machine Learning · Statistics 2026-04-23 Francesca Romana Crucinio , Sahani Pathiraja

The purpose of this work is mostly expository and aims to elucidate the Jordan-Kinderlehrer-Otto (JKO) scheme for uncertainty propagation, and a variant, the Laugesen-Mehta-Meyn-Raginsky (LMMR) scheme for filtering. We point out that these…

Optimization and Control · Mathematics 2017-10-03 Abhishek Halder , Tryphon T. Georgiou

In this thesis, we consider the Wasserstein barycenter problem of discrete probability measures from computational and statistical sides. The statistical focus is estimating the sample size of measures necessary to calculate an…

Optimization and Control · Mathematics 2021-10-26 Darina Dvinskikh

Applications such as adversarially robust training and Wasserstein Distributionally Robust Optimization (WDRO) can be naturally formulated as min-sum-max optimization problems. While this formulation can be rewritten as an equivalent…

Optimization and Control · Mathematics 2025-02-26 Wei Liu , Muhammad Khan , Gabriel Mancino-Ball , Yangyang Xu

We propose novel algorithms combining accelerated gradient flows with linearized projection-free treatments of non-convex constraints and BDF pseudo-temporal discretization for quadratic energy minimization. A general framework is developed…

Numerical Analysis · Mathematics 2025-06-13 Guozhi Dong , Zikang Gong , Ziqing Xie , Shuo Yang

Natural gradient descent is an optimization method traditionally motivated from the perspective of information geometry, and works well for many applications as an alternative to stochastic gradient descent. In this paper we critically…

Machine Learning · Computer Science 2020-09-22 James Martens

Wasserstein \textbf{D}istributionally \textbf{R}obust \textbf{O}ptimization (DRO) is concerned with finding decisions that perform well on data that are drawn from the worst-case probability distribution within a Wasserstein ball centered…

Optimization and Control · Mathematics 2020-10-27 Jiajin Li , Caihua Chen , Anthony Man-Cho So

We consider a class of optimization problems on the space of probability measures motivated by the mean-field approach to studying neural networks. Such problems can be solved by constructing continuous-time gradient flows that converge to…

Optimization and Control · Mathematics 2026-02-18 Petra Lazić , Linshan Liu , Mateusz B. Majka

Wasserstein barycenters provide a geometric notion of the weighted average of probability measures based on optimal transport. In this paper, we present a scalable algorithm to compute Wasserstein-2 barycenters given sample access to the…

Machine Learning · Computer Science 2022-01-02 Alexander Korotin , Lingxiao Li , Justin Solomon , Evgeny Burnaev

We derive a new variational principle for the quantum Fisher information leading to a simple iterative alternating algorithm, the convergence of which is proved. The case of a fixed measurement, i.e. the classical Fisher information, is…

Quantum Physics · Physics 2013-12-06 Katarzyna Macieszczak