English
Related papers

Related papers: Learn to Evolve: Self-supervised Neural JKO Operat…

200 papers

In this article we set up a splitting variant of the JKO scheme in order to handle gradient flows with respect to the Kantorovich-Fisher-Rao metric, recently introduced and defined on the space of positive Radon measure with varying masses.…

Analysis of PDEs · Mathematics 2018-05-08 Thomas Gallouët , Léonard Monsaingeon

Applications such as adversarially robust training and Wasserstein Distributionally Robust Optimization (WDRO) can be naturally formulated as min-sum-max optimization problems. While this formulation can be rewritten as an equivalent…

Optimization and Control · Mathematics 2025-02-26 Wei Liu , Muhammad Khan , Gabriel Mancino-Ball , Yangyang Xu

We study distributionally robust online learning, where a risk-averse learner updates decisions sequentially to guard against worst-case distributions drawn from a Wasserstein ambiguity set centered at past observations. While this paradigm…

Machine Learning · Computer Science 2026-02-25 Guixian Chen , Salar Fattahi , Soroosh Shafiee

This paper develops a generative model by minimizing the second-order Wasserstein loss (the $W_2$ loss) through a distribution-dependent ordinary differential equation (ODE), whose dynamics involves the Kantorovich potential associated with…

Machine Learning · Statistics 2026-05-14 Yu-Jui Huang , Zachariah Malik

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

Machine Learning · Computer Science 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos

Diffusion models and flow-based methods have shown impressive generative capability, especially for images, but their sampling is expensive because it requires many iterative updates. We introduce W-Flow, a framework for training a…

Machine Learning · Computer Science 2026-05-28 Jiaqi Han , Puheng Li , Qiushan Guo , Renyuan Xu , Stefano Ermon , Emmanuel J. Candès

In this work, we investigate the use of data-driven equation discovery for dynamical systems to model and forecast continuous-time dynamics of unconstrained optimization problems. To avoid expensive evaluations of the objective function and…

Optimization and Control · Mathematics 2026-02-19 Grant Norman , Conor Rowan , Kurt Maute , Alireza Doostan

Learning dynamics governed by differential equations is crucial for predicting and controlling the systems in science and engineering. Neural Ordinary Differential Equation (NODE), a deep learning model integrated with differential…

Machine Learning · Computer Science 2021-11-09 Shiqi Gong , Qi Meng , Yue Wang , Lijun Wu , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

We introduce an encoder-only approach to learn the evolution operators of large-scale non-linear dynamical systems, such as those describing complex natural phenomena. Evolution operators are particularly well-suited for analyzing systems…

Machine Learning · Computer Science 2025-05-27 Giacomo Turri , Luigi Bonati , Kai Zhu , Massimiliano Pontil , Pietro Novelli

Accurately predicting turbulent flows remains a central challenge in fluid dynamics due to their high dimensionality and intrinsic nonlinearity. Recent developments in quantum algorithms and machine learning offer new opportunities for…

Fluid Dynamics · Physics 2025-11-25 Han Li , Yutong Lou , Dunhui Xiao

Combining the classical theory of optimal transport with modern operator splitting techniques, we develop a new numerical method for nonlinear, nonlocal partial differential equations, arising in models of porous media, materials science,…

Numerical Analysis · Mathematics 2021-02-09 Jose A. Carrillo , Katy Craig , Li Wang , Chaozhen Wei

Transfer learning is a popular strategy to leverage external knowledge and improve statistical efficiency, particularly with a limited target sample. We propose a novel knowledge-guided Wasserstein Distributionally Robust Optimization…

Machine Learning · Computer Science 2025-02-13 Zitao Wang , Ziyuan Wang , Molei Liu , Nian Si

Gradient boosting is a sequential ensemble method that fits a new weaker learner to pseudo residuals at each iteration. We propose Wasserstein gradient boosting, a novel extension of gradient boosting that fits a new weak learner to…

Methodology · Statistics 2024-08-30 Takuo Matsubara

In the learning to learn (L2L) framework, we cast the design of optimization algorithms as a machine learning problem and use deep neural networks to learn the update rules. In this paper, we extend the L2L framework to zeroth-order (ZO)…

Machine Learning · Computer Science 2020-02-10 Yangjun Ruan , Yuanhao Xiong , Sashank Reddi , Sanjiv Kumar , Cho-Jui Hsieh

Wasserstein-Fisher-Rao (WFR) gradient flows have been recently proposed as a powerful sampling tool that combines the advantages of pure Wasserstein (W) and pure Fisher-Rao (FR) gradient flows. Existing algorithmic developments implicitly…

Machine Learning · Statistics 2026-03-02 Francesca Romana Crucinio , Sahani Pathiraja

The Wasserstein gradient flow structure of the PDE system governing multiphase flows in porous media was recently highlighted in [C. Canc\`es, T. O. Gallou\"et, and L. Monsaingeon, {\it Anal. PDE} 10(8):1845--1876, 2017]. The model can thus…

Numerical Analysis · Mathematics 2018-07-23 Clément Cancès , Thomas O. Gallouët , Maxime Laborde , Léonard Monsaingeon

Wasserstein distance-based distributionally robust optimization (DRO) has received much attention lately due to its ability to provide a robustness interpretation of various learning models. Moreover, many of the DRO problems that arise in…

Optimization and Control · Mathematics 2019-10-29 Jiajin Li , Sen Huang , Anthony Man-Cho So

We show that the continuous-time gradient descent in Rn can be viewed as an optimal controlled evolution for a suitable action functional; a similar result holds for stochastic gradient descent. We then provide an analogous characterization…

Optimization and Control · Mathematics 2025-11-03 Yongxin Chen , Tryphon Georgiou , Michele Pavon

Depth estimation and scene segmentation are two important tasks in intelligent transportation systems. A joint modeling of these two tasks will reduce the requirement for both the storage and training efforts. This work explores how the…

Machine Learning · Computer Science 2025-05-16 Tiancong Cheng , Ying Zhang , Yuxuan Liang , Roger Zimmermann , Zhiwen Yu , Bin Guo

We formulate well-posed continuous-time generative flows for learning distributions that are supported on low-dimensional manifolds through Wasserstein proximal regularizations of $f$-divergences. Wasserstein-1 proximal operators regularize…

Machine Learning · Statistics 2024-07-17 Hyemin Gu , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang