English
Related papers

Related papers: On the Relation between Rectified Flows and Optima…

200 papers

Flow models have rapidly become the go-to method for training and deploying large-scale generators, owing their success to inference-time flexibility via adjustable integration steps. A crucial ingredient in flow training is the choice of…

Existing analyses of optimization in deep learning are either continuous, focusing on (variants of) gradient flow, or discrete, directly treating (variants of) gradient descent. Gradient flow is amenable to theoretical analysis, but is…

Machine Learning · Computer Science 2021-12-30 Omer Elkabetz , Nadav Cohen

We present theoretical and numerical results concerning the problem to find the path that minimizes the time to navigate between two given points in a complex fluid under realistic navigation constraints. We contrast deterministic Optimal…

Systems and Control · Electrical Eng. & Systems 2021-03-02 Michele Buzzicotti , Luca Biferale , Fabio Bonaccorso , Patricio Clark di Leoni , Kristian Gustavsson

This paper proposes novel gradient-flow schemes that yield convergence to the optimal point of a convex optimization problem within a \textit{fixed} time from any given initial condition for unconstrained optimization, constrained…

Optimization and Control · Mathematics 2022-04-27 Kunal Garg , Dimitra Panagou

We introduce the proximal optimal transport divergence, a novel discrepancy measure that interpolates between information divergences and optimal transport distances via an infimal convolution formulation. This divergence provides a…

Optimization and Control · Mathematics 2025-08-11 Ricardo Baptista , Panagiota Birmpa , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang

We develop a theory of optimal transport for stationary random measures with a focus on stationary point processes and construct a family of distances on the set of stationary random measures. These induce a natural notion of interpolation…

Probability · Mathematics 2024-02-02 Matthias Erbar , Martin Huesmann , Jonas Jalowy , Bastian Müller

This article introduces a new class of fast algorithms to approximate variational problems involving unbalanced optimal transport. While classical optimal transport considers only normalized probability distributions, it is important for…

Optimization and Control · Mathematics 2017-05-23 Lenaic Chizat , Gabriel Peyré , Bernhard Schmitzer , François-Xavier Vialard

The future motion of traffic participants is inherently uncertain. To plan safely, therefore, an autonomous agent must take into account multiple possible trajectory outcomes and prioritize them. Recently, this problem has been addressed…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Christoph Schöller , Alois Knoll

In this paper, we propose a flow-based method for learning all-to-all transfer maps among conditional distributions that approximates pairwise optimal transport. The proposed method addresses the challenge of handling the case of continuous…

Machine Learning · Computer Science 2025-10-29 Kotaro Ikeda , Masanori Koyama , Jinzhe Zhang , Kohei Hayashi , Kenji Fukumizu

Computing optimal transport (OT) for general high-dimensional data has been a long-standing challenge. Despite much progress, most of the efforts including neural network methods have been focused on the static formulation of the OT…

Machine Learning · Statistics 2025-03-12 Chen Xu , Xiuyuan Cheng , Yao Xie

This paper presents a methodology and numerical algorithms for constructing accelerated gradient flows on the space of probability distributions. In particular, we extend the recent variational formulation of accelerated gradient methods in…

Machine Learning · Computer Science 2019-01-14 Amirhossein Taghvaei , Prashant G. Mehta

This paper presents a novel two-step approach for the fundamental problem of learning an optimal map from one distribution to another. First, we learn an optimal transport (OT) plan, which can be thought as a one-to-many map between the two…

Imitation learning is a promising approach for enabling generalist capabilities in humanoid robots, but its scaling is fundamentally constrained by the scarcity of high-quality expert demonstrations. This limitation can be mitigated by…

Robotics · Computer Science 2025-08-21 Quentin Rouxel , Clemente Donoso , Fei Chen , Serena Ivaldi , Jean-Baptiste Mouret

The scarcity of labeled data is a long-standing challenge for many machine learning tasks. We propose our gradient flow method to leverage the existing dataset (i.e., source) to generate new samples that are close to the dataset of interest…

Machine Learning · Computer Science 2023-11-06 Xinru Hua , Truyen Nguyen , Tam Le , Jose Blanchet , Viet Anh Nguyen

Flow matching casts sample generation as learning a continuous-time velocity field that transports noise to data. Existing flow matching networks typically predict each point's velocity independently, considering only its location and time…

Machine Learning · Computer Science 2025-11-11 Md Shahriar Rahim Siddiqui , Moshe Eliasof , Eldad Haber

We study dynamic measure transport for generative modeling: specifically, flows induced by stochastic processes that bridge a specified source and target distribution. The conditional expectation of the process' velocity defines an ODE…

Machine Learning · Computer Science 2025-12-12 Panos Tsimpos , Youssef Marzouk

Normalizing flows are constructed from a base distribution with a known density and a diffeomorphism with a tractable Jacobian. The base density of a normalizing flow can be parameterised by a different normalizing flow, thus allowing maps…

Machine Learning · Computer Science 2022-11-07 Samuel Klein , John Andrew Raine , Tobias Golling

Sampling from high-dimensional distributions is a fundamental problem in statistical research and practice. However, great challenges emerge when the target density function is unnormalized and contains isolated modes. We tackle this…

Methodology · Statistics 2023-04-11 Yixuan Qiu , Xiao Wang

Diffusion and flow-based generative models have achieved remarkable success in domains such as image synthesis, video generation, and natural language modeling. In this work, we extend these advances to weight space learning by leveraging…

Machine Learning · Computer Science 2025-10-17 Daniel Saragih , Deyu Cao , Tejas Balaji

Due to climate change the frequency and intensity of extreme rainfall events, which contribute to urban flooding, are expected to increase in many places. These floods can damage transport infrastructure and disrupt mobility, highlighting…

Machine Learning · Computer Science 2024-12-02 Miguel Costa , Morten W. Petersen , Arthur Vandervoort , Martin Drews , Karyn Morrissey , Francisco C. Pereira