English
Related papers

Related papers: Fixed-Point Neural Optimal Transport without Impli…

200 papers

We provide a framework for computing the exact worst-case performance of any algorithm belonging to a broad class of oracle-based first-order methods for composite convex optimization, including those performing explicit, projected,…

Optimization and Control · Mathematics 2019-11-22 Adrien B. Taylor , Julien M. Hendrickx , François Glineur

Optimal Transport (OT) problems are a cornerstone of many applications, but solving them is computationally expensive. To address this problem, we propose UNOT (Universal Neural Optimal Transport), a novel framework capable of accurately…

Machine Learning · Computer Science 2026-02-11 Jonathan Geuter , Gregor Kornhardt , Ingimar Tomasson , Vaios Laschos

We propose an algorithm for inexpensive gradient-based hyperparameter optimization that combines the implicit function theorem (IFT) with efficient inverse Hessian approximations. We present results about the relationship between the IFT…

Machine Learning · Computer Science 2019-11-11 Jonathan Lorraine , Paul Vicol , David Duvenaud

This paper considers the decentralized convex optimization problem, which has a wide range of applications in large-scale machine learning, sensor networks, and control theory. We propose novel algorithms that achieve optimal computation…

Machine Learning · Computer Science 2023-10-11 Haishan Ye , Luo Luo , Ziang Zhou , Tong Zhang

We present a self-contained analysis of a particular family of metrics over the set of non-negative integers. We show that these metrics, which are defined through a nested sequence of optimal transport problems, provide tight estimates for…

Optimization and Control · Mathematics 2022-04-21 Mario Bravo , Thierry Champion , Roberto Cominetti

Recent studies have demonstrated the vulnerability of deep convolutional neural networks against adversarial examples. Inspired by the observation that the intrinsic dimension of image data is much smaller than its pixel space dimension and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Yao Li , Martin Renqiang Min , Wenchao Yu , Cho-Jui Hsieh , Thomas C. M. Lee , Erik Kruus

We propose a \textbf{uni}fied \textbf{f}ramework for \textbf{i}mplicit \textbf{ge}nerative \textbf{m}odeling (UnifiGem) with theoretical guarantees by integrating approaches from optimal transport, numerical ODE, density-ratio…

Machine Learning · Computer Science 2020-02-18 Yuan Gao , Jian Huang , Yuling Jiao , Jin Liu

In this paper, we study the decentralized optimization problem of minimizing a finite sum of continuously differentiable and possibly nonconvex functions over a fixed-connected undirected network. We propose a unified decentralized…

Optimization and Control · Mathematics 2026-04-14 Hao Wu , Liping Wang

Primal-dual interior-point methods solve constrained convex optimization problems to tight tolerances with speed and robustness. Their solutions are also efficiently differentiable with respect to the problem data through the implicit…

Optimization and Control · Mathematics 2026-05-19 Jon Arrizabalaga , Kevin Tracy , Zachary Manchester

Neural networks trained with standard objectives exhibit behaviors characteristic of probabilistic inference: soft clustering, prototype specialization, and Bayesian uncertainty tracking. These phenomena appear across architectures -- in…

Machine Learning · Computer Science 2026-01-01 Alan Oursland

To improve the performance of classical generative adversarial network (GAN), Wasserstein generative adversarial networks (W-GAN) was developed as a Kantorovich dual formulation of the optimal transport (OT) problem using Wasserstein-1…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Byeongsu Sim , Gyutaek Oh , Jeongsol Kim , Chanyong Jung , Jong Chul Ye

Optimal transport is a powerful framework for the efficient allocation of resources between sources and targets. However, traditional models often struggle to scale effectively in the presence of large and heterogeneous populations. In this…

Artificial Intelligence · Computer Science 2024-11-13 Navpreet Kaur , Juntao Chen , Yingdong Lu

We provide a framework to approximate the 2-Wasserstein distance and the optimal transport map, amenable to efficient training as well as statistical and geometric analysis. With the quadratic cost and considering the Kantorovich dual form…

Optimization and Control · Mathematics 2019-02-20 Amirhossein Taghvaei , Amin Jalali

Semidiscrete optimal transport is a challenging generalization of the classical transportation problem in linear programming. The goal is to design a joint distribution for two random variables (one continuous, one discrete) with fixed…

Econometrics · Economics 2026-01-22 Yinchu Zhu , Ilya O. Ryzhov

This paper develops a unified distributed method for solving two classes of constrained networked optimization problems, i.e., optimal consensus problem and resource allocation problem with non-identical set constraints. We first transform…

Optimization and Control · Mathematics 2023-07-17 Yi Huang , Ziyang Meng , Jian Sun , Wei Ren

This paper proposes novel gradient-flow schemes that yield convergence to the optimal point of a convex optimization problem within a \textit{fixed} time from any given initial condition for unconstrained optimization, constrained…

Optimization and Control · Mathematics 2022-04-27 Kunal Garg , Dimitra Panagou

We present a novel neural-networks-based algorithm to compute optimal transport maps and plans for strong and weak transport costs. To justify the usage of neural networks, we prove that they are universal approximators of transport plans…

Machine Learning · Computer Science 2023-03-02 Alexander Korotin , Daniil Selikhanovych , Evgeny Burnaev

Inverse optimal transport (OT) refers to the problem of learning the cost function for OT from observed transport plan or its samples. In this paper, we derive an unconstrained convex optimization formulation of the inverse OT problem,…

Machine Learning · Computer Science 2021-07-06 Shaojun Ma , Haodong Sun , Xiaojing Ye , Hongyuan Zha , Haomin Zhou

We consider a generic decentralized constrained optimization problem over static, directed communication networks, where each agent has exclusive access to only one convex, differentiable, local objective term and one convex constraint set.…

Optimization and Control · Mathematics 2023-11-09 Firooz Shahriari-Mehr , Ashkan Panahi

This paper connects discrete optimal transport to a certain class of multi-objective optimization problems. In both settings, the decision variables can be organized into a matrix. In the multi-objective problem, the notion of Pareto…

Optimization and Control · Mathematics 2017-12-04 Johannes M. Schumacher