English
Related papers

Related papers: SISTA: learning optimal transport costs under spar…

200 papers

Optimal transport (OT) is a powerful geometric and probabilistic tool for finding correspondences and measuring similarity between two distributions. Yet, its original formulation relies on the existence of a cost function between the…

Machine Learning · Statistics 2020-11-09 Ievgen Redko , Titouan Vayer , Rémi Flamary , Nicolas Courty

In this paper, we study the problem of distributed multi-agent optimization over a network, where each agent possesses a local cost function that is smooth and strongly convex. The global objective is to find a common solution that…

Optimization and Control · Mathematics 2020-03-11 Shi Pu , Angelia Nedić

Optimal transport (OT) based data analysis is often faced with the issue that the underlying cost function is (partially) unknown. This paper is concerned with the derivation of distributional limits for the empirical OT value when the cost…

Statistics Theory · Mathematics 2023-01-05 Shayan Hundrieser , Gilles Mordant , Christoph Alexander Weitkamp , Axel Munk

Stochastic optimization of engineering systems is often infeasible due to repeated evaluations of a computationally expensive, high-fidelity simulation. Bi-fidelity methods mitigate this challenge by leveraging a cheaper, approximate model…

Optimization and Control · Mathematics 2025-12-19 Thomas O. Dixon , Geoffrey F. Bomarito , James E. Warner , Alex A. Gorodetsky

We study Sinkhorn's algorithm for solving the entropically regularized optimal transport problem. Its iterate $\pi_{t}$ is shown to satisfy $H(\pi_{t}|\pi_{*})+H(\pi_{*}|\pi_{t})=O(t^{-1})$ where $H$ denotes relative entropy and $\pi_{*}$…

Optimization and Control · Mathematics 2025-04-08 Promit Ghosal , Marcel Nutz

Optimal transport (OT) formalizes the problem of finding an optimal coupling between probability measures given a cost matrix. The inverse problem of inferring the cost given a coupling is Inverse Optimal Transport (IOT). IOT is less well…

Machine Learning · Statistics 2022-06-22 Wei-Ting Chiu , Pei Wang , Patrick Shafto

We propose a new algorithm that uses an auxiliary neural network to express the potential of the optimal transport map between two data distributions. In the sequel, we use the aforementioned map to train generative networks. Unlike WGANs,…

Machine Learning · Computer Science 2020-04-21 Vaios Laschos , Jan Tinapp , Klaus Obermayer

In this paper, we consider a general stochastic optimization problem which is often at the core of supervised learning, such as deep learning and linear classification. We consider a standard stochastic gradient descent (SGD) method with a…

Machine Learning · Statistics 2018-12-27 Lam M. Nguyen , Nam H. Nguyen , Dzung T. Phan , Jayant R. Kalagnanam , Katya Scheinberg

In this work, we solve a discrete optimal transport problem in a nonuniform environment. To solve the optimal transport problem, we build the cost matrix and then use classical solvers for discrete optimal transport. The challenge is to…

Optimization and Control · Mathematics 2026-03-17 Luca Dieci , Daniyar Omarov

Optimal transport has been an essential tool for reconstructing dynamics from complex data. With the increasingly available multifaceted data, a system can often be characterized across multiple spaces. Therefore, it is crucial to maintain…

Optimization and Control · Mathematics 2024-06-06 Zixuan Cang , Yanxiang Zhao

This paper considers an online proximal-gradient method to track the minimizers of a composite convex function that may continuously evolve over time. The online proximal-gradient method is inexact, in the sense that: (i) it relies on an…

Optimization and Control · Mathematics 2020-04-24 Amirhossein Ajalloeian , Andrea Simonetto , Emiliano Dall'Anese

Stochastic gradient descent (SGD) provides a simple and efficient way to solve a broad range of machine learning problems. Here, we focus on distribution regression (DR), involving two stages of sampling: Firstly, we regress from…

Machine Learning · Statistics 2021-03-08 Nicole Mücke

The selection of beam orientations, which is a key step in radiation treatment planning, is particularly challenging for non-coplanar radiotherapy systems due to the large number of candidate beams. In this paper, we report progress on the…

Medical Physics · Physics 2017-10-17 Daniel O'Connor , Yevgen Voronenko , Dan Nguyen , Wotao Yin , Ke Sheng

Despite the development of numerous adaptive optimizers, tuning the learning rate of stochastic gradient methods remains a major roadblock to obtaining good practical performance in machine learning. Rather than changing the learning rate…

Machine Learning · Statistics 2019-09-27 Hunter Lang , Pengchuan Zhang , Lin Xiao

Human mobility forecasting in a city is of utmost importance to transportation and public safety, but with the process of urbanization and the generation of big data, intensive computing and determination of mobility pattern have become…

Machine Learning · Computer Science 2019-08-16 Hongnian Wang , Han Su

The Sinkhorn "distance", a variant of the Wasserstein distance with entropic regularization, is an increasingly popular tool in machine learning and statistical inference. However, the time and memory requirements of standard algorithms for…

Machine Learning · Statistics 2021-11-16 Jason Altschuler , Francis Bach , Alessandro Rudi , Jonathan Niles-Weed

Understanding the movement patterns of objects (e.g., humans and vehicles) in a city is essential for many applications, including city planning and management. This paper proposes a method for predicting future city-wide crowd flows by…

Machine Learning · Computer Science 2023-10-05 Chung Park , Junui Hong , Cheonbok Park , Taesan Kim , Minsung Choi , Jaegul Choo

Stochastic Gradient Descent (SGD) methods see many uses in optimization problems. Modifications to the algorithm, such as momentum-based SGD methods have been known to produce better results in certain cases. Much of this, however, is due…

Machine Learning · Computer Science 2025-04-22 Eric Lu

The cost-distance Steiner tree problem seeks a Steiner tree that minimizes the total congestion cost plus the weighted sum of source-sink delays. This problem arises as a subroutine in timing-constrained global routing with a linear delay…

Data Structures and Algorithms · Computer Science 2025-03-07 Stephan Held , Edgar Perner

This article proposes a new population-based optimization algorithm called the Tangent Search Algorithm (TSA) to solve optimization problems. The TSA uses a mathematical model based on the tangent function to move a given solution toward a…

Neural and Evolutionary Computing · Computer Science 2021-04-07 Abdesslem Layeb