English
Related papers

Related papers: Dual Block Gradient Ascent for Entropically Regula…

200 papers

We pose the Kantorovich optimal transport problem as a min-max problem with a Nash equilibrium that can be obtained dynamically via a two-player game, providing a framework for approximating optimal couplings. We prove convergence of the…

Optimization and Control · Mathematics 2025-05-28 Lauren Conger , Franca Hoffmann , Ricardo Baptista , Eric Mazumdar

We develop a novel unified randomized block-coordinate primal-dual algorithm to solve a class of nonsmooth constrained convex optimization problems, which covers different existing variants and model settings from the literature. We prove…

Optimization and Control · Mathematics 2021-10-29 Quoc Tran-Dinh , Deyi Liu

This paper investigates the semi-discrete optimal transport (OT) problem with entropic regularization. We characterize the solution using a governing, well-posed ordinary differential equation (ODE). This naturally yields an algorithm to…

Numerical Analysis · Mathematics 2025-04-07 Luca Nenna , Daniyar Omarov , Brendan Pass

We present an efficient and robust numerical algorithm for solving the two-dimensional linear elasticity problem that combines the Quantized Tensor Train format and a domain partitioning strategy. This approach makes it possible to solve…

Numerical Analysis · Mathematics 2025-01-15 Elena Benvenuti , Gianmarco Manzini , Marco Nale , Simone Pizzolato

We propose and analyze an accelerated iterative dual diagonal descent algorithm for the solution of linear inverse problems with general regularization and data-fit functions. In particular, we develop an inertial approach of which we…

Optimization and Control · Mathematics 2023-12-25 Luca Calatroni , Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

The estimation of correspondences between two images resp. point sets is a core problem in computer vision. One way to formulate the problem is graph matching leading to the quadratic assignment problem which is NP-hard. Several so called…

Computer Vision and Pattern Recognition · Computer Science 2015-05-01 Quynh Nguyen , Antoine Gautier , Matthias Hein

The optimal transport (OT) problem is a classical optimization problem having the form of linear programming. Machine learning applications put forward new computational challenges in its solution. In particular, the OT problem defines a…

Optimization and Control · Mathematics 2022-10-25 Nazarii Tupitsa , Pavel Dvurechensky , Darina Dvinskikh , Alexander Gasnikov

Many research has been conducted about quadratic programming and inverse optimization. In this paper we present the combination aspect of these subjects, applying on transportation problem. First, we obtain the inverse form of quadratic…

Optimization and Control · Mathematics 2014-09-25 Afrooz Jalilzadeh , Erfan Yazdandoost Hamedani

Following [21, 23], the present work investigates a new relative entropy-regularized algorithm for solving the optimal transport on a graph problem within the randomized shortest paths formalism. More precisely, a unit flow is injected into…

Machine Learning · Computer Science 2021-09-21 Sylvain Courtain , Guillaume Guex , Ilkka Kivimaki , Marco Saerens

Motivated, in particular, by the entropy-regularized optimal transport problem, we consider convex optimization problems with linear equality constraints, where the dual objective has Lipschitz $p$-th order derivatives, and develop two…

Optimization and Control · Mathematics 2023-08-11 Pavel Dvurechensky , Petr Ostroukhov , Alexander Gasnikov , César A. Uribe , Anastasiya Ivanova

This note aims to demonstrate that performing maximum-likelihood estimation for a mixture model is equivalent to minimizing over the parameters an optimal transport problem with entropic regularization. The objective is pedagogical: we seek…

Machine Learning · Statistics 2025-01-24 Titouan Vayer , Etienne Lasalle

We investigate the problem of optimal transport in the so-called Kantorovich form, i.e. given two Radon measures on two compact sets, we seek an optimal transport plan which is another Radon measure on the product of the sets that has these…

Optimization and Control · Mathematics 2019-09-10 Dirk A. Lorenz , Paul Manns , Christian Meyer

We study the convergence of divergence-regularized optimal transport as the regularization parameter vanishes. Sharp rates for general divergences including relative entropy or $L^{p}$ regularization, general transport costs and…

Optimization and Control · Mathematics 2023-06-22 Stephan Eckstein , Marcel Nutz

We present a gradient-based optimal-control technique for open quantum systems that utilizes quantum trajectories to simulate the quantum dynamics during optimization. Using trajectories allows for optimizing open systems with less…

Quantum Physics · Physics 2019-06-03 Mohamed Abdelhafez , David I. Schuster , Jens Koch

We study the so-called distributed two-time-scale gradient method for solving convex optimization problems over a network of agents when the communication bandwidth between the nodes is limited, and so information that is exchanged between…

Systems and Control · Electrical Eng. & Systems 2021-06-01 Marcos M. Vasconcelos , Thinh T. Doan , Urbashi Mitra

Gradient descent method, as one of the major methods in numerical optimization, is the key ingredient in many machine learning algorithms. As one of the most fundamental way to solve the optimization problems, it promises the function value…

Quantum Physics · Physics 2021-02-01 Keren Li , Shijie Wei , Feihao Zhang , Pan Gao , Zengrong Zhou , Tao Xin , Xiaoting Wang , Guilu Long

Optimal transport has emerged as a fundamental methodology with applications spanning multiple research areas in recent years. However, the convergence rate of the empirical estimator to its population counterpart suffers from the curse of…

Statistics Theory · Mathematics 2025-10-06 Jiaping Yang , Yunxin Zhang

In this work, we revisit a classical incremental implementation of the primal-descent dual-ascent gradient method used for the solution of equality constrained optimization problems. We provide a short proof that establishes the linear…

Optimization and Control · Mathematics 2020-01-17 Sulaiman A. Alghunaim , Ali H. Sayed

We investigate a distributed optimization problem over a cooperative multi-agent time-varying network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

Optimization and Control · Mathematics 2018-05-24 Chuanye Gu , Zhiyou Wu , Jueyou Li

This paper studies the equitable and optimal transport (EOT) problem, which has many applications such as fair division problems and optimal transport with multiple agents etc. In the discrete distributions case, the EOT problem can be…

Optimization and Control · Mathematics 2021-10-04 Minhui Huang , Shiqian Ma , Lifeng Lai