English
Related papers

Related papers: Overrelaxed Sinkhorn-Knopp Algorithm for Regulariz…

200 papers

We describe a convergence acceleration technique for unconstrained optimization problems. Our scheme computes estimates of the optimum from a nonlinear average of the iterates produced by any optimization method. The weights in this average…

Optimization and Control · Mathematics 2019-04-16 Damien Scieur , Alexandre d'Aspremont , Francis Bach

In multiple target tracking, it is important to be able to evaluate the performance of different tracking algorithms. The trajectory generalized optimal sub-pattern assignment metric (TGOSPA) is a recently proposed metric for such…

Optimization and Control · Mathematics 2025-05-23 Viktor Nevelius Wernholm , Alfred Wärnsäter , Axel Ringh

We examine a wide class of stochastic approximation algorithms for solving (stochastic) nonlinear problems on Riemannian manifolds. Such algorithms arise naturally in the study of Riemannian optimization, game theory and optimal transport,…

Optimization and Control · Mathematics 2022-12-29 Mohammad Reza Karimi , Ya-Ping Hsieh , Panayotis Mertikopoulos , Andreas Krause

Navigating a collision-free and optimal trajectory for a robot is a challenging task, particularly in environments with moving obstacles such as humans. We formulate this problem as a stochastic optimal control problem. Since solving the…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Seyyed Reza Jafari , Anders Hansson , Bo Wahlberg

We consider stochastic gradient methods under the interpolation regime where a perfect fit can be obtained (minimum loss at each observation). While previous work highlighted the implicit regularization of such algorithms, we consider an…

Optimization and Control · Mathematics 2020-04-01 Anant Raj , Francis Bach

This paper presents a novel convex optimization-based method for finding the globally optimal solutions of a class of mixed-integer non-convex optimal control problems. We consider problems with non-convex constraints that restrict the…

Optimization and Control · Mathematics 2019-11-21 Danylo Malyuta , Behcet Acikmese

Optimal transport on a graph focuses on finding the most efficient way to transfer resources from one distribution to another while considering the graph's structure. This paper introduces a new distributed algorithm that solves the optimal…

Optimization and Control · Mathematics 2025-07-08 Yacine Mokhtari , Emmanuel Moulay , Patrick Coirault , Jérôme Le Ny

Stochastic variance reduced optimization methods are known to be globally convergent while they suffer from slow local convergence, especially when moderate or high accuracy is needed. To alleviate this problem, we propose an optimization…

Optimization and Control · Mathematics 2021-11-15 Hamed Sadeghi , Pontus Giselsson

We derive limit distributions for certain empirical regularized optimal transport distances between probability distributions supported on a finite metric space and show consistency of the (naive) bootstrap. In particular, we prove that the…

Statistics Theory · Mathematics 2019-05-02 Marcel Klatt , Carla Tameling , Axel Munk

Solving point-wise feature correspondence in visual data is a fundamental problem in computer vision. A powerful model that addresses this challenge is to formulate it as graph matching, which entails solving a Quadratic Assignment Problem…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Yongqing Liang , Huijun Han , Xin Li

In this paper, we propose a randomized accelerated method for the minimization of a strongly convex function under linear constraints. The method is of Kaczmarz-type, i.e. it only uses a single linear equation in each iteration. To obtain…

Optimization and Control · Mathematics 2025-04-03 Lionel Tondji , Dirk A. Lorenz , Ion Necoara

Replacing positivity constraints by an entropy barrier is popular to approximate solutions of linear programs. In the special case of the optimal transport problem, this technique dates back to the early work of Schr\"odinger. This approach…

Analysis of PDEs · Mathematics 2017-01-10 Guillaume Carlier , Vincent Duval , Gabriel Peyré , Bernhard Schmitzer

The optimal transport (OT) problem can be reduced to a linear programming (LP) problem through discretization. In this paper, we introduced the random block coordinate descent (RBCD) methods to directly solve this LP problem. Our approach…

Optimization and Control · Mathematics 2023-11-27 Yue Xie , Zhongjian Wang , Zhiwen Zhang

We propose a unifying algorithm for non-smooth non-convex optimization. The algorithm approximates the objective function by a convex model function and finds an approximate (Bregman) proximal point of the convex model. This approximate…

Optimization and Control · Mathematics 2018-06-27 Peter Ochs , Jalal Fadili , Thomas Brox

Despite impressive results, reinforcement learning (RL) suffers from slow convergence and requires a large variety of tuning strategies. In this paper, we investigate the ability of RL algorithms on simple continuous control tasks. We show…

Robotics · Computer Science 2024-02-16 Daniel Layeghi , Steve Tonneau , Michael Mistry

We propose a new approach to graph compression by appeal to optimal transport. The transport problem is seeded with prior information about node importance, attributes, and edges in the graph. The transport formulation can be setup for…

Machine Learning · Computer Science 2019-05-30 Vikas K. Garg , Tommi Jaakkola

In this work we develop a numerical method for solving a type of convex graph-structured tensor optimization problems. This type of problems, which can be seen as a generalization of multi-marginal optimal transport problems with…

Optimization and Control · Mathematics 2024-03-25 Axel Ringh , Isabel Haasler , Yongxin Chen , Johan Karlsson

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

Numerical Analysis · Computer Science 2017-10-18 Hiva Ghanbari , Katya Scheinberg

In this work, the authors address the Optimal Transport (OT) problem on graphs using a proximal stabilized Interior Point Method (IPM). In particular, strongly leveraging on the induced primal-dual regularization, the authors propose to…

Optimization and Control · Mathematics 2023-07-12 Stefano Cipolla , Jacek Gondzio , Filippo Zanetti

Entropic optimal transport problems are regularized versions of optimal transport problems. These models play an increasingly important role in machine learning and generative modelling. For finite spaces, these problems are commonly solved…

Machine Learning · Statistics 2025-12-30 O. Deniz Akyildiz , Pierre Del Moral , Joaquín Miguez