English
Related papers

Related papers: Polyak-Lojasiewicz Inequality for Quadratically Re…

200 papers

Regularising the primal formulation of optimal transport (OT) with a strictly convex term leads to enhanced numerical complexity and a denser transport plan. Many formulations impose a global constraint on the transport plan, for instance…

Machine Learning · Computer Science 2023-10-05 Hugues Van Assel , Titouan Vayer , Remi Flamary , Nicolas Courty

Inverse optimal transport (OT) refers to the problem of learning the cost function for OT from observed transport plan or its samples. In this paper, we derive an unconstrained convex optimization formulation of the inverse OT problem,…

Machine Learning · Computer Science 2021-07-06 Shaojun Ma , Haodong Sun , Xiaojing Ye , Hongyuan Zha , Haomin Zhou

It is known that when minimizing smooth Polyak-{\L}ojasiewicz (PL) functions, momentum algorithms cannot significantly improve the convergence bound of gradient descent, contrasting with the acceleration phenomenon occurring in the strongly…

Optimization and Control · Mathematics 2026-02-11 Julien Hermant

The uniform quadratic optimizatin problem (UQ) is a nonconvex quadratic constrained quadratic programming (QCQP) sharing the same Hessian matrix. Based on the second-order cone programming (SOCP) relaxation, we establish a new sufficient…

Optimization and Control · Mathematics 2015-08-06 Shu Wang , Yong Xia

We present a block gradient ascent method for solving the quantum optimal transport problem with entropic regularisation similar to the algorithm proposed in [D. Feliciangeli, A. Gerolin, L. Portinale: J. Funct. Anal. 285 (2023), no. 4,…

Mathematical Physics · Physics 2025-03-25 Marvin Randig , Max von Renesse

We consider the conjecture proposed in Matsumoto, Zhang and Schiebinger (2022) suggesting that optimal transport with quadratic regularisation can be used to construct a graph whose discrete Laplace operator converges to the…

Analysis of PDEs · Mathematics 2022-12-02 Gilles Mordant , Stephen Zhang

In this paper, we study the convergence properties of the Stochastic Gradient Descent (SGD) method for finding a stationary point of a given objective function $J(\cdot)$. The objective function is not required to be convex. Rather, our…

Machine Learning · Statistics 2024-09-24 Rajeeva L. Karandikar , M. Vidyasagar

This paper studies the continuous-time dynamics of primal-dual algorithms for linearly constrained convex optimization problems and provides a quantitative convergence analysis using the Lyapunov functions. With the growing prevalence of…

Optimization and Control · Mathematics 2026-05-26 Chise Ishii , Yasushi Narushima

In this paper we study a second order dynamical system with variable coefficients in connection to the minimization problem of a smooth nonconvex function. The convergence of the trajectories generated by the dynamical system to a critical…

Optimization and Control · Mathematics 2025-10-21 Szilárd Csaba László

The objective in statistical Optimal Transport (OT) is to consistently estimate the optimal transport plan/map solely using samples from the given source and target marginal distributions. This work takes the novel approach of posing…

Machine Learning · Computer Science 2020-11-11 J. Saketha Nath , Pratik Jawanpuria

We study decentralized multiagent optimization over networks, modeled as undirected graphs. The optimization problem consists of minimizing a nonconvex smooth function plus a convex extended-value function, which enforces constraints or…

Optimization and Control · Mathematics 2024-12-13 Xiaokai Chen , Tianyu Cao , Gesualdo Scutari

The optimal transport problem for measures supported on non-Euclidean spaces has recently gained ample interest in diverse applications involving representation learning. In this paper, we focus on circular probability measures, i.e.,…

Machine Learning · Computer Science 2023-10-11 Rocio Diaz Martin , Ivan Medri , Yikun Bai , Xinran Liu , Kangbai Yan , Gustavo K. Rohde , Soheil Kolouri

In this paper, we derive a new linear convergence rate for the gradient method with fixed step lengths for non-convex smooth optimization problems satisfying the Polyak-Lojasiewicz (PL) inequality. We establish that the PL inequality is a…

Optimization and Control · Mathematics 2022-04-05 Hadi Abbaszadehpeivasti , Etienne de Klerk , Moslem Zamani

We study local linear convergence of gradient descent for finite-width feedforward networks under the squared empirical loss. Prior work shows that GD can remain confined to a Locally Quasi-Convex Region (LQCR) around initialization, but…

Machine Learning · Statistics 2026-05-29 Agnideep Aich , Ashit Baran Aich , Bruce Wade

Given samples from two joint distributions, we consider the problem of Optimal Transportation (OT) between them when conditioned on a common variable. We focus on the general setting where the conditioned variable may be continuous, and the…

Machine Learning · Computer Science 2024-06-12 Piyushi Manupriya , Rachit Keerti Das , Sayantan Biswas , Saketha Nath Jagarlapudi

Estimating optimal transport (OT) maps (a.k.a. Monge maps) between two measures $P$ and $Q$ is a problem fraught with computational and statistical challenges. A promising approach lies in using the dual potential functions obtained when…

Optimization and Control · Mathematics 2022-06-20 Aram-Alexandre Pooladian , Marco Cuturi , Jonathan Niles-Weed

Comparing time series in a principled manner requires capturing both temporal alignment and distributional similarity of features. Optimal transport (OT) has recently emerged as a powerful tool for this task, but existing OT-based…

Optimization and Control · Mathematics 2025-12-29 Thai P. D. Nguyen , Hong T. M. Chu , Kim-Chuan Toh

In this paper, we develop a regularized higher-order Taylor based method for solving composite (e.g., nonlinear least-squares) problems. At each iteration, we replace each smooth component of the objective function by a higher-order Taylor…

Optimization and Control · Mathematics 2025-03-05 Yassine Nabou , Ion Necoara

Regularizing the optimal transport (OT) problem has proven crucial for OT theory to impact the field of machine learning. For instance, it is known that regularizing OT problems with entropy leads to faster computations and better…

Machine Learning · Statistics 2020-08-04 François-Pierre Paty , Marco Cuturi

Lloyd's algorithm is an iterative method that solves the quantization problem, i.e. the approximation of a target probability measure by a discrete one, and is particularly used in digital applications. This algorithm can be interpreted as…

Optimization and Control · Mathematics 2026-05-14 Léo Portales , Elsa Cazelles , Edouard Pauwels
‹ Prev 1 4 5 6 7 8 10 Next ›