English
Related papers

Related papers: Overrelaxed Sinkhorn-Knopp Algorithm for Regulariz…

200 papers

Many classical and modern machine learning algorithms require solving optimization tasks under orthogonality constraints. Solving these tasks with feasible methods requires a gradient descent update followed by a retraction operation on the…

Optimization and Control · Mathematics 2024-12-10 Youbang Sun , Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of…

Optimization and Control · Mathematics 2022-03-02 Boris S. Mordukhovich , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

We show that Nesterov acceleration is an optimal-order iterative regularization method for linear ill-posed problems provided that a parameter is chosen accordingly to the smoothness of the solution. This result is proven both for an a…

Numerical Analysis · Mathematics 2021-07-07 Stefan Kindermann

The Stacker Crane Problem is NP-Hard and the best known approximation algorithm only provides a 9/5 approximation ratio. The objective of this paper is threefold. First, by embedding the problem within a stochastic framework, we present a…

Systems and Control · Computer Science 2013-10-15 Kyle Treleaven , Marco Pavone , Emilio Frazzoli

In this paper we address the speed planning problem for a vehicle over an assigned path with the aim of minimizing a weighted sum of travel time and energy consumption under suitable constraints (maximum allowed speed, maximum traction or…

Optimization and Control · Mathematics 2025-07-22 Stefano Ardizzoni , Luca Consolini , Mattia Laurini , Marco Locatelli

We consider the problem of minimizing an objective function that is the sum of a convex function and a group sparsity-inducing regularizer. Problems that integrate such regularizers arise in modern machine learning applications, often for…

Optimization and Control · Mathematics 2020-07-30 Frank E. Curtis , Yutong Dai , Daniel P. Robinson

This paper presents a Successive Convexification ($ \texttt{SCvx} $) algorithm to solve a class of non-convex optimal control problems with certain types of state constraints. Sources of non-convexity may include nonlinear dynamics and…

Optimization and Control · Mathematics 2017-10-23 Yuanqi Mao , Daniel Dueri , Michael Szmuk , Behçet Açıkmeşe

We present a new approach for Neural Optimal Transport (NOT) training procedure, capable of accurately and efficiently estimating optimal transportation plan via specific regularization on dual Kantorovich potentials. The main bottleneck of…

Machine Learning · Computer Science 2024-10-21 Nazar Buzun , Maksim Bobrin , Dmitry V. Dylov

Motivated by applications in optimization and machine learning, we consider stochastic quasi-Newton (SQN) methods for solving stochastic optimization problems. In the literature, the convergence analysis of these algorithms relies on strong…

Optimization and Control · Mathematics 2016-03-16 Farzad Yousefian , Angelia Nedić , Uday V. Shanbha

Despite the broad use of fixed-point iterations throughout applied mathematics, the optimal convergence rate of general fixed-point problems with nonexpansive nonlinear operators has not been established. This work presents an acceleration…

Optimization and Control · Mathematics 2022-06-28 Jisun Park , Ernest K. Ryu

We study the optimal transport problem for pairs of stationary finite-state Markov chains, with an emphasis on the computation of optimal transition couplings. Transition couplings are a constrained family of transport plans that capture…

Optimization and Control · Mathematics 2021-09-20 Kevin O'Connor , Kevin McGoff , Andrew B. Nobel

Bilevel optimization is an important class of optimization problems where one optimization problem is nested within another. While various methods have emerged to address unconstrained general bilevel optimization problems, there has been a…

Optimization and Control · Mathematics 2024-03-15 Nazanin Abolfazli , Ruichen Jiang , Aryan Mokhtari , Erfan Yazdandoost Hamedani

We show that the discrete Sinkhorn algorithm - as applied in the setting of Optimal Transport on a compact manifold - converges to the solution of a fully non-linear parabolic PDE of Monge-Ampere type, in a large-scale limit. The latter…

Analysis of PDEs · Mathematics 2020-06-29 Robert J. Berman

This paper addresses a distributed convex optimization problem with a class of coupled constraints, which arise in a multi-agent system composed of multiple communities modeled by cliques. First, we propose a fully distributed…

Optimization and Control · Mathematics 2022-11-21 Yuto Watanabe , Kazunori Sakurama

We study the complexity of approximating the multimarginal optimal transport (MOT) distance, a generalization of the classical optimal transport distance, considered here between $m$ discrete probability distributions supported each on $n$…

Machine Learning · Statistics 2022-02-23 Tianyi Lin , Nhat Ho , Marco Cuturi , Michael I. Jordan

We consider the numerical solution of the discrete multi-marginal optimal transport (MOT) by means of the Sinkhorn algorithm. In general, the Sinkhorn algorithm suffers from the curse of dimensionality with respect to the number of…

Optimization and Control · Mathematics 2023-02-22 Fatima Antarou Ba , Michael Quellmalz

In this paper, we present a generic framework to extend existing uniformly optimal convex programming algorithms to solve more general nonlinear, possibly nonconvex, optimization problems. The basic idea is to incorporate a local search…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan , Hongchao Zhang

Optimal power flow (OPF) is an important problem in the operation of electric power systems. Due to the OPF problem's non-convexity, there may exist multiple local optima. Certifiably obtaining the global solution is important for certain…

Optimization and Control · Mathematics 2019-06-17 Alireza Barzegar , Daniel K. Molzahn , Rong Su

Global pooling is one of the most significant operations in many machine learning models and tasks, whose implementation, however, is often empirical in practice. In this study, we develop a novel and solid global pooling framework through…

Machine Learning · Computer Science 2022-09-30 Minjie Cheng , Hongteng Xu

Optimal transport (OT) aims to find a map $T$ that transports mass from one probability measure to another while minimizing a cost function. Recently, neural OT solvers have gained popularity in high dimensional biological applications such…

Machine Learning · Computer Science 2025-05-20 Peter Chen , Yue Xie , Qingpeng Zhang
‹ Prev 1 8 9 10 Next ›