English
Related papers

Related papers: Universal similar triangulars method for searching…

200 papers

We show that Nesterov acceleration is an optimal-order iterative regularization method for linear ill-posed problems provided that a parameter is chosen accordingly to the smoothness of the solution. This result is proven both for an a…

Numerical Analysis · Mathematics 2021-07-07 Stefan Kindermann

This paper develops a unified distributed method for solving two classes of constrained networked optimization problems, i.e., optimal consensus problem and resource allocation problem with non-identical set constraints. We first transform…

Optimization and Control · Mathematics 2023-07-17 Yi Huang , Ziyang Meng , Jian Sun , Wei Ren

In the paper, we develop a composite version of Mirror Prox algorithm for solving convex-concave saddle point problems and monotone variational inequalities of special structure, allowing to cover saddle point/variational analogies of what…

Optimization and Control · Mathematics 2014-05-23 Niao He , Anatoli Juditsky , Arkadi Nemirovski

In this paper, we propose a variance-reduced primal-dual algorithm with Bregman distance for solving convex-concave saddle-point problems with finite-sum structure and nonbilinear coupling function. This type of problems typically arises in…

Optimization and Control · Mathematics 2021-06-02 Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh

We propose a simple way to explain Univerasal method of Yu. Nesterov. Based on this method and using the restart technique we propose Universal method for strictly convex optimization problems. We consider general proximal set up (not…

Optimization and Control · Mathematics 2016-11-02 Alexander Gasnikov , Dmitry Kamzolov , Mikhail Mendel

Science about optimization methods is rapidly developing today. In machine learning, computer vision, biology, medicine, construction and in many other different areas optimization methods have vast popularity and they appear as important…

Optimization and Control · Mathematics 2017-05-30 Alexander Tyurin

Complexity of the Operations Research Theory tasks can be often diminished in cases that do not require finding the exact solution. For example, forecasting two-dimensional hierarchical time series leads us to the transportation problem…

Optimization and Control · Mathematics 2019-09-06 S. V. Rotin , I. V. Gusakov , V. Ya. Gusakov

In this paper, we propose the primal-dual method of multipliers (PDMM) for distributed optimization over a graph. In particular, we optimize a sum of convex functions defined over a graph, where every edge in the graph carries a linear…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-06 G. Zhang , R. Heusdens

This work is concerned with the efficient optimization method for solving a large class of optimal mass transport problems. An inexact primal-dual algorithm is presented from the time discretization of a proper dynamical system, and by…

Optimization and Control · Mathematics 2022-07-29 Jun Hu , Hao Luo , Zihang Zhang

Using convex combination and linesearch techniques, we introduce a novel primal-dual algorithm for solving structured convex-concave saddle point problems with a generic smooth nonbilinear coupling term. Our adaptive linesearch strategy…

Optimization and Control · Mathematics 2024-01-17 Xiaokai Chang , Junfeng Yang , Hongchao Zhang

We propose a primal-dual smoothing framework for finding a near-stationary point of a class of non-smooth non-convex optimization problems with max-structure. We analyze the primal and dual gradient complexities of the framework via two…

Optimization and Control · Mathematics 2023-07-19 Renbo Zhao

In this Doctoral Dissertation we propose new variational principles for traffic assignment problems. So to find equillibrium we have to solve large-scale convex optimization problem of special (multilevel) type. We propose different…

Optimization and Control · Mathematics 2017-06-26 Alexander Gasnikov

We introduce a novel primal-dual flow for affine constrained convex optimization problems. As a modification of the standard saddle-point system, our primal-dual flow is proved to possess the exponential decay property, in terms of a…

Optimization and Control · Mathematics 2022-03-22 Hao Luo

We introduce a formalism to deal with the microscopic modeling of vehicular traffic on a road network. Traffic on each road is uni-directional, and the dynamics of each vehicle is described by a Follow-the-Leader model. From a mathematical…

Physics and Society · Physics 2020-02-25 Rinaldo M. Colombo , Helge Holden , Francesca Marcellini

Optimization methods are at the core of many problems in signal/image processing, computer vision, and machine learning. For a long time, it has been recognized that looking at the dual of an optimization problem may drastically simplify…

Numerical Analysis · Computer Science 2014-12-04 Nikos Komodakis , Jean-Christophe Pesquet

We propose Log-Averaged Mirror Prox (LAMP), a linear-space primal-dual method for large-scale optimal transport. LAMP implements primal mirror prox updates by tracking an averaged dual sequence, reducing storage complexity from ${O}(nm)$ to…

Optimization and Control · Mathematics 2026-05-12 Matthew X. Burns , Jiaming Liang

Given a convex optimization problem and its dual, there are many possible first-order algorithms. In this paper, we show the equivalence between mirror descent algorithms and algorithms generalizing the conditional gradient method. This is…

Machine Learning · Computer Science 2013-10-21 Francis Bach

A new primal-dual algorithm is presented for solving a class of non-convex minimization problems. This algorithm is based on canonical duality theory such that the original non-convex minimization problem is first reformulated as a…

Numerical Analysis · Computer Science 2013-01-01 Changzhi Wu , Chaojie Li , David Yang Gao

In this article we describe the solutions of three problems posed at different time by Yurii Nesterov. First problem is 'Mage vs Experts': Assume that we live in some enviroment that characterized by unobservable convex function $f(x)$.…

Optimization and Control · Mathematics 2018-11-13 Maktagali Bektemessov , Alexander Gasnikov , Anastasia Lagunovskaya , Zhanna Ordabayeva

A transformed primal-dual (TPD) flow is developed for a class of nonlinear smooth saddle point system. The flow for the dual variable contains a Schur complement which is strongly convex. Exponential stability of the saddle point is…

Optimization and Control · Mathematics 2023-02-03 Long Chen , Jingrong Wei