中文
相关论文

相关论文: Universal composite prox-method for strictly conve…

200 篇论文

We present a practical implementation of an optimal first-order method, due to Nesterov, for large-scale total variation regularization in tomographic reconstruction, image deblurring, etc. The algorithm applies to $\mu$-strongly convex…

We consider the problem of projecting a convex set onto a subspace, or equivalently formulated, the problem of computing a set obtained by applying a linear mapping to a convex feasible set. This includes the problem of approximating convex…

最优化与控制 · 数学 2024-12-11 Gabriela Kováčová , Birgit Rudloff

We propose a novel adaptive, accelerated algorithm for the stochastic constrained convex optimization setting. Our method, which is inspired by the Mirror-Prox method, \emph{simultaneously} achieves the optimal rates for smooth/non-smooth…

最优化与控制 · 数学 2019-10-31 Ali Kavis , Kfir Y. Levy , Francis Bach , Volkan Cevher

We propose an adaptive smoothing algorithm based on Nesterov's smoothing technique in \cite{Nesterov2005c} for solving "fully" nonsmooth composite convex optimization problems. Our method combines both Nesterov's accelerated proximal…

最优化与控制 · 数学 2016-07-05 Quoc Tran-Dinh

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

数值分析 · 计算机科学 2017-10-18 Hiva Ghanbari , Katya Scheinberg

This paper extends the algorithm schemes proposed in \cite{Nesterov2007a} and \cite{Nesterov2007b} to the minimization of the sum of a composite objective function and a convex function. Two proximal point-type schemes are provided and…

最优化与控制 · 数学 2011-05-03 Quoc Tran Dinh , Moritz Diehl

We propose a globally-accelerated, first-order method for the optimization of smooth and (strongly or not) geodesically-convex functions in a wide class of Hadamard manifolds. We achieve the same convergence rates as Nesterov's accelerated…

最优化与控制 · 数学 2023-01-18 David Martínez-Rubio , Sebastian Pokutta

We introduce a generic scheme for accelerating gradient-based optimization methods in the sense of Nesterov. The approach, called Catalyst, builds upon the inexact accelerated proximal point algorithm for minimizing a convex objective…

机器学习 · 统计学 2018-06-20 Hongzhou Lin , Julien Mairal , Zaid Harchaoui

In this paper, acceleration of gradient methods for convex optimization problems with weak levels of convexity and smoothness is considered. Starting from the universal fast gradient method which was designed to be an optimal method for…

最优化与控制 · 数学 2022-06-10 Jongho Park

In this paper, we study local convergence of high-order Tensor Methods for solving convex optimization problems with composite objective. We justify local superlinear convergence under the assumption of uniform convexity of the smooth…

最优化与控制 · 数学 2021-05-21 Nikita Doikov , Yurii Nesterov

Convergence analysis of accelerated first-order methods for convex optimization problems are presented from the point of view of ordinary differential equation solvers. A new dynamical system, called Nesterov accelerated gradient flow, has…

最优化与控制 · 数学 2022-03-01 Hao Luo , Long Chen

We discuss non-Euclidean deterministic and stochastic algorithms for optimization problems with strongly and uniformly convex objectives. We provide accuracy bounds for the performance of these algorithms and design methods which are…

最优化与控制 · 数学 2014-01-09 Anatoli Iouditski , Yuri Nesterov

In the lines of our approach in \cite{Ouorou2019}, where we exploit Nesterov fast gradient concept \cite{Nesterov1983} to the Moreau-Yosida regularization of a convex function, we devise new proximal algorithms for nonsmooth convex…

最优化与控制 · 数学 2020-10-08 Adam Ouorou

In this paper, we propose two algorithms for solving convex optimization problems with linear ascending constraints. When the objective function is separable, we propose a dual method which terminates in a finite number of iterations. In…

最优化与控制 · 数学 2014-09-26 Zizhuo Wang

This paper studies a class of double-loop (inner-outer) algorithms for convex composite optimization. For unconstrained problems, we develop a restarted accelerated composite gradient method that attains the optimal first-order complexity…

最优化与控制 · 数学 2026-02-23 Matthew X. Burns , Jiaming Liang

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

最优化与控制 · 数学 2022-10-17 Christian Kanzow , Theresa Lechner

In this paper, we develop a new concept of Global Curvature Bound for an arbitrary nonlinear operator between abstract metric spaces. We use this notion to characterize the global complexity of high-order algorithms solving composite…

最优化与控制 · 数学 2025-11-11 Nikita Doikov , Yurii Nesterov

In this paper we introduce new methods for convex optimization problems with inexact stochastic oracle. First method is an extension of the intermediate gradient method proposed by Devolder, Glineur and Nesterov for problems with inexact…

最优化与控制 · 数学 2015-12-08 Pavel Dvurechensky , Alexander Gasnikov

The problem of minimizing a separable convex function under linearly coupled constraints arises from various application domains such as economic systems, distributed control, and network flow. The main challenge for solving this problem is…

最优化与控制 · 数学 2017-09-05 Qin Fan , Min Xu , Yiming Ying

In the paper we generalize universal gradient method (Yu. Nesterov) to strongly convex case and to Intermediate gradient method (Devolder-Glineur-Nesterov). We also consider possible generalizations to stochastic and online context. We show…

最优化与控制 · 数学 2016-03-29 Alexander Gasnikov , Pavel Dvurechensky , Dmitry Kamzolov