中文
相关论文

相关论文: Accelerated Inexact Composite Gradient Methods for…

200 篇论文

In this paper, we describe and establish iteration-complexity of two accelerated composite gradient (ACG) variants to solve a smooth nonconvex composite optimization problem whose objective function is the sum of a nonconvex differentiable…

最优化与控制 · 数学 2021-03-09 Jiaming Liang , Renato D. C. Monteiro , Chee-Khian Sim

The proximal gradient algorithm has been popularly used for convex optimization. Recently, it has also been extended for nonconvex problems, and the current state-of-the-art is the nonmonotone accelerated proximal gradient algorithm.…

最优化与控制 · 数学 2017-05-24 Quanming Yao , James T. Kwok , Fei Gao , Wei Chen , Tie-Yan Liu

We propose an adaptive accelerated gradient method for solving smooth convex optimization problems. The method incorporates a scheme to determine the step size adaptively, by means of a local estimation of the smoothness constant, which is…

最优化与控制 · 数学 2025-12-24 Zepeng Wang , Juan Peypouquet

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function using proximal-gradient methods, where an error is present in the calculation of the gradient of the smooth term or in the proximity…

机器学习 · 计算机科学 2011-12-02 Mark Schmidt , Nicolas Le Roux , Francis Bach

We develop multi-step gradient methods for network-constrained optimization of strongly convex functions with Lipschitz-continuous gradients. Given the topology of the underlying network and bounds on the Hessian of the objective function,…

最优化与控制 · 数学 2015-06-12 Euhanna Ghadimi , Iman Shames , Mikael Johansson

In this paper we propose a unified two-phase scheme for convex optimization to accelerate: (1) the adaptive cubic regularization methods with exact/inexact Hessian matrices, and (2) the adaptive gradient method, without any knowledge of the…

最优化与控制 · 数学 2017-12-29 Bo Jiang , Tianyi Lin , Shuzhong Zhang

The performance of optimization methods is often tied to the spectrum of the objective Hessian. Yet, conventional assumptions, such as smoothness, do often not enable us to make finely-grained convergence statements -- particularly not for…

最优化与控制 · 数学 2024-02-08 Nikita Doikov , Sebastian U. Stich , Martin Jaggi

This paper presents an accelerated proximal gradient method for multiobjective optimization, in which each objective function is the sum of a continuously differentiable, convex function and a closed, proper, convex function. Extending…

最优化与控制 · 数学 2023-06-08 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

This paper is devoted to first-order algorithms for smooth convex optimization with inexact gradients. Unlike the majority of the literature on this topic, we consider the setting of relative rather than absolute inexactness. More…

In this paper, we investigate accelerated first-order methods for smooth convex optimization problems under inexact information on the gradient of the objective. The noise in the gradient is considered to be additive with two possibilities:…

最优化与控制 · 数学 2023-01-10 Vasin Artem , Alexander Gasnikov , Pavel Dvurechensky , Vladimir Spokoiny

This thesis focuses on developing and analyzing accelerated and inexact first-order methods for solving or finding stationary points of various nonconvex composite optimization (NCO) problems. The main tools mainly come from variational and…

最优化与控制 · 数学 2021-12-28 Weiwei Kong

The aim of this paper is to develop an efficient algorithm for solving a class of unconstrained nondifferentiable convex optimization problems in finite dimensional spaces. To this end we formulate first its Fenchel dual problem and…

最优化与控制 · 数学 2012-03-12 Radu Ioan Bot , Christopher Hendrich

Composite optimization offers a powerful modeling tool for a variety of applications and is often numerically solved by means of proximal gradient methods. In this paper, we consider fully nonconvex composite problems under only local…

最优化与控制 · 数学 2023-02-09 Alberto De Marchi , Andreas Themelis

We introduce a notion of inexact model of a convex objective function, which allows for errors both in the function and in its gradient. For this situation, a gradient method with an adaptive adjustment of some parameters of the model is…

最优化与控制 · 数学 2021-10-12 Fedor S. Stonyakin

In this paper, we consider the composite optimization problem, where the objective function integrates a continuously differentiable loss function with a nonsmooth regularization term. Moreover, only the function values for the…

最优化与控制 · 数学 2024-01-09 Shanglin Liu , Lei Wang , Nachuan Xiao , Xin Liu

In this paper, it was proposed a new concept of the inexact higher degree $(\delta, L, q)$-model of a function that is a generalization of the inexact $(\delta, L)$-model, $(\delta, L)$-oracle and $(\delta, L)$-oracle of degree $q \in…

最优化与控制 · 数学 2024-10-04 Mohammad Alkousa , Fedor Stonyakin , Alexander Gasnikov , Asmaa Abdo , Mohammad Alcheikh

In this paper, we propose a novel primal-dual inexact gradient projection method for nonlinear optimization problems with convex-set constraint. This method only needs inexact computation of the projections onto the convex set for each…

最优化与控制 · 数学 2019-11-19 Fan Zhang , Hao Wang , Jiashan Wang , Kai Yang

In this paper, we consider the nonsmooth convex optimization problems over the fixed point constraint sets of firmly nonexpansive operators. To find an optimal solution of the problem, we present an iterative method based on the hybrid…

最优化与控制 · 数学 2026-03-23 Ontima Pankoon , Nimit Nimana , Yeol Je Cho

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

最优化与控制 · 数学 2013-02-14 Ion Necoara , Andrei Patrascu

In this paper, we propose an inertial accelerated primal-dual method for the linear equality constrained convex optimization problem. When the objective function has a ``nonsmooth + smooth'' composite structure, we further propose an…

最优化与控制 · 数学 2021-06-30 Xin He , Rong Hu , Ya-Ping Fang