English
Related papers

Related papers: Inexact gradient projection method with relative e…

200 papers

In this paper, it was proposed a new concept of the inexact higher degree $(\delta, L, q)$-model of a function that is a generalization of the inexact $(\delta, L)$-model, $(\delta, L)$-oracle and $(\delta, L)$-oracle of degree $q \in…

Optimization and Control · Mathematics 2024-10-04 Mohammad Alkousa , Fedor Stonyakin , Alexander Gasnikov , Asmaa Abdo , Mohammad Alcheikh

In this paper, we propose and analyze an inexact version of the symmetric proximal alternating direction method of multipliers (ADMM) for solving linearly constrained optimization problems. Basically, the method allows its first subproblem…

Optimization and Control · Mathematics 2020-06-05 Vando A. Adona , Max L. N. Gonçalves

This paper explores variants of the subspace iteration algorithm for computing approximate invariant subspaces. The standard subspace iteration approach is revisited and new variants that exploit gradient-type techniques combined with a…

Numerical Analysis · Mathematics 2024-05-14 Foivos Alimisis , Yousef Saad , Bart Vandereycken

We establish the optimal ergodic convergence rate for the classical projected subgradient method with a time-varying step-size. This convergence rate remains the same even if we slightly increase the weight of the most recent points,…

Optimization and Control · Mathematics 2024-10-10 Zhihan Zhu , Yanhao Zhang , Yong Xia

The aim of this paper is to deepen the convergence analysis of the scaled gradient projection (SGP) method, proposed by Bonettini et al. in a recent paper for constrained smooth optimization. The main feature of SGP is the presence of a…

Numerical Analysis · Mathematics 2015-09-10 Silvia Bonettini , Marco Prato

We identify and analyze a fundamental limitation of the classical projected subgradient method in nonsmooth convex optimization: the inevitable failure caused by the absence of valid subgradients at boundary points. We show that, under…

Optimization and Control · Mathematics 2026-02-17 Zhihan Zhu , Yanhao Zhang , Yong Xia

We study projection-free methods for functional constrained optimization with convex or smooth nonconvex objectives. Such problems arise in applications such as portfolio optimization and radiation therapy planning, where risk-aware…

Optimization and Control · Mathematics 2026-05-12 Yi Cheng , Guanghui Lan , Saeed Masiha , H. Edwin Romeijn

We develop a gradient-like algorithm to minimize a sum of peer objective functions based on coordination through a peer interconnection network. The coordination admits two stages: the first is to constitute a gradient, possibly with…

Optimization and Control · Mathematics 2023-07-19 Sandushan Ranaweera , Chathuranga Weeraddana , Prathapasinghe Dharmawansa , Carlo Fischione

In this paper, we propose a simple acceleration scheme for Riemannian gradient methods by extrapolating iterates on manifolds. We show when the iterates are generated from Riemannian gradient descent method, the accelerated scheme achieves…

Optimization and Control · Mathematics 2022-08-16 Andi Han , Bamdev Mishra , Pratik Jawanpuria , Junbin Gao

We propose a new concept of a relatively inexact stochastic subgradient and present novel first-order methods that can use such objects to approximately solve convex optimization problems in relative scale. An important example where…

Optimization and Control · Mathematics 2023-05-30 Yurii Nesterov , Anton Rodomanov

We consider algebraic iterative reconstruction methods with applications in image reconstruction. In particular, we are concerned with methods based on an unmatched projector/backprojector pair; i.e., the backprojector is not the exact…

Numerical Analysis · Mathematics 2019-02-14 Yiqiu Dong , Per Christian Hansen , Michiel E. Hochstenbach , Nicolai Andre Brogaard Riis

This paper proposes and develops inexact proximal methods for finding stationary points of the sum of a smooth function and a nonsmooth weakly convex one, where an error is present in the calculation of the proximal mapping of the nonsmooth…

Optimization and Control · Mathematics 2023-08-07 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat , Dat Ba Tran

This paper considers unconstrained convex optimization problems with time-varying objective functions. We propose algorithms with a discrete time-sampling scheme to find and track the solution trajectory based on prediction and correction…

Information Theory · Computer Science 2017-09-18 Andrea Simonetto , Aryan Mokhtari , Alec Koppel , Geert Leus , Alejandro Ribeiro

Many scientific and engineering applications feature nonsmooth convex minimization problems over convex sets. In this paper, we address an important instance of this broad class where we assume that the nonsmooth objective is equipped with…

Optimization and Control · Mathematics 2014-06-23 Quoc Tran Dinh , Anastasios Kyrillidis , Volkan Cevher

In this technical note, we are concerned with the problem of solving variational inequalities with improved convergence rates. Motivated by Nesterov's accelerated gradient method for convex optimization, we propose a Nesterov's accelerated…

Optimization and Control · Mathematics 2022-12-21 Shaolin Tan , Jinhu Lu

In this paper we will discuss two variants of an inexact feasible interior point algorithm for convex quadratic programming. We will consider two different neighbourhoods: a (small) one induced by the use of the Euclidean norm which yields…

Optimization and Control · Mathematics 2012-08-30 Jacek Gondzio

This paper considers an online proximal-gradient method to track the minimizers of a composite convex function that may continuously evolve over time. The online proximal-gradient method is inexact, in the sense that: (i) it relies on an…

Optimization and Control · Mathematics 2020-04-24 Amirhossein Ajalloeian , Andrea Simonetto , Emiliano Dall'Anese

In this work we consider an iterative method for solving the quasi-convex feasibility problem. We firstly introduce the so-called star subgradient projection operator and present some useful properties. We subsequently obtain a convergence…

Optimization and Control · Mathematics 2020-01-28 Nimit Nimana , Narin Petrot

In this paper, we propose Riemannian conditional gradient methods for minimizing composite functions, i.e., those that can be expressed as the sum of a smooth function and a retraction-based convex function. We analyze the convergence of…

Optimization and Control · Mathematics 2026-05-19 Kangming Chen , Ellen H. Fukuda

In this paper, a modification to the Gradient Sampling (GS) method for minimizing nonsmooth nonconvex functions is presented. One drawback in GS method is the need of solving a Quadratic optimization Problem (QP) at each iteration, which is…

Optimization and Control · Mathematics 2019-07-03 M. Maleknia , M. Shamsi
‹ Prev 1 3 4 5 6 7 10 Next ›