English
Related papers

Related papers: Global convergence and acceleration of projection …

200 papers

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

Convex approximation sets for multiobjective optimization problems are a well-studied relaxation of the common notion of approximation sets. Instead of approximating each image of a feasible solution by the image of some solution in the…

Optimization and Control · Mathematics 2023-06-13 Stephan Helfrich , Stefan Ruzika , Clemens Thielen

This paper proposes and justifies two globally convergent Newton-type methods to solve unconstrained and constrained problems of nonsmooth optimization by using tools of variational analysis and generalized differentiation. Both methods are…

Optimization and Control · Mathematics 2023-04-27 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat , Dat Ba Tran

We propose a generalization of the method of cyclic projections, which uses the lengths of projection steps carried out in the past to learn about the geometry of the problem and decides on this basis which projections to carry out in the…

Optimization and Control · Mathematics 2020-06-18 Janosch Rieger

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

Numerical Analysis · Computer Science 2017-10-18 Hiva Ghanbari , Katya Scheinberg

A subgradient method is presented for solving general convex optimization problems, the main requirement being that a strictly-feasible point is known. A feasible sequence of iterates is generated, which converges to within user-specified…

Optimization and Control · Mathematics 2016-05-30 James Renegar

This paper presents a practical method for finding the globally optimal solution to the sum-of-ratios problem arising in image processing, engineering and management. Unlike traditional methods which may get trapped in local minima due to…

Optimization and Control · Mathematics 2012-08-07 Yunchol Jong

In this paper we consider a problem, called convex projection, of projecting a convex set onto a subspace. We will show that to a convex projection one can assign a particular multi-objective convex optimization problem, such that the…

Optimization and Control · Mathematics 2021-10-18 Gabriela Kováčová , Birgit Rudloff

Circumcentered techniques have been shown to significantly accelerate projection-based methods for convex feasibility problems. Motivated by this success, we propose two direct methods with circumcenter acceleration for solving variational…

Optimization and Control · Mathematics 2026-02-10 Roger Behling , Yunier Bello-Cruz , Alfredo Iusem , Di Liu , Luiz-Rafael Santos

In this paper we consider a class of optimization problems with a strongly convex objective function and the feasible set given by an intersection of a simple convex set with a set given by a number of linear equality and inequality…

Optimization and Control · Mathematics 2016-05-11 Alexey Chernov , Pavel Dvurechensky , Alexander Gasnikov

We focus on the optimization problem with smooth, possibly nonconvex objectives and a convex constraint set for which the Euclidean projection operation is practically available. Focusing on this setting, we carry out a general convergence…

Optimization and Control · Mathematics 2026-04-23 Matteo Lapucci , Giampaolo Liuzzi , Stefano Lucidi , Marco Sciandrone , Diego Scuppa

We consider the problem of minimizing a convex function over the intersection of finitely many simple sets which are easy to project onto. This is an important problem arising in various domains such as machine learning. The main difficulty…

Optimization and Control · Mathematics 2017-10-19 Achintya Kundu , Francis Bach , Chiranjib Bhattacharyya

Constrained non-convex optimization is fundamentally challenging, as global solutions are generally intractable and constraint qualifications may not hold. However, in many applications, including safe policy optimization in control and…

Optimization and Control · Mathematics 2025-11-14 Ilyas Fatkhullin , Niao He , Guanghui Lan , Florian Wolf

This paper proposes an algorithm for solving structured optimization problems, which covers both the backward-backward and the Douglas-Rachford algorithms as special cases, and analyzes its convergence. The set of fixed points of the…

Optimization and Control · Mathematics 2017-09-19 Nguyen Hieu Thao

In this paper, acceleration of gradient methods for convex optimization problems with weak levels of convexity and smoothness is considered. Starting from the universal fast gradient method which was designed to be an optimal method for…

Optimization and Control · Mathematics 2022-06-10 Jongho Park

This paper deals with a modifed iterative projection method for approximating a solution of hierarchical fixed point problems for nearly nonexpansive mappings. Some strong convergence theorems for the proposed method are presented under…

Functional Analysis · Mathematics 2014-03-17 Ibrahim Karahan , Murat Ozdemir

We analyze the convergence rate of the monotone accelerated proximal gradient method, which can be used to solve structured convex composite optimization problems. A linear convergence rate is established when the smooth part of the…

Optimization and Control · Mathematics 2026-03-16 Zepeng Wang , Juan Peypouquet

Quasi-convex optimization acts a pivotal part in many fields including economics and finance; the subgradient method is an effective iterative algorithm for solving large-scale quasi-convex optimization problems. In this paper, we…

Optimization and Control · Mathematics 2019-10-25 Yaohua Hu , Jiawen Li , Carisa Kwok Wai Yu

The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of…

Optimization and Control · Mathematics 2022-03-02 Boris S. Mordukhovich , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

We consider a general class of regression models with normally distributed covariates, and the associated nonconvex problem of fitting these models from data. We develop a general recipe for analyzing the convergence of iterative algorithms…

Optimization and Control · Mathematics 2021-09-22 Kabir Aladin Chandrasekher , Ashwin Pananjady , Christos Thrampoulidis