English
Related papers

Related papers: Proximal Diagonal Newton Methods for Composite Opt…

200 papers

In this paper, a globally convergent Newton-type proximal gradient method is developed for composite multi-objective optimization problems where each objective function can be represented as the sum of a smooth function and a nonsmooth…

Optimization and Control · Mathematics 2024-10-25 Md Abu Talhamainuddin Ansary

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner

We generalize Newton-type methods for minimizing smooth functions to handle a sum of two convex functions: a smooth function and a nonsmooth function with a simple proximal mapping. We show that the resulting proximal Newton-type methods…

Machine Learning · Statistics 2014-03-19 Jason D. Lee , Yuekai Sun , Michael A. Saunders

In this paper, we propose new proximal Newton-type methods for convex optimization problems in composite form. The applications include model predictive control (MPC) and embedded MPC. Our new methods are computationally attractive since…

Optimization and Control · Mathematics 2020-07-21 Ilan Adler , Zhiyue Tom Hu , Tianyi Lin

This paper suggests two novel ideas to develop new proximal variable-metric methods for solving a class of composite convex optimization problems. The first idea is a new parameterization of the optimality condition which allows us to…

Optimization and Control · Mathematics 2018-12-14 Quoc Tran-Dinh , Liang Ling , Kim-Chuan Toh

This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and…

Optimization and Control · Mathematics 2026-03-03 Pham Duy Khanh , Boris S. Mordukhovich , Vo Thanh Phat

We address composite optimization problems, which consist in minimizing the sum of a smooth and a merely lower semicontinuous function, without any convexity assumptions. Numerical solutions of these problems can be obtained by proximal…

Optimization and Control · Mathematics 2024-02-14 Alberto De Marchi

We consider a class of difference-of-convex (DC) optimization problems where the objective function is the sum of a smooth function and a possible nonsmooth DC function. The application of proximal DC algorithms to address this problem…

Optimization and Control · Mathematics 2023-08-30 Shummin Nakayama , Yasushi Narushima , Hiroshi Yabe

The nonlinear conjugate gradient methods are known to be an effective approach for standard unconstrained optimization problems especially for large-scale problems. This paper proposes a proximal nonlinear conjugate gradient method, which…

Optimization and Control · Mathematics 2026-04-14 Shodai Hamana , Yasushi Narushima

The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of…

Optimization and Control · Mathematics 2022-03-02 Boris S. Mordukhovich , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

We introduce a framework for quasi-Newton forward--backward splitting algorithms (proximal quasi-Newton methods) with a metric induced by diagonal $\pm$ rank-$r$ symmetric positive definite matrices. This special type of metric allows for a…

Optimization and Control · Mathematics 2018-11-27 Stephen Becker , Jalal Fadili , Peter Ochs

In this paper, we propose an inexact proximal Newton-type method for nonconvex composite problems. We establish the global convergence rate of the order $\mathcal{O}(k^{-1/2})$ in terms of the minimal norm of the KKT residual mapping and…

Optimization and Control · Mathematics 2024-12-26 Hong Zhu

In this paper, we propose a descent method for composite optimization problems with linear operators. Specifically, we first design a structure-exploiting preconditioner tailored to the linear operator so that the resulting preconditioned…

Optimization and Control · Mathematics 2026-03-20 Jian Chen , Xinmin Yang

In this paper, we propose objective-function-free (OFF) variants of the proximal Newton method for nonconvex composite optimization problems and the regularized Newton method for unconstrained optimization problems, respectively, using…

Optimization and Control · Mathematics 2026-05-19 Hong Zhu

In this paper we consider large-scale composite optimization problems having the objective function formed as a sum of two terms (possibly nonconvex), one has (block) coordinate-wise Lipschitz continuous gradient and the other is…

Optimization and Control · Mathematics 2024-01-10 Flavia Chorobura , Ion Necoara

This paper develops the proximal method of multipliers for a class of nonsmooth convex optimization. The method generates a sequence of minimization problems (subproblems). We show that the sequence of approximations to the solutions of the…

Numerical Analysis · Mathematics 2020-01-14 Tomoya Takeuchi

In this paper, we propose a proximal gradient method and an accelerated proximal gradient method for solving composite optimization problems, where the objective function is the sum of a smooth and a convex, possibly nonsmooth, function. We…

Optimization and Control · Mathematics 2025-07-22 Raghu Bollapragada , Shagun Gupta

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

Numerical Analysis · Computer Science 2017-10-18 Hiva Ghanbari , Katya Scheinberg

In a recent study, Ansary (Optim Methods Softw 38(3):570-590,2023) proposed a Newton-type proximal gradient method for nonlinear multiobjective optimization problems (NPGMO). However, the favorable convergence properties typically…

Optimization and Control · Mathematics 2023-08-22 Jian Chen , Xiaoxue Jiang , Liping Tang , Xinmin Yang

This paper proposes a nonmonotone proximal quasi-Newton algorithm for unconstrained convex multiobjective composite optimization problems. To design the search direction, we minimize the max-scalarization of the variations of the Hessian…

Optimization and Control · Mathematics 2023-10-04 Xiaoxue Jiang
‹ Prev 1 2 3 10 Next ›