English
Related papers

Related papers: Proximal Newton-type methods for minimizing compos…

200 papers

This paper proposes new proximal Newton-type methods with a diagonal metric for solving composite optimization problems whose objective function is the sum of a twice continuously differentiable function and a proper closed directionally…

Optimization and Control · Mathematics 2023-10-11 Shotaro Yagishita , Shummin Nakayama

In this paper, a globally convergent Newton-type proximal gradient method is developed for composite multi-objective optimization problems where each objective function can be represented as the sum of a smooth function and a nonsmooth…

Optimization and Control · Mathematics 2024-10-25 Md Abu Talhamainuddin Ansary

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner

We develop a globalized Proximal Newton method for composite and possibly non-convex minimization problems in Hilbert spaces. Additionally, we impose less restrictive assumptions on the composite objective functional considering…

Optimization and Control · Mathematics 2021-11-02 Bastian Pötzl , Anton Schiela , Patrick Jaap

This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and…

Optimization and Control · Mathematics 2026-03-03 Pham Duy Khanh , Boris S. Mordukhovich , Vo Thanh Phat

We consider a class of difference-of-convex (DC) optimization problems where the objective function is the sum of a smooth function and a possible nonsmooth DC function. The application of proximal DC algorithms to address this problem…

Optimization and Control · Mathematics 2023-08-30 Shummin Nakayama , Yasushi Narushima , Hiroshi Yabe

The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of…

Optimization and Control · Mathematics 2022-03-02 Boris S. Mordukhovich , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

We study a Newton-like method for the minimization of an objective function that is the sum of a smooth convex function and an l-1 regularization term. This method, which is sometimes referred to in the literature as a proximal Newton…

Optimization and Control · Mathematics 2013-09-16 Richard H. Byrd , Jorge Nocedal , Figen Oztoprak

In this paper, we propose new proximal Newton-type methods for convex optimization problems in composite form. The applications include model predictive control (MPC) and embedded MPC. Our new methods are computationally attractive since…

Optimization and Control · Mathematics 2020-07-21 Ilan Adler , Zhiyue Tom Hu , Tianyi Lin

In this paper, we discuss the problem of minimizing the sum of two convex functions: a smooth function plus a non-smooth function. Further, the smooth part can be expressed by the average of a large number of smooth component functions, and…

Machine Learning · Computer Science 2016-11-17 Luo Luo , Zihao Chen , Zhihua Zhang , Wu-Jun Li

We introduce a notion of self-concordant smoothing for minimizing the sum of two convex functions, one of which is smooth and the other nonsmooth. The key highlight is a natural property of the resulting problem's structure that yields a…

Optimization and Control · Mathematics 2025-12-01 Adeyemi D. Adeoye , Alberto Bemporad

We consider minimization of functions that are compositions of convex or prox-regular functions (possibly extended-valued) with smooth vector functions. A wide variety of important optimization problems fall into this framework. We describe…

Optimization and Control · Mathematics 2015-04-24 A. S. Lewis , S. J. Wright

We consider solving nonconvex composite optimization problems in which the sum of a smooth function and a nonsmooth function is minimized. Many of convergence analyses of proximal gradient-type methods rely on global descent property…

Optimization and Control · Mathematics 2026-04-09 Shotaro Yagishita , Masaru Ito

We propose a novel study of the stochastic proximal gradient method for minimizing the sum of two convex functions, one of which is smooth. Under suitable assumptions and without requiring any boundedness or control of the variance of the…

Optimization and Control · Mathematics 2026-04-16 Javier I. Madariaga

In this work, we generalized and unified recent two completely different works of Jascha \cite{sohl2014fast} and Lee \cite{lee2012proximal} respectively into one by proposing the \textbf{prox}imal s\textbf{to}chastic \textbf{N}ewton-type…

Optimization and Control · Mathematics 2014-10-30 Ziqiang Shi

This paper aims to develop a Newton-type method to solve a class of nonconvex composite programs. In particular, the nonsmooth part is possibly nonconvex. To tackle the nonconvexity, we develop a notion of strong prox-regularity which is…

Optimization and Control · Mathematics 2023-03-10 Jiang Hu , Kangkang Deng , Jiayuan Wu , Quanzheng Li

This paper extends the algorithm schemes proposed in \cite{Nesterov2007a} and \cite{Nesterov2007b} to the minimization of the sum of a composite objective function and a convex function. Two proximal point-type schemes are provided and…

Optimization and Control · Mathematics 2011-05-03 Quoc Tran Dinh , Moritz Diehl

An inexact Newton type method for numerical minimization of convex piecewise quadratic functions is considered and its convergence is analyzed. Earlier, a similar method was successfully applied to optimizaton problems arising in numerical…

Optimization and Control · Mathematics 2019-01-11 Alexander I. Golikov , Igor E. Kaporin

We propose several new nonsmooth Newton methods for solving convex composite optimization problems with polyhedral regularizers, while avoiding the computation of complicated second-order information on these functions. Under the…

Optimization and Control · Mathematics 2025-11-25 Tran T. A. Nghia , Nghia V. Vo , Khoa V. H. Vu

The goal of this paper is to study approaches to bridge the gap between first-order and second-order type methods for composite convex programs. Our key observations are: i) Many well-known operator splitting methods, such as…

Optimization and Control · Mathematics 2016-09-27 Xiantao Xiao , Yongfeng Li , Zaiwen Wen , Liwei Zhang
‹ Prev 1 2 3 10 Next ›