English
Related papers

Related papers: A semi-smooth Newton method for general projection…

200 papers

The continuous quadratic knapsack (CQK) problem involves minimizing a diagonal convex quadratic function subject to box constraints and a single linear equality constraint. It has numerous applications in resource allocation, multicommodity…

Optimization and Control · Mathematics 2026-05-20 Leonardo D. Secchin , Paulo J. S. Silva

We consider concave minimization problems over non-convex sets.Optimization problems with this structure arise in sparse principal component analysis. We analyze both a gradient projection algorithm and an approximate Newton algorithm where…

Numerical Analysis · Computer Science 2019-04-09 William W. Hager , Dzung T. Phan , Jia-Jie Zhu

In this paper, we provide a finitely terminated yet efficient approach to compute the Euclidean projection onto the ordered weighted $\ell_1$ (OWL1) norm ball. In particular, an efficient semismooth Newton method is proposed for solving the…

Optimization and Control · Mathematics 2020-07-21 Qinzhen Li , Xudong Li

We develop a computationally efficient algorithm for the automatic regularization of nonlinear inverse problems based on the discrepancy principle. We formulate the problem as an equality constrained optimization problem, where the…

Numerical Analysis · Mathematics 2021-09-03 Jeffrey Cornelis , Wim Vanroose

The ground state energy of a many-electron system can be approximated by an variational approach in which the total energy of the system is minimized with respect to one and two-body reduced density matrices (RDM) instead of many-electron…

Optimization and Control · Mathematics 2017-09-01 Yongfeng Li , Zaiwen Wen , Chao Yang , Yaxiang Yuan

We propose a novel trust region method for solving a class of nonsmooth, nonconvex composite-type optimization problems. The approach embeds inexact semismooth Newton steps for finding zeros of a normal map-based stationarity measure for…

Optimization and Control · Mathematics 2023-10-04 Wenqing Ouyang , Andre Milzarek

In this paper, we propose a quasi-Newton method for solving smooth and monotone nonlinear equations, including unconstrained minimization and minimax optimization as special cases. For the strongly monotone setting, we establish two global…

Optimization and Control · Mathematics 2024-10-04 Ruichen Jiang , Aryan Mokhtari

The Euclidean projection onto a convex set is an important problem that arises in numerous constrained optimization tasks. Unfortunately, in many cases, computing projections is computationally demanding. In this work, we focus on…

Optimization and Control · Mathematics 2021-09-22 Ilnura Usmanova , Maryam Kamgarpour , Andreas Krause , Kfir Yehuda Levy

Quasi-Newton methods form an important class of methods for solving nonlinear optimization problems. In such methods, first order information is used to approximate the second derivative. The aim is to mimic the fast convergence that can be…

Optimization and Control · Mathematics 2025-02-20 Aban Ansari-Önnestam , Anders Forsgren

We consider a class of difference-of-convex (DC) optimization problems where the objective function is the sum of a smooth function and a possible nonsmooth DC function. The application of proximal DC algorithms to address this problem…

Optimization and Control · Mathematics 2023-08-30 Shummin Nakayama , Yasushi Narushima , Hiroshi Yabe

This paper proposes a squared smoothing Newton method via the Huber smoothing function for solving semidefinite programming problems (SDPs). We first study the fundamental properties of the matrix-valued mapping defined upon the Huber…

Optimization and Control · Mathematics 2024-10-10 Ling Liang , Defeng Sun , Kim-Chuan Toh

In this paper, we consider a large class of nonlinear equations derived from first-order type methods for solving composite optimization problems. Traditional approaches to establishing superlinear convergence rates of semismooth…

Optimization and Control · Mathematics 2023-07-31 Jiang Hu , Tonghua Tian , Shaohua Pan , Zaiwen Wen

This work concerns the local convergence theory of Newton and quasi-Newton methods for convex-composite optimization: minimize f(x):=h(c(x)), where h is an infinite-valued proper convex function and c is C^2-smooth. We focus on the case…

Optimization and Control · Mathematics 2018-06-19 James V. Burke , Abraham Engle

This paper presents a stochastic block-coordinate proximal Newton method for minimizing the sum of a blockwise Lipschitz-continuously differentiable function and a separable nonsmooth convex function. At each iteration, the method randomly…

Optimization and Control · Mathematics 2026-03-25 Hong Zhu , Xun Qian

We prove global convergence of classical projection algorithms for feasibility problems involving union convex sets, which refer to sets expressible as the union of a finite number of closed convex sets. We present a unified strategy for…

Optimization and Control · Mathematics 2023-07-18 Jan Harold Alcantara , Ching-pei Lee

Semismooth* Newton methods have been proposed in recent years targeting multi-valued inclusion problems and have been successfully implemented to deal with several concrete generalized equations. In this paper, we show that two typical…

Optimization and Control · Mathematics 2025-03-18 Liang Chen , Defeng Sun , Wangyongquan Zhang

In this paper, we study the iteration complexity of cubic regularization of Newton method for solving composite minimization problems with uniformly convex objective. We introduce the notion of second-order condition number of a certain…

Optimization and Control · Mathematics 2021-05-21 Nikita Doikov , Yurii Nesterov

In this manuscript, we propose a general proximal quasi-Newton method tailored for nonconvex and nonsmooth optimization problems, where we do not require the sequence of the variable metric (or Hessian approximation) to be uniformly bounded…

Optimization and Control · Mathematics 2025-07-28 Xiaoxi Jia

We are presenting a simple and numerical stable algorithm for the solution of the cone projection problem which is suitable for relative small data sets and for simulation purposes needed for convexity tests. Not even one pseudo-inverse…

Computation · Statistics 2012-07-12 Demetris T. Christopoulos

We propose a higher-order method for solving non-smooth optimization problems on manifolds. In order to obtain superlinear convergence, we apply a Riemannian Semi-smooth Newton method to a non-smooth non-linear primal-dual optimality system…

Optimization and Control · Mathematics 2023-08-17 Willem Diepeveen , Jan Lellmann