English
Related papers

Related papers: A globalized inexact semismooth Newton method for …

200 papers

We propose a inexact Newton method for solving inverse eigenvalue problems (IEP). This method is globalized by employing the classical backtracking techniques. A global convergence analysis of this method is provided and the R-order…

Numerical Analysis · Mathematics 2013-04-24 Yonghui Ling , Xiubin Xu

We focus on finding sparse and least-$\ell_1$-norm solutions for unconstrained nonlinear optimal control problems. Such optimization problems are non-convex and non-smooth, nevertheless recent versions of Newton method for under-determined…

Optimization and Control · Mathematics 2019-08-28 Boris Polyak , Andrey Tremba

It is well known that Tikhonov regularization is one of the most commonly used methods for solving ill-posed problems. One of the most widely applied approaches is based on constructing a new dataset whose sample size is greater than the…

Optimization and Control · Mathematics 2020-12-11 Ning Zhang

Second-order optimization methods, such as cubic regularized Newton methods, are known for their rapid convergence rates; nevertheless, they become impractical in high-dimensional problems due to their substantial memory requirements and…

Optimization and Control · Mathematics 2024-01-09 Ruichen Jiang , Parameswaran Raman , Shoham Sabach , Aryan Mokhtari , Mingyi Hong , Volkan Cevher

We introduce a domain decomposition-based nonlinear preconditioned iteration for solving nonlinear, nonsmooth elliptic optimal control problems, with a nonlinear reaction term, $L^1$ regularization and box constraints on the control…

Optimization and Control · Mathematics 2021-04-02 Gabriele Ciaramella , Felix Kwok , Georg Müller

We consider a variant of inexact Newton Method, called Newton-MR, in which the least-squares sub-problems are solved approximately using Minimum Residual method. By construction, Newton-MR can be readily applied for unconstrained…

Optimization and Control · Mathematics 2022-05-09 Fred Roosta , Yang Liu , Peng Xu , Michael W. Mahoney

This paper develops a method for obtaining guaranteed outer approximations for global attractors of continuous and discrete time nonlinear dynamical systems. The method is based on a hierarchy of semidefinite programming problems of…

Optimization and Control · Mathematics 2023-10-05 Corbinian Schlosser , Milan Korda

This paper proposes two proximal Newton-CG methods for convex nonsmooth optimization problems in composite form. The algorithms are based on a a reformulation of the original nonsmooth problem as the unconstrained minimization of a…

Optimization and Control · Mathematics 2014-03-03 Panagiotis Patrinos , Lorenzo Stella , Alberto Bemporad

This paper concerns the composite problem of minimizing the sum of a twice continuously differentiable function $f$ and a nonsmooth convex function. For this class of nonconvex and nonsmooth problems, by leveraging a practical inexactness…

Optimization and Control · Mathematics 2025-05-27 Ruyu Liu , Shaohua Pan , Yitian Qian

We first investigate properties of M-tensor equations. In particular, we show that if the constant term of the equation is nonnegative, then finding a nonnegative solution of the equation can be done by finding a positive solution of a…

Optimization and Control · Mathematics 2020-07-28 Dong-Hui Li , Hong-Bo Guan , Jie-Feng Xu

In this paper we consider a class of optimization problems with a strongly convex objective function and the feasible set given by an intersection of a simple convex set with a set given by a number of linear equality and inequality…

Optimization and Control · Mathematics 2016-05-11 Alexey Chernov , Pavel Dvurechensky , Alexander Gasnikov

Inexact Newton regularization methods have been proposed by Hanke and Rieder for solving nonlinear ill-posed inverse problems. Every such a method consists of two components: an outer Newton iteration and an inner scheme providing…

Numerical Analysis · Mathematics 2011-11-09 Qinian Jin

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

For strongly convex objectives that are smooth, the classical theory of gradient descent ensures linear convergence relative to the number of gradient evaluations. An analogous nonsmooth theory is challenging. Even when the objective is…

Optimization and Control · Mathematics 2023-01-19 X. Y. Han , Adrian S. Lewis

We consider minimization of a smooth nonconvex objective function using an iterative algorithm based on Newton's method and the linear conjugate gradient algorithm, with explicit detection and use of negative curvature directions for the…

Optimization and Control · Mathematics 2018-11-14 Clément W. Royer , Michael O'Neill , Stephen J. Wright

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

In the paper, a variant of the \ssstar Newton method is developed for the numerical solution of generalized equations, in which the multi-valued part is a so-called SCD (subspace containing derivative) mapping. Under a rather mild…

Numerical Analysis · Mathematics 2022-10-13 H. Gfrerer , M. Mandlmayr , J. V. Outrata , J. Valdman

Error bound analysis, which estimates the distance of a point to the solution set of an optimization problem using the optimality residual, is a powerful tool for the analysis of first-order optimization algorithms. In this paper, we use…

Optimization and Control · Mathematics 2020-07-01 Jiawei Zhang , Zhiquan Luo

We generalize Newton-type methods for minimizing smooth functions to handle a sum of two convex functions: a smooth function and a nonsmooth function with a simple proximal mapping. We show that the resulting proximal Newton-type methods…

Machine Learning · Statistics 2014-03-19 Jason D. Lee , Yuekai Sun , Michael A. Saunders

Quasi-Newton methods are widely used for solving convex optimization problems due to their ease of implementation, practical efficiency, and strong local convergence guarantees. However, their global convergence is typically established…

Optimization and Control · Mathematics 2025-08-28 Artem Agafonov , Vladislav Ryspayev , Samuel Horváth , Alexander Gasnikov , Martin Takáč , Slavomir Hanzely
‹ Prev 1 8 9 10 Next ›