English
Related papers

Related papers: A globally convergent filter-trust-region method f…

200 papers

In this work, we consider methods for large-scale and nonconvex unconstrained optimization. We propose a new trust-region method whose subproblem is defined using a so-called "shape-changing" norm together with densely-initialized…

Optimization and Control · Mathematics 2022-10-11 Johannes J. Brust , Jennifer B. Erway , Roummel F. Marcia

We consider minimization of indefinite quadratics with either trust-region (norm) constraints or cubic regularization. Despite the nonconvexity of these problems we prove that, under mild assumptions, gradient descent converges to their…

Optimization and Control · Mathematics 2020-08-17 Yair Carmon , John C. Duchi

In this paper, we devise a $\operatorname{prox}$-based semi-smooth Newton method for the non-differentiable TV-minimization problem. To this end, the primal-dual optimality conditions are reformulated as a nonlinear operator equation with…

Numerical Analysis · Mathematics 2026-05-22 Sören Bartels , Alex Kaltenbach

We investigate a globalized inexact semismooth Newton method applied to strongly convex optimization problems in Hilbert spaces. Here, the semismooth Newton method is appplied to the dual problem, which has a continuously differentiable…

Optimization and Control · Mathematics 2026-04-01 Daniel Wachsmuth

In this paper we present GSSN, a globalized SCD semismooth* Newton method for solving nonsmooth nonconvex optimization problems. The global convergence properties of the method are ensured by the proximal gradient method, whereas locally…

Optimization and Control · Mathematics 2025-01-27 H. Gfrerer

In this paper, we study large-scale convex optimization algorithms based on the Newton method applied to regularized generalized self-concordant losses, which include logistic regression and softmax regression. We first prove that our new…

Optimization and Control · Mathematics 2019-11-22 Ulysse Marteau-Ferey , Francis Bach , Alessandro Rudi

This paper proposes and justifies two globally convergent Newton-type methods to solve unconstrained and constrained problems of nonsmooth optimization by using tools of variational analysis and generalized differentiation. Both methods are…

Optimization and Control · Mathematics 2023-04-27 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat , Dat Ba Tran

In this paper, we propose two regularized proximal quasi-Newton methods with symmetric rank-1 update of the metric (SR1 quasi-Newton) to solve non-smooth convex additive composite problems. Both algorithms avoid using line search or other…

Optimization and Control · Mathematics 2024-11-22 Shida Wang , Jalal Fadili , Peter Ochs

We consider a variant of inexact Newton Method, called Newton-MR, in which the least-squares sub-problems are solved approximately using Minimum Residual method. By construction, Newton-MR can be readily applied for unconstrained…

Optimization and Control · Mathematics 2022-05-09 Fred Roosta , Yang Liu , Peng Xu , Michael W. Mahoney

A fractured poroelastic body is considered where the opening of the fractures is governed by a nonpenetration law while slip is described by a Coulomb-type friction law. This physical model results in a nonlinear variational inequality…

Numerical Analysis · Mathematics 2019-08-26 Runar L. Berge , Inga Berre , Eirik Keilegavlen , Jan M. Nordbotten , Barbara Wohlmuth

We improve recently introduced consensus-based optimization method, proposed in [R. Pinnau, C. Totzeck, O. Tse and S. Martin, Math. Models Methods Appl. Sci., 27(01):183--204, 2017], which is a gradient-free optimization method for general…

Optimization and Control · Mathematics 2020-03-06 José A. Carrillo , Shi Jin , Lei Li , Yuhua Zhu

Total generalization variation (TGV) is a very powerful and important regularization for various inverse problems and computer vision tasks. In this paper, we proposed a semismooth Newton based augmented Lagrangian method to solve this…

Optimization and Control · Mathematics 2022-01-28 Hongpeng Sun

We propose a trust-region method for finite-sum minimization with an adaptive sample size adjustment technique, which is practical in the sense that it leads to a globally convergent method that shows strong performance empirically without…

Optimization and Control · Mathematics 2019-10-09 Robert Mohr , Oliver Stein

This paper presents global optimal solutions to a nonconvex quadratic minimization problem over a sphere constraint. The problem is well-known as a trust region subproblem and has been studied extensively for decades. The main challenge is…

Optimization and Control · Mathematics 2013-08-22 Yi Chen , David Y. Gao

An equilibrium of a linear elastic body subject to loading and satisfying the friction and contact conditions can be described by a variational inequality of the second kind and the respective discrete model attains the form of a…

Optimization and Control · Mathematics 2021-03-04 Helmut Gfrerer , Jiri V. Outrata , Jan Valdman

We present a framework for the simulation of rigid and deformable bodies in the presence of contact and friction. Our method is based on a non-smooth Newton iteration that solves the underlying nonlinear complementarity problems (NCPs)…

This paper develops the proximal method of multipliers for a class of nonsmooth convex optimization. The method generates a sequence of minimization problems (subproblems). We show that the sequence of approximations to the solutions of the…

Numerical Analysis · Mathematics 2020-01-14 Tomoya Takeuchi

We present a monolithic parallel Newton-multigrid solver for nonlinear three dimensional fluid-structure interactions in Arbitrary Lagrangian Eulerian formulation. We start with a finite element discretization of the coupled problem, based…

Numerical Analysis · Mathematics 2020-08-11 L. Failer , T. Richter

In this paper, we propose new proximal Newton-type methods for convex optimization problems in composite form. The applications include model predictive control (MPC) and embedded MPC. Our new methods are computationally attractive since…

Optimization and Control · Mathematics 2020-07-21 Ilan Adler , Zhiyue Tom Hu , Tianyi Lin

The trust-region (TR) method is renowned historically for its robustness in nonconvex problems and extraordinary numerical performance, but the study of its performance in convex optimization is somehow limited. This paper complements the…

Optimization and Control · Mathematics 2026-01-26 Yuntian Jiang , Chang He , Chuwen Zhang , Dongdong Ge , Bo Jiang , Yinyu Ye