English
Related papers

Related papers: Trust-region and $p$-regularized subproblems: loca…

200 papers

We consider the minimization of non-convex functions that typically arise in machine learning. Specifically, we focus our attention on a variant of trust region methods known as cubic regularization. This approach is particularly attractive…

Machine Learning · Computer Science 2017-07-04 Jonas Moritz Kohler , Aurelien Lucchi

We consider the Generalized Trust Region Subproblem (GTRS) of minimizing a nonconvex quadratic objective over a nonconvex quadratic constraint. A lifting of this problem recasts the GTRS as minimizing a linear objective subject to two…

Data Structures and Algorithms · Computer Science 2020-11-17 Alex L. Wang , Fatma Kilinc-Karzan

The main result of the paper shows that the regular $n$-gon is a local minimizer for the first Dirichlet-Laplace eigenvalue among $n$-gons having fixed area for $n \in \{5,6\}$. The eigenvalue is seen as a function of the coordinates of the…

Numerical Analysis · Mathematics 2024-06-18 Beniamin Bogosel , Dorin Bucur

In contrast to taking the dual approach for finding a global minimum solution of a double well potential function, in Part II of the paper, we characterize a local minimizer, local maximizer, and global minimizer directly from the primal…

Optimization and Control · Mathematics 2014-04-09 Yong Xia , Ruey-Lin Sheu , Shu-Cherng Fang , Wenxun Xing

One of the key assumptions in the stability and convergence analysis of variational regularization is the ability of finding global minimizers. However, such an assumption is often not feasible when the regularizer is a black box or…

Optimization and Control · Mathematics 2023-07-05 Daniel Obmann , Markus Haltmeier

The main goal of this article is to analyze some peculiar features of the global (and local) minima of $\alpha$-Brjuno functions $B_\alpha$ where $\alpha\in(0,1].$ Our starting point is the result by Balazard--Martin (2020), who showed that…

Dynamical Systems · Mathematics 2025-01-08 Ayreena Bakhtawar , Carlo Carminati , Stefano Marmi

The trust region subproblem with a fixed number m additional linear inequality constraints, denoted by (Tm), have drawn much attention recently. The question as to whether Problem (Tm) is in Class P or Class NP remains open. So far, the…

Optimization and Control · Mathematics 2013-12-06 Yong Hsia , Ruey-Lin Sheu

Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function so that along the iterations the objective function decreases. Such a simple principle allows to solve a large…

Optimization and Control · Mathematics 2025-03-04 Ion Necoara , Daniela Lupu

In this paper we address the problem of the minimization of the $k$-th Robin eigenvalue $\lambda_{k,\beta}$ with parameter $\beta>0$ among bounded open Lipschitz sets with prescribed perimeter. The perimeter constraint allows us to…

Analysis of PDEs · Mathematics 2023-12-29 Simone Cito , Alessandro Giacomini

For nonconvex optimization in machine learning, this article proves that every local minimum achieves the globally optimal value of the perturbable gradient basis model at any differentiable point. As a result, nonconvex machine learning is…

Machine Learning · Statistics 2019-11-19 Kenji Kawaguchi , Jiaoyang Huang , Leslie Pack Kaelbling

We investigate a trust-region algorithm to solve a nonconvex optimization problem with $L^p$-regularization for $p\in(0,1)$. The algorithm relies on descent properties of a so-called generalized Cauchy point that can be obtained efficiently…

Optimization and Control · Mathematics 2025-08-22 Harbir Antil , Anna Lentz

Stochastic minimax optimization has drawn much attention over the past decade due to its broad applications in machine learning, signal processing and game theory. In some applications, the probability distribution of uncertainty depends on…

Optimization and Control · Mathematics 2025-09-17 Yan Gao , Yongchao Liu , Zili Luo

We propose a stochastic first-order trust-region method with inexact function and gradient evaluations for solving finite-sum minimization problems. Using a suitable reformulation of the given problem, our method combines the inexact…

Optimization and Control · Mathematics 2022-10-25 Stefania Bellavia , Natasa Krejic , Benedetta Morini , Simone Rebegoldi

In this paper we present a method for the regularized solution of nonlinear inverse problems, based on Ivanov regularization (also called method of quasi solutions or constrained least squares regularization). This leads to the minimization…

Numerical Analysis · Mathematics 2015-09-11 Barbara Kaltenbacher , Franz Rendl , Elena Resmerita

We prove an a priori estimate for the second derivatives of local minimizers of integral functionals of calculus of variation with convex integrand with respect to the gradient variable, assuming that the function that measures the…

Analysis of PDEs · Mathematics 2018-07-30 Andrea Gentile

This paper deals with an inertial proximal algorithm that contains a Tikhonov regularization term, in connection to the minimization problem of a convex lower semicontinuous function $f$. We show that for appropriate Tikhonov regularization…

Optimization and Control · Mathematics 2024-01-09 Szilárd Csaba László

We develop a rigorous framework for global non-convex optimization by reformulating the minimization problem as a discounted infinite-horizon optimal control problem. For non-convex, continuous, and possibly non-smooth objective functions…

Optimization and Control · Mathematics 2026-03-31 Yuyang Huang , Dante Kalise , Hicham Kouhkouh

This paper is devoted to the study of tilt stability of local minimizers for classical nonlinear programs with equality and inequality constraints in finite dimensions described by twice continuously differentiable functions. The importance…

Optimization and Control · Mathematics 2016-11-24 Helmut Gfrerer , Boris S. Mordukhovich

We discuss the local minimality of certain configurations for a nonlocal isoperimetric problem used to model microphase separation in diblock copolymer melts. We show that critical configurations with positive second variation are local…

Analysis of PDEs · Mathematics 2015-06-12 Emilio Acerbi , Nicola Fusco , Massimiliano Morini

In this paper we propose a generalized condition for a sharp minimum, somewhat similar to the inexact oracle proposed recently by Devolder-Glineur-Nesterov. The proposed approach makes it possible to extend the class of applicability of…

Optimization and Control · Mathematics 2022-12-13 S. S. Ablaev , D. V. Makarenko , F. S. Stonyakin , M. S. Alkousa , I. V. Baran