English
Related papers

Related papers: A Second-Order Cone Based Approach for Solving the…

200 papers

We study the composite convex optimization problems with a Quasi-Self-Concordant smooth component. This problem class naturally interpolates between classic Self-Concordant functions and functions with Lipschitz continuous Hessian.…

Optimization and Control · Mathematics 2023-08-29 Nikita Doikov

In this contribution we device and analyze improved variants of the non-conforming dual approach for trust-region reduced basis (TR-RB) approximation of PDE-constrained parameter optimization that has recently been introduced in [Keil et…

Numerical Analysis · Mathematics 2022-03-22 Stefan Banholzer , Tim Keil , Luca Mechelli , Mario Ohlberger , Felix Schindler , Stefan Volkwein

Manifold optimization has recently gained significant attention due to its wide range of applications in various areas. This paper introduces the first Riemannian trust region method for minimizing an SC$^1$ function, which is a…

Optimization and Control · Mathematics 2024-06-03 Chenyu Zhang , Rufeng Xiao , Wen Huang , Rujun Jiang

This paper tackles the challenging problem of finding global optimal solutions for two-stage stochastic programs with continuous decision variables and nonconvex recourse functions. We introduce a two-phase approach. The first phase…

Optimization and Control · Mathematics 2024-05-29 Suhan Zhong , Ying Cui , Jiawang Nie

This paper presents a novel convex optimization-based method for finding the globally optimal solutions of a class of mixed-integer non-convex optimal control problems. We consider problems with non-convex constraints that restrict the…

Optimization and Control · Mathematics 2019-11-21 Danylo Malyuta , Behcet Acikmese

In this paper we study second-order optimality conditions for non-convex set-constrained optimization problems. For a convex set-constrained optimization problem, it is well-known that second-order optimality conditions involve the support…

Optimization and Control · Mathematics 2020-01-15 Helmut Gfrerer , Jane Ye , Jinchuan Zhou

This work is on constrained large-scale non-convex optimization where the constraint set implies a manifold structure. Solving such problems is important in a multitude of fundamental machine learning tasks. Recent advances on Riemannian…

Machine Learning · Computer Science 2023-02-23 Yian Deng , Tingting Mu

Classical trust region methods were designed to solve problems in which function and gradient information are exact. This paper considers the case when there are bounded errors (or noise) in the above computations and proposes a simple…

Optimization and Control · Mathematics 2022-01-05 Shigeng Sun , Jorge Nocedal

This paper deals with the impact of linear approximations for the unknown nonconvex confidence region of chance-constrained AC optimal power flow problems. Such approximations are required for the formulation of tractable chance…

Systems and Control · Computer Science 2018-10-03 Lejla Halilbasic , Pierre Pinson , Spyros Chatzivasileiadis

We propose a stochastic nonconvex optimization algorithm that achieves almost sure $\tilde{\mathcal{O}}(\epsilon^{-1.5})$ iteration complexity for problems with smooth objective functions and gradients only observable with noise. The…

Optimization and Control · Mathematics 2026-04-30 Yunsoo Ha , Sara Shashaani , Quoc Tran-dinh

In this paper we consider finding an approximate second-order stationary point (SOSP) of nonconvex conic optimization that minimizes a twice differentiable function over the intersection of an affine subspace and a convex cone. In…

Optimization and Control · Mathematics 2022-10-12 Chuan He , Zhaosong Lu

Coordinate-type subgradient methods for addressing nonsmooth optimization problems are relatively underexplored due to the set-valued nature of the subdifferential. In this work, our study focuses on nonsmooth composite optimization…

Optimization and Control · Mathematics 2023-08-24 Lei Zhao , Ding Chen , Daoli Zhu , Xiao Li

A trust-region algorithm using inexact function and derivatives values is introduced for solving unconstrained smooth optimization problems. This algorithm uses high-order Taylor models and allows the search of strong approximate minimizers…

Optimization and Control · Mathematics 2021-10-14 C. Cartis , N. I. M. Gould , Ph. L. Toint

In this paper we develop a higher-order method for solving composite (non)convex minimization problems with smooth (non)convex functional constraints. At each iteration our method approximates the smooth part of the objective function and…

Optimization and Control · Mathematics 2025-03-04 Yassine Nabou , Ion Necoara

The $p$-regularized subproblem (p-RS) is a regularisation technique in computing a Newton-like step for unconstrained optimization, which globally minimizes a local quadratic approximation of the objective function while incorporating with…

Optimization and Control · Mathematics 2018-05-01 Yong Hsia , Ruey-Lin Sheu , Ya-xiang Yuan

We introduce two multifidelity trust-region methods based on the Magical Trust Region (MTR) framework. MTR augments the classical trust-region step with a secondary, informative direction. In our approaches, the secondary ``magical''…

Numerical Analysis · Mathematics 2025-11-04 Andrea Angino , Matteo Aurina , Alena Kopaničáková , Matthias Voigt , Marco Donatelli , Rolf Krause

An algorithm is proposed for solving stochastic and finite sum minimization problems. Based on a trust region methodology, the algorithm employs normalized steps, at least as long as the norms of the stochastic gradient estimates are within…

Optimization and Control · Mathematics 2018-06-27 Frank E. Curtis , Katya Scheinberg , Rui Shi

For solving large-scale non-convex problems, we propose inexact variants of trust region and adaptive cubic regularization methods, which, to increase efficiency, incorporate various approximations. In particular, in addition to approximate…

Optimization and Control · Mathematics 2018-02-21 Zhewei Yao , Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

Conic optimization has recently emerged as a powerful tool for designing tractable and guaranteed algorithms for non-convex polynomial optimization problems. On the one hand, tractability is crucial for efficiently solving large-scale…