English
Related papers

Related papers: An augmented Lagrangian trust-region method with i…

200 papers

We present a numerical method to efficiently solve optimization problems governed by large-scale nonlinear systems of equations, including discretized partial differential equations, using projection-based reduced-order models accelerated…

Optimization and Control · Mathematics 2023-04-26 Tianshu Wen , Matthew J. Zahr

In this paper, we consider augmented Lagrangian (AL) algorithms for solving large-scale nonlinear optimization problems that execute adaptive strategies for updating the penalty parameter. Our work is motivated by the recently proposed…

Optimization and Control · Mathematics 2017-01-02 Frank E. Curtis , Nicholas I. M. Gould , Hao Jiang , Daniel P. Robinson

Constrained optimization in high-dimensional black-box settings is difficult due to expensive evaluations, the lack of gradient information, and complex feasibility regions. In this work, we propose a Bayesian optimization method that…

Machine Learning · Statistics 2026-03-26 Raju Chowdhury , Tanmay Sen , Prajamitra Bhuyan , Biswabrata Pradhan

This paper is devoted to the theoretical and numerical investigation of an augmented Lagrangian method for the solution of optimization problems with geometric constraints. Specifically, we study situations where parts of the constraints…

Optimization and Control · Mathematics 2022-04-20 Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz , Gerd Wachsmuth

We study the computational complexity certification of inexact gradient augmented Lagrangian methods for solving convex optimization problems with complicated constraints. We solve the augmented Lagrangian dual problem that arises from the…

Optimization and Control · Mathematics 2013-02-19 Valentin Nedelcu , Ion Necoara , Quoc Tran Dinh

We propose a stochastic first-order trust-region method with inexact function and gradient evaluations for solving finite-sum minimization problems. Using a suitable reformulation of the given problem, our method combines the inexact…

Optimization and Control · Mathematics 2022-10-25 Stefania Bellavia , Natasa Krejic , Benedetta Morini , Simone Rebegoldi

We present an algorithm to perform trust-region-based optimization for nonlinear unconstrained problems. The method selectively uses function and gradient evaluations at different floating-point precisions to reduce the overall energy…

Optimization and Control · Mathematics 2022-02-18 Richard J Clancy , Matt Menickelly , Jan Hückelheim , Paul Hovland , Prani Nalluri , Rebecca Gjini

We propose a trust-region type method for a class of nonsmooth nonconvex optimization problems where the objective function is a summation of a (probably nonconvex) smooth function and a (probably nonsmooth) convex function. The model…

Optimization and Control · Mathematics 2021-10-26 Ziang Chen , Andre Milzarek , Zaiwen Wen

We develop a trust-region method for efficiently minimizing the sum of a smooth function, a nonsmooth convex function, and the composition of a finite-valued support function with a smooth function. Optimization problems with this structure…

Optimization and Control · Mathematics 2026-04-09 Drew P. Kouri

We consider trust-region methods for solving optimization problems where the objective is the sum of a smooth, nonconvex function and a nonsmooth, convex regularizer. We extend the global convergence theory of such methods to include…

Optimization and Control · Mathematics 2025-01-10 Minh N. Dao , Hung M. Phan , Lindon Roberts

This paper addresses a class of general nonsmooth and nonconvex composite optimization problems subject to nonlinear equality constraints. We assume that a part of the objective function and the functional constraints exhibit local…

Optimization and Control · Mathematics 2025-03-04 Lahcen El Bourkhissi , Ion Necoara , Panagiotis Patrinos , Quoc Tran-Dinh

This paper presents two new techniques relating to inexact solution of subproblems in augmented Lagrangian methods for convex programming. The first involves combining a relative error criterion for solution of the subproblems with over- or…

Optimization and Control · Mathematics 2025-09-17 Jonathan Eckstein , Chang Yu

We present an adaptive trust-region method for unconstrained optimization that allows inexact solutions to the trust-region subproblems. Our method is a simple variant of the classical trust-region method of \citet{sorensen1982newton}. The…

Optimization and Control · Mathematics 2025-08-27 Fadi Hamad , Oliver Hinder

In this paper we analyze several inexact fast augmented Lagrangian methods for solving linearly constrained convex optimization problems. Mainly, our methods rely on the combination of excessive-gap-like smoothing technique developed in…

Optimization and Control · Mathematics 2015-05-14 Andrei Patrascu , Ion Necoara , Quoc Tran-Dinh

Many large-scale optimization problems arising in science and engineering are naturally defined at multiple levels of discretization or model fidelity. Multilevel methods exploit this hierarchy to accelerate convergence by combining coarse-…

Optimization and Control · Mathematics 2025-12-02 Robert Baraldi , Michael Hintermüller , Qi Wang

In this article, we build on previous work to present an optimization algorithm for nonlinearly constrained multi-objective optimization problems. The algorithm combines a surrogate-assisted derivative-free trust-region approach with the…

Optimization and Control · Mathematics 2023-04-20 Manuel Berkemeier , Sebastian Peitz

This work introduces an unconventional inexact augmented Lagrangian method where the augmenting term is a Euclidean norm raised to a power between one and two. The proposed algorithm is applicable to a broad class of constrained nonconvex…

Optimization and Control · Mathematics 2025-11-25 Alexander Bodard , Konstantinos Oikonomidis , Emanuel Laude , Panagiotis Patrinos

In this paper, we propose and analyze a trust-region model-based algorithm for solving unconstrained stochastic optimization problems. Our framework utilizes random models of an objective function $f(x)$, obtained from stochastic…

Optimization and Control · Mathematics 2016-09-26 Ruobing Chen , Matt Menickelly , Katya Scheinberg

This paper considers an explicit continuation method and the trust-region updating strategy for the unconstrained optimization problem. Moreover, in order to improve its computational efficiency and robustness, the new method uses the…

Optimization and Control · Mathematics 2021-02-16 Xin-long Luo , Hang Xiao , Jia-hui Lv , Sen Zhang

We present a globally convergent method to accelerate density-based topology optimization using projection-based reduced-order models (ROMs) and trust-region methods. To accelerate topology optimization, we replace the large-scale finite…

Numerical Analysis · Mathematics 2021-02-03 Masayuki Yano , Tianci Huang , Matthew J. Zahr
‹ Prev 1 2 3 10 Next ›