English
Related papers

Related papers: A note on solving nonlinear optimization problems …

200 papers

We develop a trust-region method for efficiently minimizing the sum of a smooth function, a nonsmooth convex function, and the composition of a finite-valued support function with a smooth function. Optimization problems with this structure…

Optimization and Control · Mathematics 2026-04-09 Drew P. Kouri

Historically speaking, it is hard to balance the global and local efficiency of second-order optimization algorithms. For instance, the classical Newton's method possesses excellent local convergence but lacks global guarantees, often…

Optimization and Control · Mathematics 2025-11-11 Yuntian Jiang , Chuwen Zhang , Bo Jiang , Yinyu Ye

We consider trust-region methods for solving optimization problems where the objective is the sum of a smooth, nonconvex function and a nonsmooth, convex regularizer. We extend the global convergence theory of such methods to include…

Optimization and Control · Mathematics 2025-01-10 Minh N. Dao , Hung M. Phan , Lindon Roberts

This work introduces a new method to efficiently solve optimization problems constrained by partial differential equations (PDEs) with uncertain coefficients. The method leverages two sources of inexactness that trade accuracy for speed:…

Optimization and Control · Mathematics 2019-05-20 Matthew J. Zahr , Kevin T. Carlberg , Drew P. Kouri

This paper proposes the algorithm NOWPAC (Nonlinear Optimization With Path-Augmented Constraints) for nonlinear constrained derivative-free optimization. The algorithm uses a trust region framework based on fully linear models for the…

Optimization and Control · Mathematics 2015-11-18 F. Augustin , Y. M. Marzouk

We present a new framework for solving general topology optimization (TO) problems that find an optimal material distribution within a design space to maximize the performance of a structure while satisfying design constraints. These…

Numerical Analysis · Mathematics 2024-11-20 Zisheng Ye , Wenxiao Pan

We propose a flexible gradient tracking approach with adjustable computation and communication steps for solving distributed stochastic optimization problem over networks. The proposed method allows each node to perform multiple local…

Optimization and Control · Mathematics 2023-06-13 Yan Huang , Jinming Xu

This paper introduces a modified Byrd-Omojokun (BO) trust region algorithm to address the challenges posed by noisy function and gradient evaluations. The original BO method was designed to solve equality constrained problems and it forms…

Optimization and Control · Mathematics 2024-11-06 Shigeng Sun , Jorge Nocedal

A trust-region algorithm using inexact function and derivatives values is introduced for solving unconstrained smooth optimization problems. This algorithm uses high-order Taylor models and allows the search of strong approximate minimizers…

Optimization and Control · Mathematics 2021-10-14 C. Cartis , N. I. M. Gould , Ph. L. Toint

We propose a trust-region type method for a class of nonsmooth nonconvex optimization problems where the objective function is a summation of a (probably nonconvex) smooth function and a (probably nonsmooth) convex function. The model…

Optimization and Control · Mathematics 2021-10-26 Ziang Chen , Andre Milzarek , Zaiwen Wen

High-order (non-linear) functionals have become very popular in segmentation, stereo and other computer vision problems. Level sets is a well established general gradient descent framework, which is directly applicable to optimization of…

Computer Vision and Pattern Recognition · Computer Science 2013-11-12 Lena Gorelick , Ismail BenAyed , Frank R. Schmidt , Yuri Boykov

Discrete optimization is a central problem in artificial intelligence. The optimization of the aggregated cost of a network of cost functions arises in a variety of problems including (W)CSP, DCOP, as well as optimization in stochastic…

Artificial Intelligence · Computer Science 2018-01-12 Ferdinando Fioretto , Enrico Pontelli , William Yeoh , Rina Dechter

Many nonlinear differential equations arising from practical problems may permit nontrivial multiple solutions relevant to applications, and these multiple solutions are helpful to deeply understand these practical problems and to improve…

Optimization and Control · Mathematics 2025-04-17 Lin Li , Yuheng Zhou , Pengcheng Xie , Huiyuan Li

In this work, we present a trust-region optimization framework that employs Hermite kernel surrogate models. The method targets optimization problems with computationally demanding objective functions, for which direct optimization is often…

Numerical Analysis · Mathematics 2025-07-03 Sven Ullmann , Tobias Ehring , Robin Herkert , Bernard Haasdonk

We propose a nonsmooth trust-region method for solving optimization problems with locally Lipschitz continuous functions, with application to problems constrained by variational inequalities of the second kind. Under suitable assumptions on…

Optimization and Control · Mathematics 2018-01-17 Constantin Christof , Juan Carlos De Los Reyes , Christian Meyer

Deploying neural networks on edge devices entails a careful balance between the energy required for inference and the accuracy of the resulting classification. One technique for navigating this tradeoff is approximate computing: the process…

Machine Learning · Computer Science 2025-09-18 Morteza Rezaalipour , Francesco Costa , Marco Biasion , Rodrigo Otoni , George A. Constantinides , Laura Pozzi

It seems that in the current age, computers, computation, and data have an increasingly important role to play in scientific research and discovery. This is reflected in part by the rise of machine learning and artificial intelligence,…

Machine Learning · Computer Science 2024-05-15 Ronan Keane

This paper considers an explicit continuation method and the trust-region updating strategy for the unconstrained optimization problem. Moreover, in order to improve its computational efficiency and robustness, the new method uses the…

Optimization and Control · Mathematics 2021-02-16 Xin-long Luo , Hang Xiao , Jia-hui Lv , Sen Zhang

Due to the increasing demand for high performance and cost reduction within the framework of complex system design, numerical optimization of computationally costly problems is an increasingly popular topic in most engineering fields. In…

Optimization and Control · Mathematics 2018-06-12 Julien Pelamatti , Loïc Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

Several algorithms in computer algebra involve the computation of a power series solution of a given ordinary differential equation. Over finite fields, the problem is often lifted in an approximate $p$-adic setting to be well-posed. This…

Symbolic Computation · Computer Science 2023-06-12 Pierre Lairez , Tristan Vaccon