English
Related papers

Related papers: A Derivative-Free Trust-Region Algorithm for Relia…

200 papers

Constrained optimization in high-dimensional black-box settings is difficult due to expensive evaluations, the lack of gradient information, and complex feasibility regions. In this work, we propose a Bayesian optimization method that…

Machine Learning · Statistics 2026-03-26 Raju Chowdhury , Tanmay Sen , Prajamitra Bhuyan , Biswabrata Pradhan

Model-based reinforcement learning (RL) is considered to be a promising approach to reduce the sample complexity that hinders model-free RL. However, the theoretical understanding of such methods has been rather limited. This paper…

Machine Learning · Computer Science 2021-02-16 Yuping Luo , Huazhe Xu , Yuanzhi Li , Yuandong Tian , Trevor Darrell , Tengyu Ma

Bayesian optimization is a powerful tool for solving real-world optimization tasks under tight evaluation budgets, making it well-suited for applications involving costly simulations or experiments. However, many of these tasks are also…

Machine Learning · Computer Science 2025-06-18 Paolo Ascia , Elena Raponi , Thomas Bäck , Fabian Duddeck

This article builds on the recently proposed RB-ML-ROM approach for parameterized parabolic PDEs and proposes a novel hierarchical Trust Region algorithm for solving parabolic PDE constrained optimization problems. Instead of using a…

Optimization and Control · Mathematics 2025-03-28 Benedikt Klein , Mario Ohlberger

In this work, we utilize a Trust Region based Derivative Free Optimization (DFO-TR) method to directly maximize the Area Under Receiver Operating Characteristic Curve (AUC), which is a nonsmooth, noisy function. We show that AUC is a smooth…

Machine Learning · Computer Science 2017-03-22 Hiva Ghanbari , Katya Scheinberg

Interest in derivative-free optimization (DFO) and "evolutionary strategies" (ES) has recently surged in the Reinforcement Learning (RL) community, with growing evidence that they can match state of the art methods for policy optimization…

Optimizing industrial processes often involves gray-box models that couple algebraic glass-box equations with black-box components lacking analytic derivatives. Such systems challenge derivative-based solvers. The classical trust-region…

Optimization and Control · Mathematics 2026-04-15 Gul Hameed , Tao Chen , Antonio del Rio Chanona , Lorenz T. Biegler , Michael Short

This work proposes a framework for large-scale stochastic derivative-free optimization (DFO) by introducing STARS, a trust-region method based on iterative minimization in random subspaces. This framework is both an algorithmic and…

Optimization and Control · Mathematics 2024-09-26 Kwassi Joseph Dzahini , Stefan M. Wild

In this contribution we device and analyze improved variants of the non-conforming dual approach for trust-region reduced basis (TR-RB) approximation of PDE-constrained parameter optimization that has recently been introduced in [Keil et…

Numerical Analysis · Mathematics 2022-03-22 Stefan Banholzer , Tim Keil , Luca Mechelli , Mario Ohlberger , Felix Schindler , Stefan Volkwein

A trust-region algorithm is presented for finding approximate minimizers of smooth unconstrained functions whose values and derivatives are subject to random noise. It is shown that, under suitable probabilistic assumptions, the new method…

Optimization and Control · Mathematics 2022-01-03 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

Robust topology optimization (RTO), as a class of topology optimization problems, identifies a design with the best average performance while reducing the response sensitivity to input uncertainties, e.g. load uncertainty. Solving RTO is…

Machine Learning · Computer Science 2024-08-22 Rini Jasmine Gladstone , Mohammad Amin Nabian , Vahid Keshavarzzadeh , Hadi Meidani

We propose a stochastic first-order trust-region method with inexact function and gradient evaluations for solving finite-sum minimization problems. Using a suitable reformulation of the given problem, our method combines the inexact…

Optimization and Control · Mathematics 2022-10-25 Stefania Bellavia , Natasa Krejic , Benedetta Morini , Simone Rebegoldi

Stochastic and (distributionally) robust optimization problems often become computationally challenging as the number of scenarios or data points increases. Scenario reduction is therefore a key technique for improving tractability. We…

Optimization and Control · Mathematics 2026-03-10 Kevin-Martin Aigner , Sebastian Denzler , Frauke Liers , Sebastian Pokutta , Kartikey Sharma

This paper addresses the computational challenges in reliability-based topology optimization (RBTO) of structures associated with the estimation of statistics of the objective and constraints using standard sampling methods, and overcomes…

Optimization and Control · Mathematics 2021-07-27 Subhayan De , Kurt Maute , Alireza Doostan

Gray-box optimization, where parts of optimization problems are represented by algebraic models while others are treated as black-box models lacking analytic derivatives, remains a challenge. Trust-region (TR) methods provide a robust…

Optimization and Control · Mathematics 2026-04-15 Gul Hameed , Tao Chen , Antonio del Rio Chanona , Lorenz T. Biegler , Michael Short

We present a novel derivative-free interpolation based optimization algorithm. A trust-region method is used where a surrogate model is realized via an interpolation framework. The framework for interpolation is provided by Universal…

Optimization and Control · Mathematics 2018-05-31 Tom Lefebvre , Frederik De Belie , Guillaume Crevecoeur

We consider model-based derivative-free optimization (DFO) for large-scale problems, based on iterative minimization in random subspaces. We provide the first worst-case complexity bound for such methods for convergence to approximate…

Optimization and Control · Mathematics 2024-12-20 Coralia Cartis , Lindon Roberts

This paper introduces a modified Byrd-Omojokun (BO) trust region algorithm to address the challenges posed by noisy function and gradient evaluations. The original BO method was designed to solve equality constrained problems and it forms…

Optimization and Control · Mathematics 2024-11-06 Shigeng Sun , Jorge Nocedal

Derivative-free optimization problems are optimization problems where derivative information is unavailable. The least Frobenius norm updating quadratic interpolation model function is one of the essential under-determined model functions…

Optimization and Control · Mathematics 2023-11-21 Pengcheng Xie , Ya-xiang Yuan

Structuring ambiguity sets in Wasserstein-based distributionally robust optimization (DRO) can improve their statistical properties when the uncertainty consists of multiple independent components. The aim of this paper is to solve…

Optimization and Control · Mathematics 2025-04-10 Lotfi M. Chaouach , Tom Oomen , Dimitris Boskos