English
Related papers

Related papers: A trust-region framework for optimization using He…

200 papers

Expensive multi-objective optimization problems (EMOPs) are common in real-world scenarios where evaluating objective functions is costly and involves extensive computations or physical experiments. Current Pareto set learning methods for…

Machine Learning · Computer Science 2025-03-18 Minh-Duc Nguyen , Phuong Mai Dinh , Quang-Huy Nguyen , Long P. Hoang , Dung D. Le

This paper presents a novel learning-based approach to construct a surrogate problem that approximates a given parametric nonconvex optimization problem. The surrogate function is designed to be the minimum of a finite set of functions,…

Optimization and Control · Mathematics 2026-04-08 Renzi Wang , Panagiotis Patrinos , Alberto Bemporad

We develop and analyze a method for stochastic simulation optimization based on Gaussian process models within a trust-region framework. We focus on settings where the variance of the objective function is large, making accurate estimation…

Optimization and Control · Mathematics 2026-03-10 Mickael Binois , Jeffrey Larson

Solving optimization problems with unknown parameters often requires learning a predictive model to predict the values of the unknown parameters and then solving the problem using these values. Recent work has shown that including the…

Machine Learning · Computer Science 2020-10-23 Kai Wang , Bryan Wilder , Andrew Perrault , Milind Tambe

Modern computational methods, involving highly sophisticated mathematical formulations, enable several tasks like modeling complex physical phenomenon, predicting key properties and design optimization. The higher fidelity in these computer…

Computational Engineering, Finance, and Science · Computer Science 2023-04-13 Lele Luan , Nesar Ramachandra , Sandipp Krishnan Ravi , Anindya Bhaduri , Piyush Pandita , Prasanna Balaprakash , Mihai Anitescu , Changjie Sun , Liping Wang

This study develops a hybrid ensemble-variational approach for solving data assimilation problems. The method, called TR-4D-EnKF, is based on a trust region framework and consists of three computational steps. First an ensemble of model…

Numerical Analysis · Computer Science 2015-02-03 Elias D. Nino , Adrian Sandu

In this paper, a meshless Hermite-HDMR finite difference method is proposed to solve high-dimensional Dirichlet problems. The approach is based on the local Hermite-HDMR expansion with an additional smoothing technique. First, we introduce…

Numerical Analysis · Mathematics 2019-05-27 Xiaopeng Luo , Xin Xu , Herschel Rabitz

We introduce a two-level trust-region method (TLTR) for solving unconstrained nonlinear optimization problems. Our method uses a composite iteration step, which is based on two distinct search directions. The first search direction is…

Numerical Analysis · Mathematics 2024-09-10 Andrea Angino , Alena Kopaničáková , Rolf Krause

Derivative-Free Optimization (DFO) involves methods that rely solely on evaluations of the objective function. One of the earliest strategies for designing DFO methods is to adapt first-order methods by replacing gradients with…

Optimization and Control · Mathematics 2025-02-12 Timothé Taminiau , Estelle Massart , Geovani Nunes Grapiglia

We propose an optimization algorithm to improve the design and performance of quantum communication networks. When physical architectures become too complex for analytical methods, numerical simulation becomes essential to study quantum…

Quantum Physics · Physics 2025-08-21 Luise Prielinger , Álvaro G. Iñesta , Gayane Vardoyan

In this work we propose two Hermite-type optimization methods, Hermite least squares and Hermite BOBYQA, specialized for the case that some partial derivatives of the objective function are available and others are not. The main objective…

Computational Engineering, Finance, and Science · Computer Science 2022-04-12 Mona Fuhrländer , Sebastian Schöps

We develop an interior-point method for nonsmooth regularized bound-constrained optimization problems. Our method consists of iteratively solving a sequence of unconstrained nonsmooth barrier subproblems. We use a variant of the proximal…

Optimization and Control · Mathematics 2024-02-29 Geoffroy Leconte , Dominique Orban

Data assimilation presents computational challenges because many high-fidelity models must be simulated. Various deep-learning-based surrogate modeling techniques have been developed to reduce the simulation costs associated with these…

Machine Learning · Computer Science 2022-12-28 Su Jiang , Louis J. Durlofsky

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

Surrogate modeling is an essential data-driven technique for quantifying relationships between input variables and system responses in manufacturing and engineering systems. Two major challenges limit its effectiveness: (1) large data…

Machine Learning · Computer Science 2026-03-11 Manan Mehta , Zhiqiao Dong , Yuhang Yang , Chenhui Shao

This work introduces a new method to efficiently solve optimization problems constrained by partial differential equations (PDEs) with uncertain coefficients. The method leverages two sources of inexactness that trade accuracy for speed:…

Optimization and Control · Mathematics 2019-05-20 Matthew J. Zahr , Kevin T. Carlberg , Drew P. Kouri

The difficulty of minimizing a nonconvex function is in part explained by the presence of saddle points. This slows down optimization algorithms and impacts worst-case complexity guarantees. However, many nonconvex problems of interest…

Optimization and Control · Mathematics 2024-02-22 Florentin Goyens , Clément W. Royer

We propose a nonsmooth trust-region method for solving optimization problems with locally Lipschitz continuous functions, with application to problems constrained by variational inequalities of the second kind. Under suitable assumptions on…

Optimization and Control · Mathematics 2018-01-17 Constantin Christof , Juan Carlos De Los Reyes , Christian Meyer

Solving complex problems requires continuous effort in developing theory and practice to cope with larger, more difficult scenarios. Working with surrogates is normal for creating a proxy that realistically models the problem into the…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Tomohiro Harada , Enrique Alba , Gabriel Luque

We propose a practical Bayesian optimization method over sets, to minimize a black-box function that takes a set as a single input. Because set inputs are permutation-invariant, traditional Gaussian process-based Bayesian optimization…

Machine Learning · Statistics 2021-01-26 Jungtaek Kim , Michael McCourt , Tackgeun You , Saehoon Kim , Seungjin Choi