English
Related papers

Related papers: Derivative-Free Multiobjective Trust Region Descen…

200 papers

This paper proposes a technique for training a neural network by minimizing a surrogate loss that approximates the target evaluation metric, which may be non-differentiable. The surrogate is learned via a deep embedding where the Euclidean…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yash Patel , Tomas Hodan , Jiri Matas

This paper addresses some trust-region methods equipped with nonmonotone strategies for solving nonlinear unconstrained optimization problems. More specifically, the importance of using nonmonotone techniques in nonlinear optimization is…

Optimization and Control · Mathematics 2015-01-12 Masoud Ahookhosh , Susan Ghaderi

This paper addresses the study of derivative-free smooth optimization problems, where the gradient information on the objective function is unavailable. Two novel general derivative-free methods are proposed and developed for minimizing…

Optimization and Control · Mathematics 2023-11-29 Pham Duy Khanh , Boris S. Mordukhovich , Dat Ba Tran

Bayesian optimisation (BO) has been widely used to solve problems with expensive function evaluations. In multi-objective optimisation problems, BO aims to find a set of approximated Pareto optimal solutions. There are typically two ways to…

Machine Learning · Computer Science 2022-08-16 Tinkle Chugh

This article introduces a generalized framework for Decentralized Learning formulated as a Multi-Objective Optimization problem, in which both distributed agents and a central coordinator contribute independent, potentially conflicting…

Optimization and Control · Mathematics 2025-07-21 Roberto Morales , Umberto Biccari

The term `surrogate modeling' in computational science and engineering refers to the development of computationally efficient approximations for expensive simulations, such as those arising from numerical solution of partial differential…

Numerical Analysis · Mathematics 2022-08-12 Maarten V. de Hoop , Daniel Zhengyu Huang , Elizabeth Qian , Andrew M. Stuart

This paper develops a surrogate model refinement approach for the simulation of dynamical systems and the solution of optimization problems governed by dynamical systems in which surrogates replace expensive-to-compute state- and…

Optimization and Control · Mathematics 2025-09-08 Jonathan R. Cangelosi , Matthias Heinkenschloss

This paper proposes the method 2D-MoSub (2-dimensional model-based subspace method), which is a novel derivative-free optimization (DFO) method based on the subspace method for general unconstrained optimization and especially aims to solve…

Optimization and Control · Mathematics 2024-01-03 Pengcheng Xie , Ya-xiang Yuan

We present a new framework for solving general topology optimization (TO) problems that find an optimal material distribution within a design space to maximize the performance of a structure while satisfying design constraints. These…

Numerical Analysis · Mathematics 2024-11-20 Zisheng Ye , Wenxiao Pan

Many descent algorithms for multiobjective optimization have been developed in the last two decades. Tanabe et al. (Comput Optim Appl 72(2):339--361, 2019) proposed a proximal gradient method for multiobjective optimization, which can solve…

Optimization and Control · Mathematics 2022-04-11 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

Multi-objective optimization is central to many engineering and machine learning applications, where multiple objectives must be optimized in balance. While multi-gradient based optimization methods combine these objectives in each step,…

Optimization and Control · Mathematics 2026-05-13 Trang H. Tran , Luis Nunes Vicente

One of the main challenges in surrogate modeling is the limited availability of data due to resource constraints associated with computationally expensive simulations. Multi-fidelity methods provide a solution by chaining models in a…

Classical trust region methods were designed to solve problems in which function and gradient information are exact. This paper considers the case when there are bounded errors (or noise) in the above computations and proposes a simple…

Optimization and Control · Mathematics 2022-01-05 Shigeng Sun , Jorge Nocedal

We present a proximal gradient method for solving convex multiobjective optimization problems, where each objective function is the sum of two convex functions, with one assumed to be continuously differentiable. The algorithm incorporates…

Optimization and Control · Mathematics 2024-04-18 Yunier Bello-Cruz , J. G. Melo , L. F. Prudente , R. V. G. Serra

The present paper proposes a Bayesian framework for inverse problems that seamlessly integrates optimization and inversion to enable rapid surrogate modeling, accurate parameter inference, and rigorous uncertainty quantification. Bayesian…

Computational Engineering, Finance, and Science · Computer Science 2026-02-05 Mihaela Chiappetta , Massimo Carraturo , Alexander Raßloff , Markus Kästner , Ferdinando Auricchio

In this paper, we solve the l2-l1 sparse recovery problem by transforming the objective function of this problem into an unconstrained differentiable function and apply a limited-memory trust-region method. Unlike gradient projection-type…

Numerical Analysis · Mathematics 2016-03-01 Lasith Adhikari , Jennifer B. Erway , Shelby Lockhart , Roummel F. Marcia

Surrogate models are used to alleviate the computational burden in engineering tasks, which require the repeated evaluation of computationally demanding models of physical systems, such as the efficient propagation of uncertainties. For…

Machine Learning · Statistics 2022-09-28 Felix Schneider , Iason Papaioannou , Gerhard Müller

The effective contact area in rough surface contact plays a critical role in multi-physics phenomena such as wear, sealing, and thermal or electrical conduction. Although accurate numerical methods, like the Boundary Element Method (BEM),…

Computational Engineering, Finance, and Science · Computer Science 2025-04-25 Tarik Sahin , Jacopo Bonari , Sebastian Brandstaeter , Alexander Popp

Surrogate modeling is of great practical significance for parametric differential equation systems. In contrast to classical numerical methods, using physics-informed deep learning methods to construct simulators for such systems is a…

Numerical Analysis · Mathematics 2025-01-03 Xili Wang , Kejun Tang , Jiayu Zhai , Xiaoliang Wan , Chao Yang

Optimizing the reliability and the robustness of a design is important but often unaffordable due to high sample requirements. Surrogate models based on statistical and machine learning methods are used to increase the sample efficiency.…

Machine Learning · Statistics 2022-05-06 Can Bogoclu , Dirk Roos , Tamara Nestorović