English
Related papers

Related papers: On leveraging constrained smooth additive regressi…

200 papers

For a linear equality constrained convex optimization problem involving two objective functions with a ``nonsmooth" + ``nonsmooth" composite structure, we study two algorithms derived from a mixed-order dynamical system which incorporates…

Optimization and Control · Mathematics 2026-03-25 Geng-Hua Li , Hai-Yi Zhao , Xiangkai Sun

Stochastic inverse problems are generally solved by some form of finite sampling of a space of uncertain parameters. For computationally expensive models, surrogate response surfaces are often employed to increase the number of samples used…

Numerical Analysis · Mathematics 2018-07-04 Steven Mattis , Barbara Wohlmuth

This paper proposes an open-source distributed solver for solving Sparse Convex Optimization (SCO) problems over computational networks. Motivated by past algorithmic advances in mixed-integer optimization, the Sparse Convex Optimization…

Optimization and Control · Mathematics 2022-11-01 Alireza Olama , Eduardo Camponogara , Jan Kronqvist

The long runtime associated with simulating multidisciplinary systems challenges the use of Bayesian optimization for multidisciplinary design optimization (MDO). This is particularly the case if the coupled system is modeled in a…

Computational Engineering, Finance, and Science · Computer Science 2024-08-19 Susanna Baars , Jigar Parekh , Ihar Antonau , Philipp Bekemeyer , Ulrich Römer

Surrogate Optimization (SO) algorithms have shown promise for optimizing expensive black-box functions. However, their performance is heavily influenced by hyperparameters related to sampling and surrogate fitting, which poses a challenge…

Machine Learning · Computer Science 2023-10-13 Nazanin Nezami , Hadis Anahideh

Constrained optimization of high-dimensional numerical problems plays an important role in many scientific and industrial applications. Function evaluations in many industrial applications are severely limited and no analytical information…

Optimization and Control · Mathematics 2016-01-01 Samineh Bagheri , Wolfgang Konen , Michael Emmerich , Thomas Bäck

Real-world optimisation problems typically have objective functions which cannot be expressed analytically. These optimisation problems are evaluated through expensive physical experiments or simulations. Cheap approximations of the…

Neural and Evolutionary Computing · Computer Science 2022-11-01 Mohamed Z. Variawa , Terence L. Van Zyl , Matthew Woolway

Performing reliability analysis on complex systems is often computationally expensive. In particular, when dealing with systems having high input dimensionality, reliability estimation becomes a daunting task. A popular approach to overcome…

Machine Learning · Statistics 2021-12-22 Navaneeth N. , Souvik Chakraborty

Recent advancements in Markov chain Monte Carlo (MCMC) sampling and surrogate modelling have significantly enhanced the feasibility of Bayesian analysis across engineering fields. However, the selection and integration of surrogate models…

Computational Physics · Physics 2024-11-22 Leon Riccius , Iuri B. C. M. Rocha , Joris Bierkens , Hanne Kekkonen , Frans P. van der Meer

The computational burden of running a complex computer model can make optimization impractical. Gaussian Processes (GPs) are statistical surrogates (also known as emulators) that alleviate this issue since they cheaply replace the computer…

Computation · Statistics 2019-09-11 Theodoros Mathikolonis , Serge Guillas

Physical models classically involved Partial Differential equations (PDE) and depending of their underlying complexity and the level of accuracy required, and known to be computationally expensive to numerically solve them. Thus, an idea…

Machine Learning · Computer Science 2025-05-14 Chetra Mang , Axel TahmasebiMoradi , David Danan , Mouadh Yagoubi

To solve real-world expensive constrained multi-objective optimization problems (ECMOPs), surrogate/approximation models are commonly incorporated in evolutionary algorithms to pre-select promising candidate solutions for evaluation.…

Neural and Evolutionary Computing · Computer Science 2024-05-24 Kamrul Hasan Rahi

Classifiers are often utilized in time-constrained settings where labels must be assigned to inputs quickly. To address these scenarios, budgeted multi-stage classifiers (MSC) process inputs through a sequence of partial feature acquisition…

Neural and Evolutionary Computing · Computer Science 2021-12-06 Nolan H. Hamilton , Errin W. Fulp

Understanding structure-property relations is essential to optimally design materials for specific applications. Two-scale simulations are often employed to analyze the effect of the microstructure on a component's macroscopic properties.…

Computational Engineering, Finance, and Science · Computer Science 2022-10-25 Theron Guo , Francesco A. B. Silva , Ondřej Rokoš , Karen Veroy

Building surrogate models is one common approach when we attempt to learn unknown black-box functions. Bayesian optimization provides a framework which allows us to build surrogate models based on sequential samples drawn from the function…

Machine Learning · Computer Science 2021-09-17 Hengrui Luo , James W. Demmel , Younghyun Cho , Xiaoye S. Li , Yang Liu

Minimax optimization problems are an important class of optimization problems arising from modern machine learning and traditional research areas. While there have been many numerical algorithms for solving smooth convex-concave minimax…

Optimization and Control · Mathematics 2020-12-22 Yu-Hong Dai , Jiani Wang , Liwei Zhang

We give the first mathematically rigorous analysis of an emerging approach to finite element analysis (see, e.g., Bauer et al. [Appl. Numer. Math., 2017]), which we hereby refer to as the surrogate matrix methodology. This methodology is…

Numerical Analysis · Mathematics 2020-08-11 Daniel Drzisga , Brendan Keith , Barbara Wohlmuth

Multi-Objective Optimization (MOO) is very difficult for expensive functions because most current MOO methods rely on a large number of function evaluations to get an accurate solution. We address this problem with surrogate approximation…

Neural and Evolutionary Computing · Computer Science 2019-03-07 Taimoor Akhtar , Christine A. Shoemaker

For obtaining optimal first-order convergence guarantee for stochastic optimization, it is necessary to use a recurrent data sampling algorithm that samples every data point with sufficient frequency. Most commonly used data sampling…

Optimization and Control · Mathematics 2024-07-23 William G. Powell , Hanbaek Lyu

The aim of the present paper is to develop a strategy for solving reliability-based design optimization (RBDO) problems that remains applicable when the performance models are expensive to evaluate. Starting with the premise that…

Methodology · Statistics 2011-04-20 V. Dubourg , B. Sudret , J. -M. Bourinet