English
Related papers

Related papers: A new Taxonomy of Continuous Global Optimization A…

200 papers

Evolutionary illumination is a recent technique that allows producing many diverse, optimal solutions in a map of manually defined features. To support the large amount of objective function evaluations, surrogate model assistance was…

Neural and Evolutionary Computing · Computer Science 2017-03-30 Alexander Hagg

A surrogate-based topology optimisation algorithm for linear elastic structures under parametric loads and boundary conditions is proposed. Instead of learning the parametric solution of the state (and adjoint) problems or the optimisation…

Numerical Analysis · Mathematics 2025-11-04 Matteo Giacomini , Antonio Huerta

Nature is known to be the best optimizer. Natural processes most often than not reach an optimal equilibrium. Scientists have always strived to understand and model such processes.Thus, many algorithms exist today that are inspired by…

Neural and Evolutionary Computing · Computer Science 2019-03-06 Pranshu Gupta

A new technique of global optimization and its applications in particular to neural networks are presented. The algorithm is also compared to other global optimization algorithms such as Gradient descent (GD), Monte Carlo (MC), Genetic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-18 Homayoun Valafar , Okan K. Ersoy , Faramarz Valafar

Sampling techniques are used in many fields, including design of experiments, image processing, and graphics. The techniques in each field are designed to meet the constraints specific to that field such as uniform coverage of the range of…

Machine Learning · Computer Science 2023-06-08 Chandrika Kamath

The purpose of this paper is twofold. On one side, we present a general framework for Bayesian optimization and we compare it with some related fields in active learning and Bayesian numerical analysis. On the other hand, Bayesian…

Robotics · Computer Science 2018-02-13 Ruben Martinez-Cantin

Surrogate model-based optimization has been increasingly used in the field of engineering design. It involves creating a surrogate model with objective functions or constraints based on the data obtained from simulations or real-world…

Optimization and Control · Mathematics 2023-08-28 Minyoung Jwa , Jihoon Kim , Seungyeon Shin , Ah-hyeon Jin , Dongju Shin , Namwoo Kang

Most optimization problems in real life applications are often highly nonlinear. Local optimization algorithms do not give the desired performance. So, only global optimization algorithms should be used to obtain optimal solutions. This…

Neural and Evolutionary Computing · Computer Science 2012-11-28 Mohammed El-Dosuky , Ahmed EL-Bassiouny , Taher Hamza , Magdy Rashad

Global optimization of large-scale, complex systems such as multi-physics black-box simulations and real-world industrial systems is important but challenging. This work presents a novel Surrogate-Based Optimization framework based on…

Machine Learning · Computer Science 2026-01-13 Maaz Ahmad , Iftekhar A. Karimi

Existing work on data-driven optimization focuses on problems in static environments, but little attention has been paid to problems in dynamic environments. This paper proposes a data-driven optimization algorithm to deal with the…

Neural and Evolutionary Computing · Computer Science 2020-12-29 Cuie Yang , Jinliang Ding , Yaochu Jin , Tianyou Chai

The design of neural network architectures is frequently either based on human expertise using trial/error and empirical feedback or tackled via large scale reinforcement learning strategies performed over distinct discrete architecture…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Yunyang Xiong , Ronak Mehta , Vikas Singh

Offline optimization is an emerging problem in many experimental engineering domains including protein, drug or aircraft design, where online experimentation to collect evaluation data is too expensive or dangerous. To avoid that, one has…

Machine Learning · Computer Science 2024-05-10 Yassine Chemingui , Aryan Deshwal , Trong Nghia Hoang , Janardhan Rao Doppa

Much has been said about the fusion of bio-inspired optimization algorithms and Deep Learning models for several purposes: from the discovery of network topologies and hyper-parametric configurations with improved performance for a given…

Neural and Evolutionary Computing · Computer Science 2020-08-11 Aritz D. Martinez , Javier Del Ser , Esther Villar-Rodriguez , Eneko Osaba , Javier Poyatos , Siham Tabik , Daniel Molina , Francisco Herrera

Large-scale, high-quality data are considered an essential factor for the successful application of many deep learning techniques. Meanwhile, numerous real-world deep learning tasks still have to contend with the lack of sufficient amounts…

Machine Learning · Computer Science 2023-10-26 Ou Wu , Rujing Yao

We propose and analyse a variant of the recently introduced kinetic based optimization method that incorporates ideas like survival-of-the-fittest and mutation strategies well-known from genetic algorithms. Thus, we provide a first attempt…

Optimization and Control · Mathematics 2024-07-18 Giacomo Albi , Federica Ferrarese , Claudia Totzeck

Real-world optimisation problems typically have objective functions which cannot be expressed analytically. These optimisation problems are evaluated through expensive physical experiments or simulations. Cheap approximations of the…

Neural and Evolutionary Computing · Computer Science 2022-11-01 Mohamed Z. Variawa , Terence L. Van Zyl , Matthew Woolway

Recent works in learning-integrated optimization have shown promise in settings where the optimization problem is only partially observed or where general-purpose optimizers perform poorly without expert tuning. By learning an optimizer…

Machine Learning · Computer Science 2023-11-06 Arman Zharmagambetov , Brandon Amos , Aaron Ferber , Taoan Huang , Bistra Dilkina , Yuandong Tian

Optimization problems with nonlinear cost functions and combinatorial constraints appear in many real-world applications but remain challenging to solve efficiently compared to their linear counterparts. To bridge this gap, we propose…

Machine Learning · Computer Science 2023-07-20 Aaron Ferber , Taoan Huang , Daochen Zha , Martin Schubert , Benoit Steiner , Bistra Dilkina , Yuandong Tian

Adaptive designs are increasingly used in clinical trials and online experiments to improve participant outcomes by dynamically updating treatment allocation as data accumulate. In practice, experimenters often consider multiple candidate…

Methodology · Statistics 2026-04-08 Wenxin Zhang , Aaron Hudson , Maya Petersen , Mark van der Laan

AI-assisted molecular optimization is a very active research field as it is expected to provide the next-generation drugs and molecular materials. An important difficulty is that the properties to be optimized rely on costly evaluations.…

Machine Learning · Computer Science 2025-05-19 Jules Leguy , Thomas Cauchy , Beatrice Duval , Benoit Da Mota