English
Related papers

Related papers: On efficient global optimization via universal Kri…

200 papers

Evolutionary strategies have recently been shown to achieve competing levels of performance for complex optimization problems in reinforcement learning. In such problems, one often needs to optimize an objective function subject to a set of…

Neural and Evolutionary Computing · Computer Science 2022-02-23 Youssef Diouane , Aurelien Lucchi , Vihang Patil

Multi-fidelity Kriging model is a promising technique in surrogate-based design as it can balance the model accuracy and cost of sample preparation by fusing low- and high-fidelity data. However, the cost for building a multi-fidelity…

Machine Learning · Computer Science 2023-01-03 Youwei He , Jinliang Luo

Model overconfidence and poor calibration are common in machine learning and difficult to account for when applying standard empirical risk minimization. In this work, we propose a novel method to alleviate these problems that we call…

Machine Learning · Computer Science 2024-02-13 Lukas Muttenthaler , Robert A. Vandermeulen , Qiuyi Zhang , Thomas Unterthiner , Klaus-Robert Müller

We analyse the impact of the selective pressure for the global optimisation capabilities of steady-state EAs. For the standard bimodal benchmark function \twomax we rigorously prove that using uniform parent selection leads to exponential…

Neural and Evolutionary Computing · Computer Science 2021-03-19 Dogan Corus , Andrei Lissovoi , Pietro S. Oliveto , Carsten Witt

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

Machine Learning · Computer Science 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

Many real-world systems are modelled using complex ordinary differential equations (ODEs). However, the dimensionality of these systems can make them challenging to analyze. Dimensionality reduction techniques like Proper Orthogonal…

Computational Engineering, Finance, and Science · Computer Science 2025-02-26 Abhishek Ajayakumar , Soumyendu Raha

The objective of this paper is to introduce an artificial intelligence based optimization approach, which is inspired from Piagets theory on cognitive development. The approach has been designed according to essential processes that an…

Artificial Intelligence · Computer Science 2017-04-21 Utku Kose , Ahmet Arslan

This paper investigates a constrained inverse kinematic (IK) problem that seeks a feasible configuration of an articulated robot under various constraints such as joint limits and obstacle collision avoidance. Due to the high-dimensionality…

Robotics · Computer Science 2024-06-18 Yu Chen , Yilin Cai , Jinyun Xu , Zhongqiang Ren , Guanya Shi , Howie Choset

The paper proposes a novel nature-inspired technique of optimization. It mimics the perching nature of eagles and uses mathematical formulations to introduce a new addition to metaheuristic algorithms. The nature of the proposed algorithm…

Neural and Evolutionary Computing · Computer Science 2018-07-10 Ameer Tamoor Khan , Shuai Li Senior , Predrag S. Stanimirovic , Yinyan Zhang

This work aims at developing new methodologies to optimize computational costly complex systems (e.g., aeronautical engineering systems). The proposed surrogate-based method (often called Bayesian optimization) uses adaptive sampling to…

We consider minimizing functions for which it is expensive to compute the (possibly stochastic) gradient. Such functions are prevalent in reinforcement learning, imitation learning and adversarial training. Our target optimization framework…

Machine Learning · Computer Science 2023-06-09 Jonathan Wilder Lavington , Sharan Vaswani , Reza Babanezhad , Mark Schmidt , Nicolas Le Roux

Numerous multi-objective evolutionary algorithms have been designed for constrained optimisation over past two decades. The idea behind these algorithms is to transform constrained optimisation problems into multi-objective optimisation…

Optimization and Control · Mathematics 2020-03-24 Tao Xu , Jun He , Changjing Shang

Evolutionary algorithms are particularly effective for optimisation problems with dynamic and stochastic components. We propose multi-objective evolutionary approaches for the knapsack problem with stochastic profits under static and…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Kokila Kasuni Perera , Aneta Neumann

The adoption of probabilistic models for the best individuals found so far is a powerful approach for evolutionary computation. Increasingly more complex models have been used by estimation of distribution algorithms (EDAs), which often…

Neural and Evolutionary Computing · Computer Science 2007-10-16 Leonardo Emmendorfer , Aurora Pozo

The predict-then-optimize (PTO) framework is indispensable for addressing practical stochastic decision-making tasks. It consists of two crucial steps: initially predicting unknown parameters of an optimization model and subsequently…

Systems and Control · Electrical Eng. & Systems 2024-11-20 Jixian Liu , Tao Xu , Jianping He , Chongrong Fang

In the field of reliability engineering, the Active learning reliability method combining Kriging and Monte Carlo Simulation (AK-MCS) has been developed and demonstrated to be effective in reliability analysis. However, the performance of…

Computational Engineering, Finance, and Science · Computer Science 2025-05-20 Wenxiong Li , Rong Geng , Suiyin Chen

We propose a multi-swarm approach to approximate the Pareto front of general multi-objective optimization problems that is based on the Consensus-based Optimization method (CBO). The algorithm is motivated step by step beginning with a…

Optimization and Control · Mathematics 2022-11-30 Kathrin Klamroth , Michael Stiglmayr , Claudia Totzeck

Many problems in science and technology require finding global minima or maxima of various objective functions. The functions are typically high-dimensional; each function evaluation may entail a significant computational cost. The…

Data Analysis, Statistics and Probability · Physics 2023-09-12 Jianneng Yu , Alexandre V. Morozov

It is known that the set of perturbed data is key in robust optimization (RO) modelling. Distributionally robust optimization (DRO) is a methodology used for optimization problems affected by random parameters with uncertain probability…

Optimization and Control · Mathematics 2022-05-09 Yueyao Li , Wenxun Xing

Global optimization is an active area of research in atomistic simulations, and many algorithms have been proposed to date. A prominent example is basin hopping Monte Carlo, which performs a modified Metropolis Monte Carlo search to explore…

Chemical Physics · Physics 2020-02-04 Martín Leandro Paleico , Jörg Behler