English
Related papers

Related papers: Efficient Multi-Objective Optimization through Pop…

200 papers

Multi-objective optimization (MOO) aims at finding a set of optimal configurations for a given set of objectives. A recent line of work applies MOO methods to the typical Machine Learning (ML) setting, which becomes multi-objective if a…

Machine Learning · Computer Science 2021-10-15 Michael Ruchte , Josif Grabocka

Real-world problems often involve the optimization of several objectives under multiple constraints. An example is the hyper-parameter tuning problem of machine learning algorithms. In particular, the minimization of the estimation of the…

Machine Learning · Statistics 2021-07-02 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Neural architecture search (NAS) automates neural network design, improving efficiency over manual approaches. However, efficiently discovering high-performance neural network architectures that simultaneously optimize multiple objectives…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Yu Xue , Pengcheng Jiang , Chenchen Zhu , Yong Zhang , Ran Cheng , Kaizhou Gao , Dunwei Gong

Multi-objective reinforcement learning (MORL) addresses the challenge of simultaneously optimizing multiple, often conflicting, rewards, moving beyond the single-reward focus of conventional reinforcement learning (RL). This approach is…

Neural and Evolutionary Computing · Computer Science 2025-05-21 Carlos Hernández , Roberto Santana

Many real-world decision-making processes rely on solving mixed-integer nonlinear programming (MINLP) problems. However, finding high-quality solutions to MINLPs is often computationally demanding. This has motivated the development of…

Optimization and Control · Mathematics 2025-10-17 Marina Cuesta , Claudia D'Ambrosio , María Durban , Vanesa Guerrero , Renan Spencer Trindade

This paper addresses the problem of active learning of a multi-output Gaussian process (MOGP) model representing multiple types of coexisting correlated environmental phenomena. In contrast to existing works, our active learning problem…

Machine Learning · Statistics 2015-11-25 Yehong Zhang , Trong Nghia Hoang , Kian Hsiang Low , Mohan Kankanhalli

Optimizing expensive to evaluate black-box functions over an input space consisting of all permutations of d objects is an important problem with many real-world applications. For example, placement of functional blocks in hardware design…

Machine Learning · Computer Science 2021-12-03 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa , Dae Hyun Kim

It has been widely observed that there exists no universal best Multi-objective Evolutionary Algorithm (MOEA) dominating all other MOEAs on all possible Multi-objective Optimization Problems (MOPs). In this work, we advocate using the…

Neural and Evolutionary Computing · Computer Science 2023-06-08 Xiasheng Ma , Shengcai Liu , Wenjing Hong

In this paper we propose a new parallel algorithm for solving global optimization (GO) multidimensional problems. The method unifies two powerful approaches for accelerating the search: parallel computations and local tuning on the behavior…

Optimization and Control · Mathematics 2011-03-31 Yaroslav D. Sergeyev

Multi-objective orienteering problems (MO-OPs) are classical multi-objective routing problems and have received a lot of attention in the past decades. This study seeks to solve MO-OPs through a problem-decomposition framework, that is, a…

Neural and Evolutionary Computing · Computer Science 2022-06-22 Wei Liu , Rui Wang , Tao Zhang , Kaiwen Li , Wenhua Li , Hisao Ishibuchi

We study the problem of generating diverse candidates in the context of Multi-Objective Optimization. In many applications of machine learning such as drug discovery and material design, the goal is to generate candidates which…

Large language models (LLMs) achieve strong performance across a wide range of tasks but are highly sensitive to prompt design, motivating the need for automatic prompt optimization. Existing methods predominantly focus on performance…

Machine Learning · Computer Science 2026-05-20 Jan Büssing , Moritz Schlager , Timo Heiß , Tom Zehle , Matthias Feurer

Bayesian Optimization (BO) is a powerful tool for optimizing expensive black-box objective functions. While extensive research has been conducted on the single-objective optimization problem, the multi-objective optimization problem remains…

Machine Learning · Computer Science 2025-10-27 Lam Ngo , Huong Ha , Jeffrey Chan , Hongyu Zhang

Application of the multi-objective particle swarm optimisation (MOPSO) algorithm to design of water distribution systems is described. An earlier MOPSO algorithm is augmented with (a) local search, (b) a modified strategy for assigning the…

Neural and Evolutionary Computing · Computer Science 2019-03-15 Mahesh B. Patil , M. Naveen Naidu , A. Vasan , Murari R. R. Varma

Mixed-integer optimization is at the core of many online decision-making systems that demand frequent updates of decisions in real time. However, due to their combinatorial nature, mixed-integer linear programs (MILPs) can be difficult to…

Optimization and Control · Mathematics 2026-04-21 Shivi Dixit , Rishabh Gupta , Qi Zhang

Multi-objective optimization problems (MOPs) require the simultaneous optimization of conflicting objectives. Real-world MOPs often exhibit complex characteristics, including high-dimensional decision spaces, many objectives, or…

Neural and Evolutionary Computing · Computer Science 2025-10-20 Haokai Hong , Liang Feng , Min Jiang , Kay Chen Tan

Stochastic computer simulations enable users to gain new insights into complex physical systems. Optimization is a common problem in this context: users seek to find model inputs that maximize the expected value of an objective function.…

Optimization and Control · Mathematics 2018-09-13 Atiye Alaeddini , Daniel J. Klein

In the field of evolutionary multi-objective optimization, the approximation of the Pareto front (PF) is achieved by utilizing a collection of representative candidate solutions that exhibit desirable convergence and diversity. Although…

Neural and Evolutionary Computing · Computer Science 2024-07-10 Peng Chen , Jing Liang , Kangjia Qiao , Ponnuthurai Nagaratnam Suganthan , Xuanxuan Ban

Parametric multi-objective optimization (PMO) addresses the challenge of solving an infinite family of multi-objective optimization problems, where optimal solutions must adapt to varying parameters. Traditional methods require re-execution…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Ji Cheng , Bo Xue , Qingfu Zhang

Deploying deep learning models requires taking into consideration neural network metrics such as model size, inference latency, and #FLOPs, aside from inference accuracy. This results in deep learning model designers leveraging…

Machine Learning · Computer Science 2024-08-20 Yiyang Zhao , Linnan Wang , Tian Guo