English
Related papers

Related papers: Unraveling the Versatility and Impact of Multi-Obj…

200 papers

Optimizing multiple, non-preferential objectives for mixed-variable, expensive black-box problems is important in many areas of engineering and science. The expensive, noisy, black-box nature of these problems makes them ideal candidates…

Machine Learning · Computer Science 2022-11-15 Haris Moazam Sheikh , Philip S. Marcus

Constrained multiobjective optimization has gained much interest in the past few years. However, constrained multiobjective optimization problems (CMOPs) are still unsatisfactorily understood. Consequently, the choice of adequate CMOPs for…

Neural and Evolutionary Computing · Computer Science 2023-02-07 Aljoša Vodopija , Tea Tušar , Bogdan Filipič

Learning-enabled control systems increasingly rely on multiple sensing modalities (e.g., vision, audio, language, etc.) for perception and decision support. A key challenge is that multi-modal sensor training dynamics are often imbalanced:…

Machine Learning · Computer Science 2026-04-01 Heshan Fernando , Quan Xiao , Parikshit Ram , Yi Zhou , Horst Samulowitz , Nathalie Baracaldo , Tianyi Chen

The development of artificial intelligence (AI) for science has led to the emergence of learning-based research paradigms, necessitating a compelling reevaluation of the design of multi-objective optimization (MOO) methods. The new…

Machine Learning · Computer Science 2023-11-02 Linxi Yang , Xinmin Yang , Liping Tang

Real-world problems are becoming highly complex and, therefore, have to be solved with combinatorial optimisation (CO) techniques. Motivated by the strong increase of publications on CO, 8,393 articles from this research field are subjected…

General Economics · Economics 2026-04-17 Jann Michael Weinand , Kenneth Sörensen , Pablo San Segundo , Max Kleinebrahm , Russell McKenna

Some real problems require the evaluation of expensive and noisy objective functions. Moreover, the analytical expression of these objective functions may be unknown. These functions are known as black-boxes, for example, estimating the…

Machine Learning · Statistics 2021-07-12 Lucia Asencio Martín , Eduardo C. Garrido-Merchán

Bayesian Optimization (BO) is a powerful tool for optimizing expensive black-box objective functions. While extensive research has been conducted on the single-objective optimization problem, the multi-objective optimization problem remains…

Machine Learning · Computer Science 2025-10-27 Lam Ngo , Huong Ha , Jeffrey Chan , Hongyu Zhang

Multimodal multi-objective problems (MMOPs) commonly arise in real-world problems where distant solutions in decision space correspond to very similar objective values. To obtain all solutions for MMOPs, many multimodal multi-objective…

Neural and Evolutionary Computing · Computer Science 2023-01-31 Wenhua Li , Tao Zhang , Rui Wang , Jing Liang

In this paper, we deal with batch Bayesian Optimization (Bayes-Opt) problems over a box and we propose a novel bi-objective optimization (BOO) acquisition strategy to sample points where to evaluate the objective function. The BOO problem…

Optimization and Control · Mathematics 2025-05-27 Francesco Carciaghi , Simone Magistri , Pierluigi Mansueto , Fabio Schoen

In multi-objective optimization, a single decision vector must balance the trade-offs between many objectives. Solutions achieving an optimal trade-off are said to be Pareto optimal: these are decision vectors for which improving any one…

Optimization and Control · Mathematics 2023-08-07 Abhishek Roy , Geelon So , Yi-An Ma

Multi-objective optimization (MOO) is a prevalent challenge for Deep Learning, however, there exists no scalable MOO solution for truly deep neural networks. Prior work either demand optimizing a new network for every point on the Pareto…

Machine Learning · Computer Science 2021-10-15 Michael Ruchte , Josif Grabocka

Balancing competing objectives is omnipresent across disciplines, from drug design to autonomous systems. Multi-objective Bayesian optimization is a promising solution for such expensive, black-box problems: it fits probabilistic surrogates…

Machine Learning · Computer Science 2026-05-13 Xinyu Zhang , Conor Hassan , Julien Martinelli , Daolang Huang , Samuel Kaski

In recent years, multimodal multiobjective optimization algorithms (MMOAs) based on evolutionary computation have been widely studied. However, existing MMOAs are mainly tested on benchmark function sets such as the 2019 IEEE Congress on…

Neural and Evolutionary Computing · Computer Science 2024-12-05 Zhiqiu Chen , Zong-Gan Chen , Yuncheng Jiang , Zhi-Hui Zhan

Multi-objective optimization (MOO) has received growing attention in applications that require learning under multiple criteria. However, the existing MOO formulations do not explicitly account for distributional shifts in the data. We…

Machine Learning · Computer Science 2026-05-08 Yufeng Yang , Fangning Zhuo , Ziyi Chen , Heng Huang , Yi Zhou

Design optimization of engineering systems with multiple competing objectives is a painstakingly tedious process especially when the objective functions are expensive-to-evaluate computer codes with parametric uncertainties. The…

Optimization and Control · Mathematics 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal , B. P. Gautham , Amol Joshi , Pramod Zagade

Design problems in industrial engineering often involve a large number of design variables with multiple objectives, under complex nonlinear constraints. The algorithms for multiobjective problems can be significantly different from the…

Optimization and Control · Mathematics 2013-03-27 Xin-She Yang

Hyperparameter optimization (HPO) is a necessary step to ensure the best possible performance of Machine Learning (ML) algorithms. Several methods have been developed to perform HPO; most of these are focused on optimizing one performance…

Machine Learning · Computer Science 2022-11-16 Alejandro Morales-Hernández , Inneke Van Nieuwenhuyse , Sebastian Rojas Gonzalez

Machine learning (ML) methods offer a wide range of configurable hyperparameters that have a significant influence on their performance. While accuracy is a commonly used performance objective, in many settings, it is not sufficient.…

Machine Learning · Computer Science 2023-09-27 Romain Egele , Tyler Chang , Yixuan Sun , Venkatram Vishwanath , Prasanna Balaprakash

Pareto front profiling in multi-objective optimization (MOO), i.e., finding a diverse set of Pareto optimal solutions, is challenging, especially with expensive objectives that require training a neural network. Typically, in MOO for neural…

Machine Learning · Computer Science 2025-02-06 Rhea Sanjay Sukthanker , Arber Zela , Benedikt Staffler , Samuel Dooley , Josif Grabocka , Frank Hutter

This paper is concerned with a recently developed paradigm for population-based optimization, termed particle filter optimization (PFO). This paradigm is attractive in terms of coherence in theory and easiness in mathematical analysis and…

Machine Learning · Statistics 2018-11-26 Bin Liu , Yaochu Jin