English
Related papers

Related papers: Output Space Entropy Search Framework for Multi-Ob…

200 papers

The standard implementation of the Maximum Entropy Method (MEM) follows Bryan and deploys a Singular Value Decomposition (SVD) to limit the dimensionality of the underlying solution space apriori. Here we present arguments based on the…

Computational Physics · Physics 2013-01-08 Alexander Rothkopf

Despite significant progress in the field of mathematical runtime analysis of multi-objective evolutionary algorithms (MOEAs), the performance of MOEAs on discrete many-objective problems is little understood. In particular, the few…

Neural and Evolutionary Computing · Computer Science 2025-06-24 Simon Wietheger , Benjamin Doerr

In supply chain management, decision-making often involves balancing multiple conflicting objectives, such as cost reduction, service level improvement, and environmental sustainability. Traditional multi-objective optimization methods,…

Artificial Intelligence · Computer Science 2025-09-09 Niki Kotecha , Ehecatl Antonio del Rio Chanona

Multi-objective optimization is a widely studied problem in diverse fields, such as engineering and finance, that seeks to identify a set of non-dominated solutions that provide optimal trade-offs among competing objectives. However, the…

Neural and Evolutionary Computing · Computer Science 2024-01-15 Arash Heidari , Sebastian Rojas Gonzalez , Tom Dhaene , Ivo Couckuyt

The goal of Multi-task Bayesian Optimization (MBO) is to minimize the number of queries required to accurately optimize a target black-box function, given access to offline evaluations of other auxiliary functions. When offline datasets are…

Machine Learning · Computer Science 2022-03-11 Kourosh Hakhamaneshi , Pieter Abbeel , Vladimir Stojanovic , Aditya Grover

Parameter settings profoundly impact the performance of machine learning algorithms and laboratory experiments. The classical grid search or trial-error methods are exponentially expensive in large parameter spaces, and Bayesian…

Machine Learning · Computer Science 2017-04-18 Vu Nguyen , Santu Rana , Sunil Gupta , Cheng Li , Svetha Venkatesh

Optimizing expensive to evaluate black-box functions over an input space consisting of all permutations of d objects is an important problem with many real-world applications. For example, placement of functional blocks in hardware design…

Machine Learning · Computer Science 2021-12-03 Aryan Deshwal , Syrine Belakaria , Janardhan Rao Doppa , Dae Hyun Kim

Multiobjective optimization plays an increasingly important role in modern applications, where several objectives are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to…

Optimization and Control · Mathematics 2019-06-24 Stefan Banholzer , Bennet Gebken , Michael Dellnitz , Sebastian Peitz , Stefan Volkwein

Novelty search (NS) refers to a class of exploration algorithms that seek to uncover diverse system behaviors through simulations or experiments. Such diversity is central to many AI-driven discovery and design tasks, including material and…

Machine Learning · Statistics 2025-07-31 Wei-Ting Tang , Ankush Chakrabarty , Joel A. Paulson

Multi-objective optimization (MOO) is a prevalent challenge for Deep Learning, however, there exists no scalable MOO solution for truly deep neural networks. Prior work either demand optimizing a new network for every point on the Pareto…

Machine Learning · Computer Science 2021-10-15 Michael Ruchte , Josif Grabocka

Bayesian optimization (BO) is an efficient framework for optimization of black-box objectives when function evaluations are costly and gradient information is not easily accessible. BO has been successfully applied to automate the task of…

Machine Learning · Computer Science 2024-07-09 Pallavi Mitra , Felix Biessmann

Optimizing costly black-box functions within a constrained evaluation budget presents significant challenges in many real-world applications. Surrogate Optimization (SO) is a common resolution, yet its proprietary nature introduced by the…

Machine Learning · Computer Science 2024-10-21 Nazanin Nezami , Hadis Anahideh

Max-value entropy search (MES) is one of the state-of-the-art approaches in Bayesian optimization (BO). In this paper, we propose a novel variant of MES for constrained problems, called Constrained MES via Information lower BOund…

Machine Learning · Computer Science 2023-02-21 Shion Takeno , Tomoyuki Tamura , Kazuki Shitara , Masayuki Karasuyama

Many real-world optimization problems such as engineering design can be eventually modeled as the corresponding multiobjective optimization problems (MOPs) which must be solved to obtain approximate Pareto optimal fronts. Multiobjective…

Neural and Evolutionary Computing · Computer Science 2021-11-12 Wang Chen , Jian Chen , Weitian Wu , Xinmin Yang , Hui Li

Stacked AutoEncoders (SAE) have been widely adopted in edge anomaly detection scenarios. However, the resource-intensive nature of SAE can pose significant challenges for edge devices, which are typically resource-constrained and must adapt…

Neural and Evolutionary Computing · Computer Science 2026-03-17 Lizhao Zhang , Shengsong Kong , Tao Guo , Shaobo Li , Zhenzhou Ji

We present MOSS, a multi-objective optimization framework for constructing stable sets of decision rules. MOSS incorporates three important criteria for interpretability: sparsity, accuracy, and stability, into a single multi-objective…

Optimization and Control · Mathematics 2025-07-31 Brian Liu , Rahul Mazumder

Bayesian optimization over the latent spaces of deep autoencoder models (DAEs) has recently emerged as a promising new approach for optimizing challenging black-box functions over structured, discrete, hard-to-enumerate search spaces (e.g.,…

Machine Learning · Computer Science 2023-02-24 Natalie Maus , Haydn T. Jones , Juston S. Moore , Matt J. Kusner , John Bradshaw , Jacob R. Gardner

Efficient optimization of molecules with targeted properties remains a significant challenge due to the vast size and discrete nature of chemical compound space. Conventional machine-learning-based optimization approaches typically require…

Chemical Physics · Physics 2026-03-04 Yun-Wen Mao , Roman V. Krems

AI inference scaling is often tuned through 1D heuristics (a fixed reasoning pass) or 2D bivariate trade-offs (e.g., accuracy vs. compute), which fail to consider cost and latency constraints. We introduce a 3D optimization framework that…

Machine Learning · Computer Science 2025-11-18 Minseok Jung , Abhas Ricky , Muhammad Rameez Chatni

Optimization of very expensive black-box functions requires utilization of maximum information gathered by the process of optimization. Model Guided Sampling Optimization (MGSO) forms a more robust alternative to Jones'…

Neural and Evolutionary Computing · Computer Science 2015-09-01 Lukas Bajer , Martin Holena