English
Related papers

Related papers: Multi-Objective Simultaneous Optimistic Optimizati…

200 papers

In decision-making problems, the outcome of an intervention often depends on the causal relationships between system components and is highly costly to evaluate. In such settings, causal Bayesian optimization (CBO) can exploit the causal…

Machine Learning · Statistics 2025-02-21 Shriya Bhatija , Paul-David Zuercher , Jakob Thumm , Thomas Bohné

Multi-Objective Optimization (MOO) is an important problem in real-world applications. However, for a non-trivial problem, no single solution exists that can optimize all the objectives simultaneously. In a typical MOO problem, the goal is…

Machine Learning · Computer Science 2024-09-17 Zhang Haishan , Diptesh Das , Koji Tsuda

In multi-objective black-box optimization, the goal is typically to find solutions that optimize a set of $T$ black-box objective functions, $f_1, \ldots f_T$, simultaneously. Traditional approaches often seek a single Pareto-optimal set…

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires the prohibitive…

Machine Learning · Computer Science 2023-11-23 Ryota Ozaki , Kazuki Ishikawa , Youhei Kanzaki , Shinya Suzuki , Shion Takeno , Ichiro Takeuchi , Masayuki Karasuyama

We study the novel problem of blackbox optimization of multiple objectives via multi-fidelity function evaluations that vary in the amount of resources consumed and their accuracy. The overall goal is to approximate the true Pareto set of…

Artificial Intelligence · Computer Science 2020-11-04 Syrine Belakaria , Aryan Deshwal , Janardhan Rao Doppa

Many real-world applications involve black-box optimization of multiple objectives using continuous function approximations that trade-off accuracy and resource cost of evaluation. For example, in rocket launching research, we need to find…

Machine Learning · Statistics 2020-11-24 Syrine Belakaria , Aryan Deshwal , Janardhan Rao Doppa

Multi-armed bandit (MAB) problems are widely applied to online optimization tasks that require balancing exploration and exploitation. In practical scenarios, these tasks often involve multiple conflicting objectives, giving rise to…

Machine Learning · Computer Science 2025-06-17 Mansoor Davoodi , Setareh Maghsudi

A multiple objective simulation optimization algorithm named Multiple Objective Probabilistic Branch and Bound with Single Observation (MOPBnB(so)) is presented for approximating the Pareto optimal set and the associated efficient frontier…

Optimization and Control · Mathematics 2025-06-06 Hao Huang , Zelda B. Zabinsky

In this study, we propose a novel multi-objective Bayesian optimization (MOBO) method to efficiently identify the Pareto front (PF) defined by risk measures for black-box functions under the presence of input uncertainty (IU). Existing BO…

Machine Learning · Statistics 2023-11-27 Yu Inatsu , Shion Takeno , Hiroyuki Hanada , Kazuki Iwata , Ichiro Takeuchi

We consider the problem of multi-objective optimization (MOO) of expensive black-box functions with the goal of discovering high-quality and diverse Pareto fronts where we are allowed to evaluate a batch of inputs. This problem arises in…

Machine Learning · Computer Science 2024-06-14 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

In this paper, we introduce a novel approach for addressing the multi-objective optimization problem in large language model merging via black-box multi-objective optimization algorithms. The goal of model merging is to combine multiple…

Computation and Language · Computer Science 2024-11-26 Bingdong Li , Zixiang Di , Yanting Yang , Hong Qian , Peng Yang , Hao Hao , Ke Tang , Aimin Zhou

Most multi-objective optimisation algorithms maintain an archive explicitly or implicitly during their search. Such an archive can be solely used to store high-quality solutions presented to the decision maker, but in many cases may…

Neural and Evolutionary Computing · Computer Science 2023-09-15 Miqing Li , Manuel López-Ibáñez , Xin Yao

We propose a multi-swarm approach to approximate the Pareto front of general multi-objective optimization problems that is based on the Consensus-based Optimization method (CBO). The algorithm is motivated step by step beginning with a…

Optimization and Control · Mathematics 2022-11-30 Kathrin Klamroth , Michael Stiglmayr , Claudia Totzeck

Multi-objective optimization aims at finding trade-off solutions to conflicting objectives. These constitute the Pareto optimal set. In the context of expensive-to-evaluate functions, it is impossible and often non-informative to look for…

Machine Learning · Statistics 2020-02-20 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

We present MOSS, a multi-objective optimization framework for constructing stable sets of decision rules. MOSS incorporates three important criteria for interpretability: sparsity, accuracy, and stability, into a single multi-objective…

Optimization and Control · Mathematics 2025-07-31 Brian Liu , Rahul Mazumder

Multiobjective optimization (MOO) is prevalent in numerous applications, in which a Pareto front (PF) is constructed to display optima under various preferences. Previous methods commonly utilize the set of Pareto objectives (particles on…

Machine Learning · Computer Science 2024-02-16 Xiaoyuan Zhang , Xi Lin , Yichi Zhang , Yifan Chen , Qingfu Zhang

In this paper, we propose a new multi-objective contextual multi-armed bandit (MAB) problem with two objectives, where one of the objectives dominates the other objective. Unlike single-objective MAB problems in which the learner obtains a…

Machine Learning · Computer Science 2018-06-04 Cem Tekin , Eralp Turgay

Automated experimentation has the potential to revolutionize scientific discovery, but its effectiveness depends on well-defined optimization targets, which are often uncertain or probabilistic in real-world settings. In this work, we…

Machine Learning · Computer Science 2025-04-10 Yu Liu , Sergei V. Kalinin

Multiple-objective optimization (MOO) aims to simultaneously optimize multiple conflicting objectives and has found important applications in machine learning, such as minimizing classification loss and discrepancy in treating different…

Machine Learning · Computer Science 2022-09-16 Eric Enouen , Katja Mathesius , Sean Wang , Arielle Carr , Sihong Xie

Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the…

Machine Learning · Computer Science 2019-06-24 Biswajit Paria , Kirthevasan Kandasamy , Barnabás Póczos