English
Related papers

Related papers: Parametric Pareto Set Learning for Expensive Multi…

200 papers

Hyperparameter optimization (HPO) is an important step in machine learning (ML) model development, but common practices are archaic -- primarily relying on manual or grid searches. This is partly because adopting advanced HPO algorithms…

Machine Learning · Computer Science 2024-02-08 Sungduk Yu , Mike Pritchard , Po-Lun Ma , Balwinder Singh , Sam Silva

Learning to Optimize (L2O) is a subfield of machine learning (ML) in which ML models are trained to solve parametric optimization problems. The general goal is to learn a fast approximator of solutions to constrained optimization problems,…

Optimization and Control · Mathematics 2025-12-04 James Kotary , Himanshu Sharma , Ethan King , Draguna Vrabie , Ferdinando Fioretto , Jan Drgona

Multi-task trade-offs in machine learning can be addressed via Pareto Front Learning (PFL) methods that parameterize the Pareto Front (PF) with a single model. PFL permits to select the desired operational point during inference, contrary…

Machine Learning · Computer Science 2025-02-27 Nikolaos Dimitriadis , Pascal Frossard , Francois Fleuret

Particle accelerators require constant tuning during operation to meet beam quality, total charge and particle energy requirements for use in a wide variety of physics, chemistry and biology experiments. Maximizing the performance of an…

Accelerator Physics · Physics 2021-06-16 Ryan Roussel , Adi Hanuka , Auralee Edelen

The popularity of Bayesian Optimization (BO) to automate or support the commissioning of engineering systems is rising. Conventional BO, however, relies on the availability of a scalar objective function. The latter is often difficult to…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Sander De Witte , Jeroen Taets , Andras Retzler , Guillaume Crevecoeur , Tom Lefebvre

any practical multiobjective optimization (MOO) problems include discrete decision variables and/or nonlinear model equations and exhibit disconnected or smooth but nonconvex Pareto surfaces. Scalarization methods, such as the weighted-sum…

Optimization and Control · Mathematics 2024-10-23 Ye Seol Lee , George Jackson , Amparo Galindo , Claire S. Adjiman

The rapid development of large language model (LLM) alignment algorithms has resulted in a complex and fragmented landscape, with limited clarity on the effectiveness of different methods and their inter-connections. This paper introduces…

Many systems require optimisation over multiple objectives, where objectives are characteristics of the system such as energy consumed or increase in time to perform the work. Optimisation is performed by selecting the `best' set of input…

Performance · Computer Science 2019-10-08 Alexander J. M. Kell , Matthew Forshaw , A. Stephen McGough

In last decades optimization and control of complex systems that possessed various conflicted objectives simultaneously attracted an incremental interest of scientists. This is because of the vast applications of these systems in various…

Neural and Evolutionary Computing · Computer Science 2013-12-17 Ahmad Mozaffari , Alireza Fathi

Hyperparameter optimization (HPO) plays a central role in the performance of deep learning models, yet remains computationally expensive and difficult to interpret, particularly for time-series forecasting. While Bayesian Optimization (BO)…

Machine Learning · Computer Science 2026-02-17 Ons Saadallah , Mátyás andó , Tamás Gábor Orosz

This paper presents VBMO, the Voting-Based Multi-Objective path planning algorithm, that generates optimal single-objective plans, evaluates each of them with respect to the other objectives, and selects one with a voting mechanism. VBMO…

Artificial Intelligence · Computer Science 2023-08-24 Raj Korpan

Most of the research on Federated Learning (FL) has focused on analyzing global optimization, privacy, and communication, with limited attention focusing on analyzing the critical matter of performing efficient local training and inference…

Machine Learning · Computer Science 2020-09-09 Basheer Qolomany , Kashif Ahmad , Ala Al-Fuqaha , Junaid Qadir

Automated hyperparameter optimization (HPO) can support practitioners to obtain peak performance in machine learning models. However, there is often a lack of valuable insights into the effects of different hyperparameters on the final…

Machine Learning · Computer Science 2022-01-27 Julia Moosbauer , Julia Herbinger , Giuseppe Casalicchio , Marius Lindauer , Bernd Bischl

Multiobjective optimization plays an increasingly important role in modern applications, where several objectives are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to…

Optimization and Control · Mathematics 2019-06-24 Stefan Banholzer , Bennet Gebken , Michael Dellnitz , Sebastian Peitz , Stefan Volkwein

Molecular discovery is a multi-objective optimization problem that requires identifying a molecule or set of molecules that balance multiple, often competing, properties. Multi-objective molecular design is commonly addressed by combining…

Quantitative Methods · Quantitative Biology 2023-10-17 Jenna C. Fromer , Connor W. Coley

Multi-objective reinforcement learning (MORL) excels at handling rapidly changing preferences in tasks that involve multiple criteria, even for unseen preferences. However, previous dominating MORL methods typically generate a fixed policy…

Machine Learning · Computer Science 2025-05-09 Ruohong Liu , Yuxin Pan , Linjie Xu , Lei Song , Jiang Bian , Pengcheng You , Yize Chen

Service supply chain management is to prepare spare parts for failed products under warranty. Their goal is to reach agreed service level at the minimum cost. We convert this business problem into a preference based multi-objective…

Artificial Intelligence · Computer Science 2019-06-20 Wenli Ouyang

In this work, we propose a novel method to tackle the problem of multiobjective optimization under parameteric uncertainties, by considering the Conditional Pareto Sets and Conditional Pareto Fronts. Based on those quantities we can define…

Optimization and Control · Mathematics 2026-01-15 Victor Trappler , Céline Helbert , Rodolphe Le Riche

The facility location problems (FLPs) are a typical class of NP-hard combinatorial optimization problems, which are widely seen in the supply chain and logistics. Many mathematical and heuristic algorithms have been developed for optimizing…

Machine Learning · Computer Science 2022-10-28 Shiqing Liu , Xueming Yan , Yaochu Jin

Dynamic multi-objective optimization (DMOO) has recently attracted increasing interest from both academic researchers and engineering practitioners, as numerous real-world applications that evolve over time can be naturally formulated as…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Chang Shao , Qi Zhao , Nana Pu , Shi Cheng , Jing Jiang , Yuhui Shi