English
Related papers

Related papers: Exact Pareto Optimal Search for Multi-Task Learnin…

200 papers

Current computer-aided synthesis planning (CASP) methods often treat retrosynthesis as solved once a single feasible route is identified, focusing primarily on convergence or shortest-path metrics. This view is misaligned with real-world…

Artificial Intelligence · Computer Science 2026-05-27 Friedrich Hastedt , Dongda Zhang , Antonio del Rio Chanona

Multi-objective optimization (MOO) problems are prevalent in machine learning. These problems have a set of optimal solutions, called the Pareto front, where each point on the front represents a different trade-off between possibly…

Machine Learning · Computer Science 2021-04-27 Aviv Navon , Aviv Shamsian , Gal Chechik , Ethan Fetaya

Expensive multi-objective optimization problems can be found in many real-world applications, where their objective function evaluations involve expensive computations or physical experiments. It is desirable to obtain an approximate Pareto…

Neural and Evolutionary Computing · Computer Science 2022-10-18 Xi Lin , Zhiyuan Yang , Xiaoyuan Zhang , Qingfu Zhang

Multi-objective optimization (MOO) is a prevalent challenge for Deep Learning, however, there exists no scalable MOO solution for truly deep neural networks. Prior work either demand optimizing a new network for every point on the Pareto…

Machine Learning · Computer Science 2021-10-15 Michael Ruchte , Josif Grabocka

Objective: Radiation therapy treatment planning is a time-consuming, iterative process with potentially high inter-planner variability. Fully automated treatment planning processes could reduce a planner's active treatment planning time and…

Medical Physics · Physics 2021-02-09 Charles Huang , Yong Yang , Neil Panjwani , Stephen Boyd , Lei Xing

Real-world problems often involve the optimization of several objectives under multiple constraints. An example is the hyper-parameter tuning problem of machine learning algorithms. In particular, the minimization of the estimation of the…

Machine Learning · Statistics 2021-07-02 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Hyperparameter optimization (HPO) is important to leverage the full potential of machine learning (ML). In practice, users are often interested in multi-objective (MO) problems, i.e., optimizing potentially conflicting objectives, like…

Machine Learning · Computer Science 2024-01-12 Joseph Giovanelli , Alexander Tornede , Tanja Tornede , Marius Lindauer

Entropy Search (ES) and Predictive Entropy Search (PES) are popular and empirically successful Bayesian Optimization techniques. Both rely on a compelling information-theoretic motivation, and maximize the information gained about the…

Machine Learning · Statistics 2018-08-06 Zi Wang , Stefanie Jegelka

This paper investigates multi-objective reinforcement learning (MORL), which focuses on learning Pareto optimal policies in the presence of multiple reward functions. Despite MORL's significant empirical success, there is still a lack of…

Machine Learning · Computer Science 2024-07-25 Shuang Qiu , Dake Zhang , Rui Yang , Boxiang Lyu , Tong Zhang

Multiobjective optimization (MOO) is prevalent in numerous applications, in which a Pareto front (PF) is constructed to display optima under various preferences. Previous methods commonly utilize the set of Pareto objectives (particles on…

Machine Learning · Computer Science 2024-02-16 Xiaoyuan Zhang , Xi Lin , Yichi Zhang , Yifan Chen , Qingfu Zhang

The multi-objective optimization is to optimize several objective functions over a common feasible set. Since the objectives usually do not share a common optimizer, people often consider (weakly) Pareto points. This paper studies…

Optimization and Control · Mathematics 2023-12-05 Jiawang Nie , Zi Yang

There are a lot of real-world black-box optimization problems that need to optimize multiple criteria simultaneously. However, in a multi-objective optimization (MOO) problem, identifying the whole Pareto front requires the prohibitive…

Machine Learning · Computer Science 2023-11-23 Ryota Ozaki , Kazuki Ishikawa , Youhei Kanzaki , Shinya Suzuki , Shion Takeno , Ichiro Takeuchi , Masayuki Karasuyama

Post-training of LLMs with RLHF, and subsequently preference optimization algorithms such as DPO, IPO, etc., made a big difference in improving human alignment. However, all such techniques can only work with a single (human) objective. In…

Machine Learning · Computer Science 2025-05-19 Akhil Agnihotri , Rahul Jain , Deepak Ramachandran , Zheng Wen

Simultaneous optimization of multiple objective functions results in a set of trade-off, or Pareto, solutions. Choosing a, in some sense, best solution in this set is in general a challenging task: In the case of three or more objectives…

Optimization and Control · Mathematics 2023-02-01 C. Yalçın Kaya , Helmut Maurer

Path planning is one of the most vital elements of mobile robotics, providing the agent with a collision-free route through the workspace. The global path plan can be calculated with a variety of informed search algorithms, most notably the…

Artificial Intelligence · Computer Science 2015-11-04 Alexander Lavin

This work addresses a Multi-Objective Shortest Path Problem (MO-SPP) on a graph where the goal is to find a set of Pareto-optimal solutions from a start node to a destination in the graph. A family of approaches based on MOA* have been…

Artificial Intelligence · Computer Science 2022-05-31 Zhongqiang Ren , Richard Zhan , Sivakumar Rathinam , Maxim Likhachev , Howie Choset

Pareto front profiling in multi-objective optimization (MOO), i.e., finding a diverse set of Pareto optimal solutions, is challenging, especially with expensive objectives that require training a neural network. Typically, in MOO for neural…

Machine Learning · Computer Science 2025-02-06 Rhea Sanjay Sukthanker , Arber Zela , Benedikt Staffler , Samuel Dooley , Josif Grabocka , Frank Hutter

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front…

Machine Learning · Computer Science 2024-06-17 Anke Tang , Li Shen , Yong Luo , Shiwei Liu , Han Hu , Bo Du

We consider the problem of multi-objective optimization (MOO) of expensive black-box functions with the goal of discovering high-quality and diverse Pareto fronts where we are allowed to evaluate a batch of inputs. This problem arises in…

Machine Learning · Computer Science 2024-06-14 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

Many modern machine learning applications, such as multi-task learning, require finding optimal model parameters to trade-off multiple objective functions that may conflict with each other. The notion of the Pareto set allows us to focus on…

Optimization and Control · Mathematics 2022-09-05 Mao Ye , Qiang Liu