English
Related papers

Related papers: Efficient Continuous Pareto Exploration in Multi-T…

200 papers

Machine learning applications frequently come with multiple diverse objectives and constraints that can change over time. Accordingly, trained models can be tuned with sets of hyper-parameters that affect their predictive behavior (e.g.,…

Machine Learning · Computer Science 2022-10-17 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

Many problems in robotics seek to simultaneously optimize several competing objectives under constraints. A conventional approach to solving such multi-objective optimization problems is to create a single cost function comprised of the…

Robotics · Computer Science 2022-06-02 Alexander Botros , Armin Sadeghi , Nils Wilde , Javier Alonso-Mora , Stephen L. Smith

Multi-objective optimization (MOO) problems are prevalent in machine learning. These problems have a set of optimal solutions, called the Pareto front, where each point on the front represents a different trade-off between possibly…

Machine Learning · Computer Science 2021-04-27 Aviv Navon , Aviv Shamsian , Gal Chechik , Ethan Fetaya

Multiobjective combinatorial optimization (MOCO) problems can be found in many real-world applications. However, exactly solving these problems would be very challenging, particularly when they are NP-hard. Many handcrafted heuristic…

Machine Learning · Computer Science 2022-05-10 Xi Lin , Zhiyuan Yang , Qingfu Zhang

Simultaneous optimization of multiple objective functions results in a set of trade-off, or Pareto, solutions. Choosing a, in some sense, best solution in this set is in general a challenging task: In the case of three or more objectives…

Optimization and Control · Mathematics 2023-02-01 C. Yalçın Kaya , Helmut Maurer

In multiobjective optimization, most branch and bound algorithms provide the decision maker with the whole Pareto front, and then decision maker could select a single solution finally. However, if the number of objectives is large, the…

Optimization and Control · Mathematics 2024-02-29 Weitian Wu , Xinmin Yang

In a multiobjective optimization problem a solution is called Pareto-optimal if no criterion can be improved without deteriorating at least one of the other criteria. Computing the set of all Pareto-optimal solutions is a common task in…

Data Structures and Algorithms · Computer Science 2020-10-22 Heiko Röglin

Pareto Front Learning (PFL) was recently introduced as an efficient method for approximating the entire Pareto front, the set of all optimal solutions to a Multi-Objective Optimization (MOO) problem. In the previous work, the mapping…

Optimization and Control · Mathematics 2023-08-15 Tran Anh Tuan , Long P. Hoang , Dung D. Le , Tran Ngoc Thang

Classification, recommendation, and ranking problems often involve competing goals with additional constraints (e.g., to satisfy fairness or diversity criteria). Such optimization problems are quite challenging, often involving non-convex…

Machine Learning · Computer Science 2021-02-16 Gurpreet Singh , Soumyajit Gupta , Matthew Lease , Clint Dawson

Optimization problems have been the subject of statistical physics approximations. A specially relevant and general scenario is provided by optimization methods considering tradeoffs between cost and efficiency, where optimal solutions…

Statistical Mechanics · Physics 2015-09-16 Luís F. Seoane , Ricard V. Solé

There is a well known intrinsic trade-off between the fairness of a representation and the performance of classifiers derived from the representation. Due to the complexity of optimisation algorithms in most modern representation learning…

Machine Learning · Statistics 2025-10-27 Mark Kozdoba , Binyamin Perets , Shie Mannor

A multi-task learning (MTL) system aims at solving multiple related tasks at the same time. With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of…

Machine Learning · Computer Science 2021-02-16 Xi Lin , Zhiyuan Yang , Qingfu Zhang , Sam Kwong

Linear scalarization, i.e., combining all loss functions by a weighted sum, has been the default choice in the literature of multi-task learning (MTL) since its inception. In recent years, there is a surge of interest in developing…

Machine Learning · Computer Science 2023-09-25 Yuzheng Hu , Ruicheng Xian , Qilong Wu , Qiuling Fan , Lang Yin , Han Zhao

Optimizing a set of functions simultaneously by leveraging their similarity is called multi-task optimization. Current black-box multi-task algorithms only solve a finite set of tasks, even when the tasks originate from a continuous space.…

Neural and Evolutionary Computing · Computer Science 2024-04-05 Timothée Anne , Jean-Baptiste Mouret

According to the published papers and books since the turn of the century, Pareto optimization is the dominating assessment method for multi-objective nonlinear optimization problems treated by population-based optimizers like Evolutionary…

Neural and Evolutionary Computing · Computer Science 2022-03-08 Wilfried Jakob , Christian Blume

In the past few decades, many multiobjective evolutionary optimization algorithms (MOEAs) have been proposed to find a finite set of approximate Pareto solutions for a given problem in a single run, each with its own structure. However, in…

Neural and Evolutionary Computing · Computer Science 2024-04-30 Xi Lin , Xiaoyuan Zhang , Zhiyuan Yang , Qingfu Zhang

Deep learning models form one of the most powerful machine learning models for the extraction of important features. Most of the designs of deep neural models, i.e., the initialization of parameters, are still manually tuned. Hence,…

Machine Learning · Computer Science 2023-05-18 Mrittika Chakraborty , Wreetbhas Pal , Sanghamitra Bandyopadhyay , Ujjwal Maulik

In many real-world applications, the Pareto Set (PS) of a continuous multiobjective optimization problem can be a piecewise continuous manifold. A decision maker may want to find a solution set that approximates a small part of the PS and…

Neural and Evolutionary Computing · Computer Science 2024-04-02 Ping Guo , Qingfu Zhang , Xi Lin

In the imprecise geometry model, the input is an imprecise point set, which is a family of regions $F = (R_1, \ldots,R_n)$, where for each $R_i$ one may retrieve the true point $p_i \in R_i$. By preprocessing $F$, we can construct the…

In this work, we propose a novel method to tackle the problem of multiobjective optimization under parameteric uncertainties, by considering the Conditional Pareto Sets and Conditional Pareto Fronts. Based on those quantities we can define…

Optimization and Control · Mathematics 2026-01-15 Victor Trappler , Céline Helbert , Rodolphe Le Riche