English
Related papers

Related papers: Pareto Set Learning for Neural Multi-objective Com…

200 papers

Balancing safety, efficiency, and operational costs in highway driving poses a challenging decision-making problem for heavy-duty vehicles. A central difficulty is that conventional scalar reward formulations, obtained by aggregating these…

Machine Learning · Computer Science 2026-01-27 Deepthi Pathare , Leo Laine , Morteza Haghir Chehreghani

Contrastive learning models have demonstrated impressive abilities to capture semantic similarities by aligning representations in the embedding space. However, their performance can be limited by the quality of the training data and its…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Amirabbas Afzali , Borna Khodabandeh , Ali Rasekh , Mahyar JafariNodeh , Sepehr kazemi , Simon Gottschalk

Direct preference optimization (DPO) has shown to be an effective method for large language model (LLM) alignment. Recent works have attempted to apply DPO to multimodal scenarios but have found it challenging to achieve consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Fei Wang , Wenxuan Zhou , James Y. Huang , Nan Xu , Sheng Zhang , Hoifung Poon , Muhao Chen

Many modern deep learning applications require balancing multiple objectives that are often conflicting. Examples include multi-task learning, fairness-aware learning, and the alignment of Large Language Models (LLMs). This leads to…

Machine Learning · Computer Science 2025-08-07 Weiyu Chen , Baijiong Lin , Xiaoyuan Zhang , Xi Lin , Han Zhao , Qingfu Zhang , James T. Kwok

Most multi-objective optimisation algorithms maintain an archive explicitly or implicitly during their search. Such an archive can be solely used to store high-quality solutions presented to the decision maker, but in many cases may…

Neural and Evolutionary Computing · Computer Science 2023-09-15 Miqing Li , Manuel López-Ibáñez , Xin Yao

Automating design minimizes errors, accelerates the design process, and reduces cost. However, automating robot design is challenging due to recursive constraints, multiple design objectives, and cross-domain design complexity possibly…

Robotics · Computer Science 2026-01-21 Andrew Wilhelm , Nils Napp

Optimization has found numerous applications in engineering, particularly since 1960s. Many optimization applications in engineering have more than one objective (or performance criterion). Such applications require multi-objective (or…

Chemical Physics · Physics 2024-07-16 Zhiyuan Wang , Seyed Reza Nabavi , Gade Pandu Rangaiah

Solutions to multi-objective optimization problems can generally not be compared or ordered, due to the lack of orderability of the single objectives. Furthermore, decision-makers are often made to believe that scaled objectives can be…

Optimization and Control · Mathematics 2022-05-31 Sebastian Hönel , Welf Löwe

Prior work in multi-objective reinforcement learning typically uses linear reward scalarization with fixed weights, which provably fails to capture non-convex Pareto fronts and thus yields suboptimal results. This limitation becomes…

Machine Learning · Computer Science 2026-04-01 Yining Lu , Zilong Wang , Shiyang Li , Xin Liu , Changlong Yu , Qingyu Yin , Zhan Shi , Zixuan Zhang , Meng Jiang

Solving NP-hard/complete combinatorial problems with neural networks is a challenging research area that aims to surpass classical approximate algorithms. The long-term objective is to outperform hand-designed heuristics for…

Neural and Evolutionary Computing · Computer Science 2024-02-14 Dobrik Georgiev , Danilo Numeroso , Davide Bacciu , Pietro Liò

In offline multi-objective optimization (MOO), we leverage an offline dataset of designs and their associated labels to simultaneously minimize multiple objectives. This setting more closely mirrors complex real-world problems compared to…

Computational Engineering, Finance, and Science · Computer Science 2025-02-21 Ye Yuan , Can Chen , Christopher Pal , Xue Liu

The multi-objective optimization is to optimize several objective functions over a common feasible set. Since the objectives usually do not share a common optimizer, people often consider (weakly) Pareto points. This paper studies…

Optimization and Control · Mathematics 2023-12-05 Jiawang Nie , Zi Yang

Pareto Front Learning (PFL) was recently introduced as an effective approach to obtain a mapping function from a given trade-off vector to a solution on the Pareto front, which solves the multi-objective optimization (MOO) problem. Due to…

Machine Learning · Computer Science 2023-05-02 Long P. Hoang , Dung D. Le , Tran Anh Tuan , Tran Ngoc Thang

Multi-objective reinforcement learning (MORL) approaches have emerged to tackle many real-world problems with multiple conflicting objectives by maximizing a joint objective function weighted by a preference vector. These approaches find…

Machine Learning · Computer Science 2023-05-31 Toygun Basaklar , Suat Gumussoy , Umit Y. Ogras

In many real-world applications, the Pareto Set (PS) of a continuous multiobjective optimization problem can be a piecewise continuous manifold. A decision maker may want to find a solution set that approximates a small part of the PS and…

Neural and Evolutionary Computing · Computer Science 2024-04-02 Ping Guo , Qingfu Zhang , Xi Lin

The goal of multi-objective optimization is to understand optimal trade-offs between competing objective functions by finding the Pareto front, i.e., the set of all Pareto optimal solutions, where no objective can be improved without…

Multi-objective Bayesian optimization aims to find the Pareto front of trade-offs between a set of expensive objectives while collecting as few samples as possible. In some cases, it is possible to evaluate the objectives separately, and a…

Machine Learning · Statistics 2025-03-04 Jack M. Buckingham , Sebastian Rojas Gonzalez , Juergen Branke

Multi-objective optimization (MOO) arises in many real-world applications where trade-offs between competing objectives must be carefully balanced. In the offline setting, where only a static dataset is available, the main challenge is…

Machine Learning · Computer Science 2026-02-16 Jatan Shrestha , Santeri Heiskanen , Kari Hepola , Severi Rissanen , Pekka Jääskeläinen , Joni Pajarinen

A homotopy method for multi-objective optimization that produces uniformly sampled Pareto fronts by construction is presented. While the algorithm is general, of particular interest is application to simulation-based engineering…

Optimization and Control · Mathematics 2015-05-13 Andreas Adelmann , Peter Arbenz , Andrew Foster , Yves Ineichen

Aligning large language models (LLMs) with diverse and multifaceted user preferences is a fundamental challenge in personalized AI systems. Existing multi-objective alignment methods either rely on costly training or require pre-trained…

Computation and Language · Computer Science 2026-05-26 Linhao Luo , Thuy-Trang Vu , Van-Anh Nguyen , Junae Kim , Gholamreza Haffari , Dinh Phung