English
Related papers

Related papers: PMGDA: A Preference-based Multiple Gradient Descen…

200 papers

Parametric multi-objective optimization (PMO) addresses the challenge of solving an infinite family of multi-objective optimization problems, where optimal solutions must adapt to varying parameters. Traditional methods require re-execution…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Ji Cheng , Bo Xue , Qingfu Zhang

Multi-objective preference alignment in language models often encounters a challenging trade-off: optimizing for one human preference (e.g., helpfulness) frequently compromises others (e.g., harmlessness) due to the inherent conflicts…

Computation and Language · Computer Science 2025-04-16 Zhihao Xu , Yongqi Tong , Xin Zhang , Jun Zhou , Xiting Wang

In this work we are interested in stochastic particle methods for multi-objective optimization. The problem is formulated using parametrized, single-objective sub-problems which are solved simultaneously. To this end a consensus based…

Optimization and Control · Mathematics 2022-08-03 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

Pareto Set Learning (PSL) is popular as an efficient approach to obtaining the complete optimal solution in Multi-objective Learning (MOL). A set of optimal solutions approximates the Pareto set, and its mapping is a set of dense points in…

Machine Learning · Computer Science 2025-12-11 Minh-Duc Nguyen , Dung D. Le

Projected Gradient Descent (PGD) methods offer a simple and scalable approach to topology optimization (TO), yet they often struggle with nonlinear and multi-constraint problems due to the complexity of active-set detection. This paper…

Computational Engineering, Finance, and Science · Computer Science 2025-11-19 Amin Heyrani Nobari , Faez Ahmed

This work focuses on a class of general decentralized constraint-coupled optimization problems. We propose a novel nested primal-dual gradient algorithm (NPGA), which can achieve linear convergence under the weakest known condition, and its…

Optimization and Control · Mathematics 2025-05-06 Jingwang Li , Housheng Su

This paper proposes the multi objective variant of the recently introduced fitness dependent optimizer (FDO). The algorithm is called a Multi objective Fitness Dependent Optimizer (MOFDO) and is equipped with all five types of knowledge…

Neural and Evolutionary Computing · Computer Science 2023-02-14 Jaza M. Abdullah , Tarik A. Rashid , Bestan B. Maaroof , Seyedali Mirjalili

In several multiobjective decision problems Pairwise Comparison Matrices (PCM) are applied to evaluate the decision variants. The problem that arises very often is the inconsistency of a given PCM. In such a situation it is important to…

Optimization and Control · Mathematics 2024-12-10 Marcin Anholcer , Janos Fülöp

Many decision-making problems feature multiple objectives where it is not always possible to know the preferences of a human or agent decision-maker for different objectives. However, demonstrated behaviors from the decision-maker are often…

Artificial Intelligence · Computer Science 2024-10-01 Junlin Lu , Patrick Mannion , Karl Mason

This note proposes an algorithm to generate the Pareto front of a mixed discrete multi-objective optimization problem based on the pruning of irrelevant subproblems. An existing pruning-based method for a mixed discrete bi-objective problem…

Optimization and Control · Mathematics 2017-09-28 Juseong Lee , Sang-Il Lee , Jaemyung Ahn , Han-Lim Choi

The goal of multi-objective reinforcement learning (MORL) is to learn policies that simultaneously optimize multiple competing objectives. In practice, an agent's preferences over the objectives may not be known apriori, and hence, we…

Machine Learning · Computer Science 2023-05-02 Baiting Zhu , Meihua Dang , Aditya Grover

During the past two decades, multi-agent optimization problems have drawn increased attention from the research community. When multiple objective functions are present among agents, many works optimize the sum of these objective functions.…

Multiagent Systems · Computer Science 2020-10-13 M. J. Blondin , M. T. Hale

Physics-informed machine learning (PIML) is crucial in modern traffic flow modeling because it combines the benefits of both physics-based and data-driven approaches. In conventional PIML, physical information is typically incorporated by…

Machine Learning · Computer Science 2025-09-23 Yuan-Zheng Lei , Yaobang Gong , Dianwei Chen , Yao Cheng , Xianfeng Terry Yang

We present some first results concerning a gradient-based dynamic approach to multi-objective optimization problems, involving inertial effects. We prove the existence of global solution trajectories for this second-order differential…

Optimization and Control · Mathematics 2015-06-10 Hédy Attouch , Guillaume Garrigos

As the interest in multi- and many-objective optimization algorithms grows, the performance comparison of these algorithms becomes increasingly important. A large number of performance indicators for multi-objective optimization algorithms…

Artificial Intelligence · Computer Science 2024-11-28 Amin Ibrahim , Azam Asilian Bidgoli , Shahryar Rahnamayan , Kalyanmoy Deb

This paper proposes a Riemannian Multiobjective Proximal Gradient Method (RMPGM) for composite optimization problems on manifolds. Unlike scalarization-based approaches, the proposed framework directly handles vector-valued objectives and…

Optimization and Control · Mathematics 2026-05-19 Kangming Chen

Preference based alignment objectives implicitly assume that all human preferences are expressed with equal strength. In practice, however, preference strength varies across individuals and contexts -- a phenomenon established in behavioral…

Machine Learning · Computer Science 2026-01-13 Saki Imai , Pedram Heydari , Anthony Sicilia , Asteria Kaeberlein , Katherine Atwell , Malihe Alikhani

Most multi-objective optimisation algorithms maintain an archive explicitly or implicitly during their search. Such an archive can be solely used to store high-quality solutions presented to the decision maker, but in many cases may…

Neural and Evolutionary Computing · Computer Science 2023-09-15 Miqing Li , Manuel López-Ibáñez , Xin Yao

Following the introduction of Adam, several novel adaptive optimizers for deep learning have been proposed. These optimizers typically excel in some tasks but may not outperform Adam uniformly across all tasks. In this work, we introduce…

Machine Learning · Computer Science 2024-06-18 Kaan Ozkara , Can Karakus , Parameswaran Raman , Mingyi Hong , Shoham Sabach , Branislav Kveton , Volkan Cevher

Preference aggregation is a core operation in multi-objective design optimisation and group decision-making, as it determines the best-fit-for-common-purpose alternative within complex socio-technical contexts. Therefore, their aggregation…

Optimization and Control · Mathematics 2026-01-28 A. R. M. , Wolfert