English
Related papers

Related papers: Pareto Front Shape-Agnostic Pareto Set Learning in…

200 papers

Data-driven offline reinforcement learning and imitation learning approaches have been gaining popularity in addressing sequential decision-making problems. Yet, these approaches rarely consider learning Pareto-optimal policies from a…

Machine Learning · Computer Science 2024-08-23 Woo Kyung Kim , Minjong Yoo , Honguk Woo

Many modern machine learning applications, such as multi-task learning, require finding optimal model parameters to trade-off multiple objective functions that may conflict with each other. The notion of the Pareto set allows us to focus on…

Optimization and Control · Mathematics 2022-09-05 Mao Ye , Qiang Liu

Controllable Pareto front learning (CPFL) approximates the Pareto solution set and then locates a Pareto optimal solution with respect to a given reference vector. However, decision-maker objectives were limited to a constraint region in…

Machine Learning · Computer Science 2024-02-12 Tran Anh Tuan , Nguyen Viet Dung , Tran Ngoc Thang

Ensuring AI models align with human values is essential for their safety and functionality. Reinforcement learning from human feedback (RLHF) leverages human preferences to achieve this alignment. However, when preferences are sourced from…

Machine Learning · Computer Science 2025-02-10 Ryan Bahlous-Boldi , Li Ding , Lee Spector , Scott Niekum

In many real-world applications, the Pareto Set (PS) of a continuous multiobjective optimization problem can be a piecewise continuous manifold. A decision maker may want to find a solution set that approximates a small part of the PS and…

Neural and Evolutionary Computing · Computer Science 2024-04-02 Ping Guo , Qingfu Zhang , Xi Lin

Abstract--- Exploiting the spatial structure in scene images is a key research direction for scene recognition. Due to the large intra-class structural diversity, building and modeling flexible structural layout to adapt various image…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Gongwei Chen , Xinhang Song , Haitao Zeng , Shuqiang Jiang

Multi-task learning, which optimizes performance across multiple tasks, is inherently a multi-objective optimization problem. Various algorithms are developed to provide discrete trade-off solutions on the Pareto front. Recently, continuous…

Machine Learning · Computer Science 2024-07-31 Weiyu Chen , James T. Kwok

Continual learning aims to learn multiple tasks sequentially. A key challenge in continual learning is balancing between two objectives: retaining knowledge from old tasks (stability) and adapting to new tasks (plasticity). Experience…

Machine Learning · Computer Science 2025-04-01 Song Lai , Zhe Zhao , Fei Zhu , Xi Lin , Qingfu Zhang , Gaofeng Meng

Tasks in multi-task learning often correlate, conflict, or even compete with each other. As a result, a single solution that is optimal for all tasks rarely exists. Recent papers introduced the concept of Pareto optimality to this field and…

Machine Learning · Computer Science 2020-08-28 Pingchuan Ma , Tao Du , Wojciech Matusik

Parallel split learning (PSL) suffers from two intertwined issues: the effective batch size grows with the number of clients, and data that is not identically and independently distributed (non-IID) skews global batches. We present parallel…

Machine Learning · Computer Science 2026-03-06 Mohammad Kohankhaki , Ahmad Ayad , Mahdi Barhoush , Anke Schmeink

Parametric multi-objective optimization (PMO) addresses the challenge of solving an infinite family of multi-objective optimization problems, where optimal solutions must adapt to varying parameters. Traditional methods require re-execution…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Ji Cheng , Bo Xue , Qingfu Zhang

Multi-task learning is a powerful method for solving multiple correlated tasks simultaneously. However, it is often impossible to find one single solution to optimize all the tasks, since different tasks might conflict with each other.…

Machine Learning · Computer Science 2020-01-01 Xi Lin , Hui-Ling Zhen , Zhenhua Li , Qingfu Zhang , Sam Kwong

This paper presents Prototypical Contrastive Learning (PCL), an unsupervised representation learning method that addresses the fundamental limitations of instance-wise contrastive learning. PCL not only learns low-level features for the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Junnan Li , Pan Zhou , Caiming Xiong , Steven C. H. Hoi

A traditional and intuitively appealing Multi-Task Multiple Kernel Learning (MT-MKL) method is to optimize the sum (thus, the average) of objective functions with (partially) shared kernel function, which allows information sharing amongst…

Machine Learning · Computer Science 2014-04-14 Cong Li , Michael Georgiopoulos , Georgios C. Anagnostopoulos

The facility location problems (FLPs) are a typical class of NP-hard combinatorial optimization problems, which are widely seen in the supply chain and logistics. Many mathematical and heuristic algorithms have been developed for optimizing…

Machine Learning · Computer Science 2022-10-28 Shiqing Liu , Xueming Yan , Yaochu Jin

Efficiently solving multi-objective optimization problems for simulation optimization of important scientific and engineering applications such as materials design is becoming an increasingly important research topic. This is due largely to…

Artificial Intelligence · Computer Science 2023-06-27 Eric Hans Lee , Bolong Cheng , Michael McCourt

This paper provides a novel parsimonious yet efficient design for zero-shot learning (ZSL), dubbed ParsNets, where we are interested in learning a composition of on-device friendly linear networks, each with orthogonality and low-rankness…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Jingcai Guo , Qihua Zhou , Ruibing Li , Xiaocheng Lu , Ziming Liu , Junyang Chen , Xin Xie , Jie Zhang

Partial Label Learning (PLL) aims to learn from the data where each training example is associated with a set of candidate labels, among which only one is correct. The key to deal with such problem is to disambiguate the candidate label…

Machine Learning · Computer Science 2019-01-11 Gengyu Lyu , Songhe Feng , Tao Wang , Congyan Lang , Yidong Li

Multi-objective reinforcement learning (MORL) provides an effective solution for decision-making problems involving conflicting objectives. However, achieving high-quality approximations to the Pareto policy set remains challenging,…

Artificial Intelligence · Computer Science 2026-03-23 Tianmeng Hu , Biao Luo

Multi-objective reinforcement learning (MORL) approaches have emerged to tackle many real-world problems with multiple conflicting objectives by maximizing a joint objective function weighted by a preference vector. These approaches find…

Machine Learning · Computer Science 2023-05-31 Toygun Basaklar , Suat Gumussoy , Umit Y. Ogras