English
Related papers

Related papers: Scaling Pareto-Efficient Decision Making Via Offli…

200 papers

With the success of offline reinforcement learning (RL), offline trained RL policies have the potential to be further improved when deployed online. A smooth transfer of the policy matters in safe real-world deployment. Besides, fast…

Machine Learning · Computer Science 2022-01-26 Yihuan Mao , Chao Wang , Bin Wang , Chongjie Zhang

Model-based offline Reinforcement Learning (RL) constructs environment models from offline datasets to perform conservative policy optimization. Existing approaches focus on learning state transitions through ensemble models, rollouting…

Machine Learning · Computer Science 2025-03-27 Hongye Cao , Fan Feng , Jing Huo , Shangdong Yang , Meng Fang , Tianpei Yang , Yang Gao

For a control problem with multiple conflicting objectives, there exists a set of Pareto-optimal policies called the Pareto set instead of a single optimal policy. When a multi-objective control problem is continuous and complex,…

Artificial Intelligence · Computer Science 2024-06-28 Tianye Shu , Ke Shang , Cheng Gong , Yang Nan , Hisao Ishibuchi

Many advances that have improved the robustness and efficiency of deep reinforcement learning (RL) algorithms can, in one way or another, be understood as introducing additional objectives or constraints in the policy optimization step.…

Multi-objective reinforcement learning (MORL) algorithms tackle sequential decision problems where agents may have different preferences over (possibly conflicting) reward functions. Such algorithms often learn a set of policies (each…

Machine Learning · Computer Science 2023-08-16 Lucas N. Alegre , Ana L. C. Bazzan , Diederik M. Roijers , Ann Nowé , Bruno C. da Silva

Multi-Objective Reinforcement Learning (MORL) is a generalization of traditional Reinforcement Learning (RL) that aims to optimize multiple, often conflicting objectives simultaneously rather than focusing on a single reward. This approach…

Machine Learning · Computer Science 2025-08-15 Davide Guidobene , Lorenzo Benedetti , Diego Arapovic

Data-driven offline reinforcement learning and imitation learning approaches have been gaining popularity in addressing sequential decision-making problems. Yet, these approaches rarely consider learning Pareto-optimal policies from a…

Machine Learning · Computer Science 2024-08-23 Woo Kyung Kim , Minjong Yoo , Honguk Woo

Multi-objective reinforcement learning (MORL) is increasingly relevant due to its resemblance to real-world scenarios requiring trade-offs between multiple objectives. Catering to diverse user preferences, traditional reinforcement learning…

Machine Learning · Computer Science 2024-04-08 Junlin Lu , Patrick Mannion , Karl Mason

Inferring reward functions from demonstrations and pairwise preferences are auspicious approaches for aligning Reinforcement Learning (RL) agents with human intentions. However, state-of-the art methods typically focus on learning a single…

Machine Learning · Computer Science 2022-01-04 Markus Peschl , Arkady Zgonnikov , Frans A. Oliehoek , Luciano C. Siebert

Multi-objective reinforcement learning (MORL) is used to solve problems involving multiple objectives. An MORL agent must make decisions based on the diverse signals provided by distinct reward functions. Training an MORL agent yields a set…

Artificial Intelligence · Computer Science 2024-11-08 Zuzanna Osika , Jazmin Zatarain-Salazar , Frans A. Oliehoek , Pradeep K. Murukannaiah

In Multi-objective Reinforcement Learning (MORL) agents are tasked with optimising decision-making behaviours that trade-off between multiple, possibly conflicting, objectives. MORL based on decomposition is a family of solution methods…

Machine Learning · Computer Science 2025-06-17 Yucheng Shi , David Lynch , Alexandros Agapitos

Multi-objective reinforcement learning (MORL) is an extension of ordinary, single-objective reinforcement learning (RL) that is applicable to many real-world tasks where multiple objectives exist without known relative costs. We study the…

Machine Learning · Computer Science 2021-01-12 Dongruo Zhou , Jiahao Chen , Quanquan Gu

This study introduces a novel multi-objective reinforcement learning (MORL) approach for autonomous intersection management, aiming to balance traffic efficiency and environmental sustainability across electric and internal combustion…

Systems and Control · Electrical Eng. & Systems 2025-12-15 Matteo Cederle , Marco Fabris , Gian Antonio Susto

Scalarisation functions are widely employed in MORL algorithms to enable intelligent decision-making. However, these functions often struggle to approximate the Pareto front accurately, rendering them unideal in complex, uncertain…

Machine Learning · Computer Science 2025-11-21 Muhammad Sa'ood Shah , Asad Jeewa

Recently, successful applications of reinforcement learning to chip placement have emerged. Pretrained models are necessary to improve efficiency and effectiveness. Currently, the weights of objective metrics (e.g., wirelength, congestion,…

Multi-objective reinforcement learning (MORL) aims to optimize policies in the presence of conflicting objectives, where linear scalarization is commonly used to reduce vector-valued returns into scalar signals. While effective for certain…

Machine Learning · Computer Science 2025-11-19 Woosung Kim , Jinho Lee , Jongmin Lee , Byung-Jun Lee

Multi-Objective Reinforcement Learning (MORL) aims to learn a set of policies that optimize trade-offs between multiple, often conflicting objectives. MORL is computationally more complex than single-objective RL, particularly as the number…

Machine Learning · Computer Science 2026-03-27 Dimitris Michailidis , Willem Röpke , Diederik M. Roijers , Sennay Ghebreab , Fernando P. Santos

Multi-objective reinforcement learning (MORL) is a powerful tool to learn Pareto-optimal policy families across conflicting objectives. However, unlike traditional RL algorithms, existing MORL algorithms do not effectively leverage…

Robotics · Computer Science 2026-03-11 Neil Janwani , Ellen Novoseller , Vernon J. Lawhern , Maegan Tucker

Transmission grid congestion increases as the electrification of various sectors requires transmitting more power. Topology control, through substation reconfiguration, can reduce congestion but its potential remains under-exploited in…

Machine Learning · Computer Science 2025-05-02 Thomas Lautenbacher , Ali Rajaei , Davide Barbieri , Jan Viebahn , Jochen L. Cremer

Multi-objective reinforcement learning (MORL) is essential for addressing the intricacies of real-world RL problems, which often require trade-offs between multiple utility functions. However, MORL is challenging due to unstable learning…

Machine Learning · Computer Science 2024-07-25 Mikhail Terekhov , Caglar Gulcehre