English
Related papers

Related papers: Micro-Objective Learning : Accelerating Deep Reinf…

200 papers

Multi-objective decision-making problems have emerged in numerous real-world scenarios, such as video games, navigation and robotics. Considering the clear advantages of Reinforcement Learning (RL) in optimizing decision-making processes,…

Machine Learning · Computer Science 2025-01-15 Erlong Liu , Yu-Chang Wu , Xiaobin Huang , Chengrui Gao , Ren-Jian Wang , Ke Xue , Chao Qian

Multi-objective reinforcement learning (MORL) algorithms extend conventional reinforcement learning (RL) to the more general case of problems with multiple, conflicting objectives, represented by vector-valued rewards. Widely-used scalar RL…

Machine Learning · Computer Science 2026-04-23 Peter Vamplew , Ethan , Watkins , Cameron Foale , Richard Dazeley

We introduce an exploration bonus for deep reinforcement learning methods that is easy to implement and adds minimal overhead to the computation performed. The bonus is the error of a neural network predicting features of the observations…

Machine Learning · Computer Science 2018-10-31 Yuri Burda , Harrison Edwards , Amos Storkey , Oleg Klimov

Multi-objective reinforcement learning (MORL) algorithms tackle sequential decision problems where agents may have different preferences over (possibly conflicting) reward functions. Such algorithms often learn a set of policies (each…

Machine Learning · Computer Science 2023-08-16 Lucas N. Alegre , Ana L. C. Bazzan , Diederik M. Roijers , Ann Nowé , Bruno C. da Silva

Reinforcement learning (RL) has emerged as a powerful approach for tackling complex problems. The recent introduction of multi-objective reinforcement learning (MORL) has further expanded the scope of RL by enabling agents to make…

Machine Learning · Computer Science 2023-10-26 Florian Felten , Daniel Gareev , El-Ghazali Talbi , Grégoire Danoy

Multi-objective reinforcement learning (MORL) is a relatively new field which builds on conventional Reinforcement Learning (RL) to solve multi-objective problems. One of common algorithm is to extend scalar value Q-learning by using vector…

Machine Learning · Computer Science 2022-11-17 Kewen Ding

The standard reinforcement learning (RL) formulation considers the expectation of the (discounted) cumulative reward. This is limiting in applications where we are concerned with not only the expected performance, but also the distribution…

Machine Learning · Computer Science 2019-06-13 Changjian Li , Krzysztof Czarnecki

Deep Reinforcement Learning (DRL) has shown its promising capabilities to learn optimal policies directly from trial and error. However, learning can be hindered if the goal of the learning, defined by the reward function, is "not optimal".…

Artificial Intelligence · Computer Science 2019-10-09 Yizheng Zhang , Andre Rosendo

Reinforcement learning (RL) algorithms are designed to optimize problem-solving by learning actions that maximize rewards, a task that becomes particularly challenging in random and nonstationary environments. Even advanced RL algorithms…

Machine Learning · Computer Science 2025-10-31 Sebastian Zieglmeier , Niklas Erdmann , Narada D. Warakagoda

Inverse reinforcement learning (IRL) infers a reward function from demonstrations, allowing for policy improvement and generalization. However, despite much recent interest in IRL, little work has been done to understand the minimum set of…

Machine Learning · Computer Science 2019-08-19 Daniel S. Brown , Scott Niekum

Reinforcement learning synthesizes controllers without prior knowledge of the system. At each timestep, a reward is given. The controllers optimize the discounted sum of these rewards. Applying this class of algorithms requires designing a…

Machine Learning · Computer Science 2021-06-21 Ernst Moritz Hahn , Mateo Perez , Sven Schewe , Fabio Somenzi , Ashutosh Trivedi , Dominik Wojtczak

Reinforcement learning with multiple, potentially conflicting objectives is pervasive in real-world applications, while this problem remains theoretically under-explored. This paper tackles the multi-objective reinforcement learning (MORL)…

Machine Learning · Computer Science 2024-05-10 Tianchen Zhou , FNU Hairi , Haibo Yang , Jia Liu , Tian Tong , Fan Yang , Michinari Momma , Yan Gao

Real-time heuristic search algorithms satisfy a constant bound on the amount of planning per action, independent of problem size. As a result, they scale up well as problems become larger. This property would make them well suited for video…

Artificial Intelligence · Computer Science 2014-01-17 Vadim Bulitko , Yngvi Björnsson , Ramon Lawrence

Hierarchical reinforcement learning (HRL) improves the efficiency of long-horizon reinforcement-learning tasks with sparse rewards by decomposing the task into a hierarchy of subgoals. The main challenge of HRL is efficient discovery of the…

Machine Learning · Computer Science 2025-07-08 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Matthias Grossglauser

Reinforcement learning, which acquires a policy maximizing long-term rewards, has been actively studied. Unfortunately, this learning type is too slow and difficult to use in practical situations because the state-action space becomes huge…

Machine Learning · Computer Science 2024-10-28 Takato Okudo , Seiji Yamada

Deep reinforcement learning algorithms that estimate state and state-action value functions have been shown to be effective in a variety of challenging domains, including learning control strategies from raw image pixels. However,…

Machine Learning · Computer Science 2018-10-26 Peter Jin , Kurt Keutzer , Sergey Levine

In this study, we address the problem of efficient exploration in reinforcement learning. Most common exploration approaches depend on random action selection, however these approaches do not work well in environments with sparse or no…

Machine Learning · Computer Science 2022-06-30 Doğay Kamar , Nazım Kemal Üre , Gözde Ünal

Deep reinforcement learning (DRL) has recently shown its success in tackling complex combinatorial optimization problems. When these problems are extended to multiobjective ones, it becomes difficult for the existing DRL approaches to…

Artificial Intelligence · Computer Science 2022-02-15 Zizhen Zhang , Zhiyuan Wu , Hang Zhang , Jiahai Wang

Learning in multi-agent scenarios is a fruitful research direction, but current approaches still show scalability problems in multiple games with general reward settings and different opponent types. The Multi-Agent Reinforcement Learning…

Artificial Intelligence · Computer Science 2025-04-14 Diego Perez-Liebana , Katja Hofmann , Sharada Prasanna Mohanty , Noboru Kuno , Andre Kramer , Sam Devlin , Raluca D. Gaina , Daniel Ionita

Multi-objective reinforcement learning (MORL) excels at handling rapidly changing preferences in tasks that involve multiple criteria, even for unseen preferences. However, previous dominating MORL methods typically generate a fixed policy…

Machine Learning · Computer Science 2025-05-09 Ruohong Liu , Yuxin Pan , Linjie Xu , Lei Song , Jiang Bian , Pengcheng You , Yize Chen