English
Related papers

Related papers: Distributional Reward Decomposition for Reinforcem…

200 papers

Besides independent learning, human learning process is highly improved by summarizing what has been learned, communicating it with peers, and subsequently fusing knowledge from different sources to assist the current learning goal. This…

Machine Learning · Computer Science 2017-02-21 Kaixiang Lin , Shu Wang , Jiayu Zhou

No real-world reward function is perfect. Sensory errors and software bugs may result in RL agents observing higher (or lower) rewards than they should. For example, a reinforcement learning agent may prefer states where a sensory error…

Artificial Intelligence · Computer Science 2017-08-22 Tom Everitt , Victoria Krakovna , Laurent Orseau , Marcus Hutter , Shane Legg

We transform reinforcement learning (RL) into a form of supervised learning (SL) by turning traditional RL on its head, calling this Upside Down RL (UDRL). Standard RL predicts rewards, while UDRL instead uses rewards as task-defining…

Artificial Intelligence · Computer Science 2020-06-24 Juergen Schmidhuber

Deep reinforcement learning (DRL) has achieved significant breakthroughs in various tasks. However, most DRL algorithms suffer a problem of generalizing the learned policy which makes the learning performance largely affected even by minor…

Machine Learning · Computer Science 2019-07-11 Zhengyao Jiang , Shan Luo

This tutorial provides a comprehensive survey of methods for fine-tuning diffusion models to optimize downstream reward functions. While diffusion models are widely known to provide excellent generative modeling capability, practical…

Machine Learning · Computer Science 2024-07-19 Masatoshi Uehara , Yulai Zhao , Tommaso Biancalani , Sergey Levine

We consider a distributed system, consisting of a heterogeneous set of devices, ranging from low-end to high-end. These devices have different profiles, e.g., different energy budgets, or different hardware specifications, determining their…

Machine Learning · Computer Science 2020-06-11 Martin Rapp , Ramin Khalili , Jörg Henkel

Offline preference-based reinforcement learning (PbRL) mitigates the need for reward definition, aligning with human preferences via preference-driven reward feedback without interacting with the environment. However, trajectory-wise…

Machine Learning · Computer Science 2025-09-25 Teng Pang , Bingzheng Wang , Guoqiang Wu , Yilong Yin

Next generation wireless networks are expected to be extremely complex due to their massive heterogeneity in terms of the types of network architectures they incorporate, the types and numbers of smart IoT devices they serve, and the types…

Signal Processing · Electrical Eng. & Systems 2022-03-14 Abdulmalik Alwarafy , Mohamed Abdallah , Bekir Sait Ciftler , Ala Al-Fuqaha , Mounir Hamdi

Multi-agent path finding in formation has many potential real-world applications like mobile warehouse robots. However, previous multi-agent path finding (MAPF) methods hardly take formation into consideration. Furthermore, they are usually…

Robotics · Computer Science 2020-11-05 Shanqi Liu , Licheng Wen , Jinhao Cui , Xuemeng Yang , Junjie Cao , Yong Liu

Distributional reinforcement learning (RL) aims to learn a value-network that predicts the full distribution of the returns for a given state, often modeled via a quantile-based critic. This approach has been successfully integrated into…

Machine Learning · Computer Science 2022-02-08 Michael Teng , Michiel van de Panne , Frank Wood

Reinforcement learning (RL) often faces the challenges of uninformed search problems where the agent should explore without access to the domain knowledge such as characteristics of the environment or external rewards. To tackle these…

Machine Learning · Computer Science 2023-10-31 Daesol Cho , Seungjae Lee , H. Jin Kim

Deep reinforcement learning (DRL) has long been a promising solution for sequential resource management in wireless networks. However, conventional DRL methods are fundamentally limited by their reliance on unimodal policy distributions,…

Recent studies have shown that reinforcement learning (RL) models are vulnerable in various noisy scenarios. For instance, the observed reward channel is often subject to noise in practice (e.g., when rewards are collected through sensors),…

Machine Learning · Computer Science 2020-02-04 Jingkang Wang , Yang Liu , Bo Li

The challenges to solving the collision avoidance problem lie in adaptively choosing optimal robot velocities in complex scenarios full of interactive obstacles. In this paper, we propose a distributed approach for multi-robot navigation…

Robotics · Computer Science 2022-03-22 Ruihua Han , Shengduo Chen , Shuaijun Wang , Zeqing Zhang , Rui Gao , Qi Hao , Jia Pan

Value functions are crucial for model-free Reinforcement Learning (RL) to obtain a policy implicitly or guide the policy updates. Value estimation heavily depends on the stochasticity of environmental dynamics and the quality of reward…

Machine Learning · Computer Science 2019-05-28 Hongyao Tang , Jianye Hao , Guangyong Chen , Pengfei Chen , Zhaopeng Meng , Yaodong Yang , Li Wang

Improving sample efficiency is central to Reinforcement Learning (RL), especially in environments where the rewards are sparse. Some recent approaches have proposed to specify reward functions as manually designed or learned reward…

Machine Learning · Computer Science 2024-01-26 Shuai Han , Mehdi Dastani , Shihan Wang

Reinforcement Learning (RL) heavily relies on the careful design of the reward function. However, accurately assigning rewards to each state-action pair in Long-Term Reinforcement Learning (LTRL) tasks remains a significant challenge. As a…

Machine Learning · Computer Science 2025-06-03 Qi Ju , Falin Hei , Zhemei Fang , Yunfeng Luo

In this paper we consider reinforcement learning tasks with progressive rewards; that is, tasks where the rewards tend to increase in magnitude over time. We hypothesise that this property may be problematic for value-based deep…

Machine Learning · Computer Science 2021-04-30 Michael Dann , John Thangarajah

Wireless network optimization has been becoming very challenging as the problem size and complexity increase tremendously, due to close couplings among network entities with heterogeneous service and resource requirements. By continuously…

Information Theory · Computer Science 2020-01-29 Shimin Gong , Yutong Xie , Jing Xu , Dusit Niyato , Ying-Chang Liang

Recent research has shown that fine-tuning diffusion models (DMs) with arbitrary rewards, including non-differentiable ones, is feasible with reinforcement learning (RL) techniques, enabling flexible model alignment. However, applying…

Machine Learning · Computer Science 2025-03-12 Zhiwei Jia , Yuesong Nan , Huixi Zhao , Gengdai Liu