English
Related papers

Related papers: Towards Empathic Deep Q-Learning

200 papers

In this paper we combine one method for hierarchical reinforcement learning - the options framework - with deep Q-networks (DQNs) through the use of different "option heads" on the policy network, and a supervisory network for choosing…

Machine Learning · Computer Science 2017-06-20 Kai Arulkumaran , Nat Dilokthanakul , Murray Shanahan , Anil Anthony Bharath

Deep Reinforcement Learning (DRL) sometimes needs a large amount of data to converge in the training procedure and in some cases, each action of the agent may produce regret. This barrier naturally motivates different data sets or…

Machine Learning · Computer Science 2021-10-01 Yimin Shi

In this article, we propose a novel algorithm for deep reinforcement learning named Expert Q-learning. Expert Q-learning is inspired by Dueling Q-learning and aims at incorporating semi-supervised learning into reinforcement learning…

Machine Learning · Computer Science 2024-06-26 Li Meng , Anis Yazidi , Morten Goodwin , Paal Engelstad

Deep reinforcement learning (RL) models, despite their efficiency in learning an optimal policy in static environments, easily loses previously learned knowledge (i.e., catastrophic forgetting). It leads RL models to poor performance in…

Machine Learning · Computer Science 2025-09-08 Wonseo Jang , Dongjae Kim

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

Artificial Intelligence · Computer Science 2025-10-27 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Over the past decade, remarkable progress has been made in adopting deep neural networks to enhance the performance of conventional reinforcement learning. A notable milestone was the development of Deep Q-Networks (DQN), which achieved…

Systems and Control · Electrical Eng. & Systems 2025-07-14 Klinsmann Agyei , Pouria Sarhadi , Daniel Polani

Autonomous driving is a promising technology to reduce traffic accidents and improve driving efficiency. In this work, a deep reinforcement learning (DRL)-enabled decision-making policy is constructed for autonomous vehicles to address the…

Signal Processing · Electrical Eng. & Systems 2020-07-20 Jiangdong Liao , Teng Liu , Xiaolin Tang , Xingyu Mu , Bing Huang , Dongpu Cao

The numerous deployed Artificial Intelligence systems need to be aligned with our ethical considerations. However, such ethical considerations might change as time passes: our society is not fixed, and our social mores evolve. This makes it…

Machine Learning · Computer Science 2023-07-04 Rémy Chaput , Olivier Boissier , Mathieu Guillermin

One way to improve the relationship between humans and anthropomorphic agents is to have humans empathize with the agents. In this study, we focused on a task between an agent and a human in which the agent makes a mistake. To investigate…

Human-Computer Interaction · Computer Science 2025-04-22 Takahiro Tsumura , Seiji Yamada

Deep Reinforcement Learning (RL) involves the use of Deep Neural Networks (DNNs) to make sequential decisions in order to maximize reward. For many tasks the resulting sequence of actions produced by a Deep RL policy can be long and…

Artificial Intelligence · Computer Science 2022-07-26 Sam Blakeman , Denis Mareschal

Recent work in AI safety has highlighted that in sequential decision making, objectives are often underspecified or incomplete. This gives discretion to the acting agent to realize the stated objective in ways that may result in undesirable…

Artificial Intelligence · Computer Science 2021-06-07 Parand Alizadeh Alamdari , Toryn Q. Klassen , Rodrigo Toro Icarte , Sheila A. McIlraith

We present a novel multi-agent RL approach, Selective Multi-Agent Prioritized Experience Relay, in which agents share with other agents a limited number of transitions they observe during training. The intuition behind this is that even a…

Machine Learning · Computer Science 2024-04-25 Matthias Gerstgrasser , Tom Danino , Sarah Keren

In cooperative multi-agent reinforcement learning, a collection of agents learns to interact in a shared environment to achieve a common goal. We propose the use of reward machines (RM) -- Mealy machines used as structured representations…

Multiagent Systems · Computer Science 2021-06-16 Cyrus Neary , Zhe Xu , Bo Wu , Ufuk Topcu

To ensure that the data aggregation, data storage, and data processing are all performed in a decentralized but trusted manner, we propose to use the blockchain with the mining pool to support IoT services based on cognitive radio networks.…

Networking and Internet Architecture · Computer Science 2018-10-25 Nguyen Cong Luong , Tran The Anh , Huynh Thi Thanh Binh , Dusit Niyato , Dong In Kim , Ying-Chang Liang

Deep reinforcement learning algorithms often use two networks for value function optimization: an online network, and a target network that tracks the online network with some delay. Using two separate networks enables the agent to hedge…

Machine Learning · Computer Science 2023-04-19 Kavosh Asadi , Rasool Fakoor , Omer Gottesman , Taesup Kim , Michael L. Littman , Alexander J. Smola

Drawing an inspiration from behavioral studies of human decision making, we propose here a general parametric framework for a reinforcement learning problem, which extends the standard Q-learning approach to incorporate a two-stream…

Machine Learning · Computer Science 2019-11-14 Baihan Lin , Djallel Bouneffouf , Guillermo Cecchi

Deep Q Network (DQN) firstly kicked the door of deep reinforcement learning (DRL) via combining deep learning (DL) with reinforcement learning (RL), which has noticed that the distribution of the acquired data would change during the…

Machine Learning · Computer Science 2022-01-11 Jiajun Fan , Changnan Xiao , Yue Huang

We study reinforcement learning (RL) in high dimensional episodic Markov decision processes (MDP). We consider value-based RL when the optimal Q-value is a linear function of d-dimensional state-action feature representation. For instance,…

Artificial Intelligence · Computer Science 2019-09-10 Kamyar Azizzadenesheli , Animashree Anandkumar

While many sophisticated exploration methods have been proposed, their lack of generality and high computational cost often lead researchers to favor simpler methods like $\epsilon$-greedy. Motivated by this, we introduce $\beta$-DQN, a…

Machine Learning · Computer Science 2025-10-29 Hongming Zhang , Fengshuo Bai , Chenjun Xiao , Chao Gao , Bo Xu , Martin Müller

We investigate the problem of distributed training under partial observability, whereby cooperative multi-agent reinforcement learning agents (MARL) maximize the expected cumulative joint reward. We propose distributed value decomposition…

Machine Learning · Computer Science 2025-02-12 Guilherme S. Varela , Alberto Sardinha , Francisco S. Melo