English
Related papers

Related papers: Implicit Quantile Networks for Distributional Rein…

200 papers

Offline reinforcement learning (RL) leverages pre-collected datasets to train optimal policies. Diffusion Q-Learning (DQL), introducing diffusion models as a powerful and expressive policy class, significantly boosts the performance of…

Machine Learning · Computer Science 2024-11-04 Tianyu Chen , Zhendong Wang , Mingyuan Zhou

In order perform a large variety of tasks and to achieve human-level performance in complex real-world environments, Artificial Intelligence (AI) Agents must be able to learn from their past experiences and gain both knowledge and an…

Machine Learning · Computer Science 2019-05-13 Andrei Claudiu Roibu

We propose a general agent population learning system, and on this basis, we propose lineage evolution reinforcement learning algorithm. Lineage evolution reinforcement learning is a kind of derivative algorithm which accords with the…

Neural and Evolutionary Computing · Computer Science 2020-10-29 Zeyu Zhang , Guisheng Yin

Deep Reinforcement Learning has shown excellent performance in generating efficient solutions for complex tasks. However, its efficacy is often limited by static training modes and heavy reliance on vast data from stable environments. To…

Machine Learning · Computer Science 2024-11-06 Xinhao Zhang , Jinghan Zhang , Wujun Si , Kunpeng Liu

Generative adversarial networks (GANs) have given us a great tool to fit implicit generative models to data. Implicit distributions are ones we can sample from easily, and take derivatives of samples with respect to model parameters. These…

Machine Learning · Statistics 2017-02-28 Ferenc Huszár

Deep reinforcement learning has demonstrated superhuman performance in complex decision-making tasks, but it struggles with generalization and knowledge reuse - key aspects of true intelligence. This article introduces a novel approach that…

Machine Learning · Computer Science 2024-11-12 Marko Ruman , Tatiana V. Guy

Reinforcement learning has exceeded human-level performance in game playing AI with deep learning methods according to the experiments from DeepMind on Go and Atari games. Deep learning solves high dimension input problems which stop the…

Machine Learning · Computer Science 2019-09-12 Yue Zheng

Offline reinforcement learning (RL) tries to learn the near-optimal policy with recorded offline experience without online exploration. Current offline RL research includes: 1) generative modeling, i.e., approximating a policy using fixed…

Machine Learning · Computer Science 2021-06-23 Hua Wei , Deheng Ye , Zhao Liu , Hao Wu , Bo Yuan , Qiang Fu , Wei Yang , Zhenhui Li

Deep reinforcement learning (DRL) methods such as the Deep Q-Network (DQN) have achieved state-of-the-art results in a variety of challenging, high-dimensional domains. This success is mainly attributed to the power of deep neural networks…

Artificial Intelligence · Computer Science 2017-11-06 Nir Levine , Tom Zahavy , Daniel J. Mankowitz , Aviv Tamar , Shie Mannor

We propose a method for learning expressive energy-based policies for continuous states and actions, which has been feasible only in tabular domains before. We apply our method to learning maximum entropy policies, resulting into a new…

Machine Learning · Computer Science 2017-07-25 Tuomas Haarnoja , Haoran Tang , Pieter Abbeel , Sergey Levine

We extend the provably convergent Full Gradient DQN algorithm for discounted reward Markov decision processes from Avrachenkov et al. (2021) to average reward problems. We experimentally compare widely used RVI Q-Learning with recently…

Systems and Control · Electrical Eng. & Systems 2023-04-10 Tejas Pagare , Vivek Borkar , Konstantin Avrachenkov

``Distribution shift'' is the main obstacle to the success of offline reinforcement learning. A learning policy may take actions beyond the behavior policy's knowledge, referred to as Out-of-Distribution (OOD) actions. The Q-values for…

Machine Learning · Computer Science 2025-01-14 Jing Zhang , Linjiajie Fang , Kexin Shi , Wenjia Wang , Bing-Yi Jing

Instability and variability of Deep Reinforcement Learning (DRL) algorithms tend to adversely affect their performance. Averaged-DQN is a simple extension to the DQN algorithm, based on averaging previously learned Q-values estimates, which…

Artificial Intelligence · Computer Science 2017-03-13 Oron Anschel , Nir Baram , Nahum Shimkin

When multiple agents learn in a decentralized manner, the environment appears non-stationary from the perspective of an individual agent due to the exploration and learning of the other agents. Recently proposed deep multi-agent…

Machine Learning · Computer Science 2020-06-16 Xueguang Lyu , Christopher Amato

Deep Reinforcement Learning (RL) is well known for being highly sensitive to hyperparameters, requiring practitioners substantial efforts to optimize them for the problem at hand. This also limits the applicability of RL in real-world…

Machine Learning · Computer Science 2025-03-04 Théo Vincent , Fabian Wahren , Jan Peters , Boris Belousov , Carlo D'Eramo

We propose a novel training algorithm for reinforcement learning which combines the strength of deep Q-learning with a constrained optimization approach to tighten optimality and encourage faster reward propagation. Our novel technique…

Machine Learning · Computer Science 2016-11-08 Frank S. He , Yang Liu , Alexander G. Schwing , Jian Peng

Recent research has shown that although Reinforcement Learning (RL) can benefit from expert demonstration, it usually takes considerable efforts to obtain enough demonstration. The efforts prevent training decent RL agents with expert…

Machine Learning · Computer Science 2021-07-09 Si-An Chen , Voot Tangkaratt , Hsuan-Tien Lin , Masashi Sugiyama

We evaluate the use of original game curricula supported by the Atari 2600 console as a heterogeneous transfer benchmark for deep reinforcement learning agents. Game designers created curricula using combinations of several discrete…

Machine Learning · Computer Science 2022-10-25 Andrei A. Rusu , Sebastian Flennerhag , Dushyant Rao , Razvan Pascanu , Raia Hadsell

Spiking neural networks (SNNs) have great potential for energy-efficient implementation of Deep Neural Networks (DNNs) on dedicated neuromorphic hardware. Recent studies demonstrated competitive performance of SNNs compared with DNNs on…

Neural and Evolutionary Computing · Computer Science 2020-12-24 Weihao Tan , Devdhar Patel , Robert Kozma

Inverse reinforcement learning (IRL) and dynamic discrete choice (DDC) models explain sequential decision-making by recovering reward functions that rationalize observed behavior. Flexible IRL methods typically rely on machine learning but…

Machine Learning · Computer Science 2026-01-01 Lars van der Laan , Aurelien Bibaut , Nathan Kallus