中文
相关论文

相关论文: Sample-Efficient Deep Reinforcement Learning via E…

200 篇论文

Reinforcement learning (RL) has transformed sequential decision making, yet traditional algorithms like Deep Q-Networks (DQNs) and Proximal Policy Optimization (PPO) often struggle with efficient exploration, stability, and adaptability in…

机器学习 · 计算机科学 2025-05-13 Umberto Gonçalves de Sousa

This paper presents a novel method for autonomously enhancing deep neural network training. My approach employs an Evaluation Neural Network (ENN) trained via deep reinforcement learning to predict the performance of the target network. The…

机器学习 · 计算机科学 2024-06-18 Ryohei Ino

This paper introduces PG-Rainbow, a novel algorithm that incorporates a distributional reinforcement learning framework with a policy gradient algorithm. Existing policy gradient methods are sample inefficient and rely on the mean of…

机器学习 · 计算机科学 2024-07-22 WooJae Jeon , KangJun Lee , Jeewoo Lee

Modern reinforcement learning algorithms reach super-human performance on many board and video games, but they are sample inefficient, i.e. they typically require significantly more playing experience than humans to reach an equal…

机器学习 · 计算机科学 2018-06-12 Dane Corneil , Wulfram Gerstner , Johanni Brea

Achieving efficient and scalable exploration in complex domains poses a major challenge in reinforcement learning. While Bayesian and PAC-MDP approaches to the exploration problem offer strong formal guarantees, they are often impractical…

人工智能 · 计算机科学 2015-11-23 Bradly C. Stadie , Sergey Levine , Pieter Abbeel

We methodologically address the problem of Q-value overestimation in deep reinforcement learning to handle high-dimensional state spaces efficiently. By adapting concepts from information theory, we introduce an intrinsic penalty signal…

人工智能 · 计算机科学 2018-11-21 Felix Leibfried , Jordi Grau-Moya , Haitham Bou-Ammar

Reinforcement learning combined with deep neural networks has performed remarkably well in many genres of games recently. It has surpassed human-level performance in fixed game environments and turn-based two player board games. However, to…

人工智能 · 计算机科学 2020-02-03 Inseok Oh , Seungeun Rho , Sangbin Moon , Seongho Son , Hyoil Lee , Jinyun Chung

Experience replay allows a reinforcement learning agent to train on samples from a large amount of the most recent experiences. A simple in-RAM experience replay stores these most recent experiences in a list in RAM, and then copies sampled…

人工智能 · 计算机科学 2018-01-11 Ben Parr

Deep reinforcement learning algorithms often use two networks for value function optimization: an online network, and a target network that tracks the online network with some delay. Using two separate networks enables the agent to hedge…

机器学习 · 计算机科学 2023-04-19 Kavosh Asadi , Rasool Fakoor , Omer Gottesman , Taesup Kim , Michael L. Littman , Alexander J. Smola

Our work is a simple extension of the paper "Exploration by Random Network Distillation". More in detail, we show how to efficiently combine Intrinsic Rewards with Experience Replay in order to achieve more efficient and robust exploration…

机器学习 · 计算机科学 2019-12-03 Francesco Sovrano

Learning continuous control in high-dimensional sparse reward settings, such as robotic manipulation, is a challenging problem due to the number of samples often required to obtain accurate optimal value and policy estimates. While many…

机器人学 · 计算机科学 2021-07-29 Sreehari Rammohan , Shangqun Yu , Bowen He , Eric Hsiung , Eric Rosen , Stefanie Tellex , George Konidaris

Differential temporal difference (TD) methods are value-based reinforcement learning algorithms that have been proposed for infinite-horizon problems. They rely on reward centering, where each reward is centered by the average reward. This…

机器学习 · 计算机科学 2026-05-07 Kris De Asis , Mohamed Elsayed , Jiamin He

Meta-reinforcement learning (RL) addresses the problem of sample inefficiency in deep RL by using experience obtained in past tasks for a new task to be solved. However, most meta-RL methods require partially or fully on-policy data, i.e.,…

人工智能 · 计算机科学 2021-01-07 Takahisa Imagawa , Takuya Hiraoka , Yoshimasa Tsuruoka

This study conducts a comparative analysis of three advanced Deep Reinforcement Learning models: Deep Q-Networks (DQN), Proximal Policy Optimization (PPO), and Advantage Actor-Critic (A2C), within the BreakOut Atari game environment. Our…

机器学习 · 计算机科学 2024-07-22 Neil De La Fuente , Daniel A. Vidal Guerra

We consider the generic approach of using an experience memory to help exploration by adapting a restart distribution. That is, given the capacity to reset the state with those corresponding to the agent's past observations, we help…

机器学习 · 计算机科学 2020-08-19 Arash Tavakoli , Vitaly Levdik , Riashat Islam , Christopher M. Smith , Petar Kormushev

Most provably-efficient learning algorithms introduce optimism about poorly-understood states and actions to encourage exploration. We study an alternative approach for efficient exploration, posterior sampling for reinforcement learning…

机器学习 · 统计学 2013-12-30 Ian Osband , Daniel Russo , Benjamin Van Roy

Artificial intelligence is transforming financial investment decision-making frameworks, with deep reinforcement learning demonstrating substantial potential in robo-advisory applications. This paper addresses the limitations of traditional…

投资组合管理 · 定量金融 2025-02-24 Gang Huang , Xiaohua Zhou , Qingyang Song

In this paper, a novel training paradigm inspired by quantum computation is proposed for deep reinforcement learning (DRL) with experience replay. In contrast to traditional experience replay mechanism in DRL, the proposed deep…

机器学习 · 计算机科学 2021-01-07 Qing Wei , Hailan Ma , Chunlin Chen , Daoyi Dong

Continual learning is the problem of learning new tasks or knowledge while protecting old knowledge and ideally generalizing from old experience to learn new tasks faster. Neural networks trained by stochastic gradient descent often degrade…

机器学习 · 计算机科学 2019-11-27 David Rolnick , Arun Ahuja , Jonathan Schwarz , Timothy P. Lillicrap , Greg Wayne

Sampled environment transitions are a critical input to deep reinforcement learning (DRL) algorithms. Current DRL benchmarks often allow for the cheap and easy generation of large amounts of samples such that perceived progress in DRL does…

机器学习 · 计算机科学 2021-02-10 Florian E. Dorner