中文
相关论文

相关论文: Sample Efficient Actor-Critic with Experience Repl…

200 篇论文

Recent works have proposed accelerating the wall-clock training time of actor-critic methods via the use of large-scale environment parallelization; unfortunately, these can sometimes still require large number of environment interactions…

A key theme in the past decade has been that when large neural networks and large datasets combine they can produce remarkable results. In deep reinforcement learning (RL), this paradigm is commonly made possible through experience replay,…

机器学习 · 计算机科学 2023-10-30 Cong Lu , Philip J. Ball , Yee Whye Teh , Jack Parker-Holder

Motivated by recent advance of machine learning using Deep Reinforcement Learning this paper proposes a modified architecture that produces more robust agents and speeds up the training process. Our architecture is based on Asynchronous…

机器学习 · 计算机科学 2018-04-18 Ibrahim M. Sobh , Nevin M. Darwish

We propose a novel framework to solve risk-sensitive reinforcement learning (RL) problems where the agent optimises time-consistent dynamic spectral risk measures. Based on the notion of conditional elicitability, our methodology constructs…

机器学习 · 计算机科学 2023-05-02 Anthony Coache , Sebastian Jaimungal , Álvaro Cartea

From a young age humans learn to use grammatical principles to hierarchically combine words into sentences. Action grammars is the parallel idea, that there is an underlying set of rules (a "grammar") that govern how we hierarchically…

机器学习 · 计算机科学 2019-10-24 Petros Christodoulou , Robert Tjarko Lange , Ali Shafti , A. Aldo Faisal

Optimization of parameterized policies for reinforcement learning (RL) is an important and challenging problem in artificial intelligence. Among the most common approaches are algorithms based on gradient ascent of a score function…

Deep Reinforcement Learning (RL) techniques can benefit greatly from leveraging prior experience, which can be either self-generated or acquired from other entities. Action advising is a framework that provides a flexible way to transfer…

机器学习 · 计算机科学 2021-07-01 Ercument Ilhan , Jeremy Gow , Diego Perez-Liebana

Model-based reinforcement learning algorithms, which aim to learn a model of the environment to make decisions, are more sample efficient than their model-free counterparts. The sample efficiency of model-based approaches relies on whether…

机器学习 · 计算机科学 2021-12-21 Zhihai Wang , Jie Wang , Qi Zhou , Bin Li , Houqiang Li

Despite definite success in deep reinforcement learning problems, actor-critic algorithms are still confronted with sample inefficiency in complex environments, particularly in tasks where efficient exploration is a bottleneck. These…

机器学习 · 计算机科学 2021-02-09 Yannis Flet-Berliac , Johan Ferret , Olivier Pietquin , Philippe Preux , Matthieu Geist

The utilization of the experience replay mechanism enables agents to effectively leverage their experiences on several occasions. In previous studies, the sampling probability of the transitions was modified based on their relative…

机器学习 · 计算机科学 2024-06-14 Arda Sarp Yenicesu , Furkan B. Mutlu , Suleyman S. Kozat , Ozgur S. Oguz

While deep reinforcement learning has achieved tremendous successes in various applications, most existing works only focus on maximizing the expected value of total return and thus ignore its inherent stochasticity. Such stochasticity is…

机器学习 · 计算机科学 2023-09-19 Han Zhong , Xun Deng , Ethan X. Fang , Zhuoran Yang , Zhaoran Wang , Runze Li

Background: Deep Deterministic Policy Gradient-based reinforcement learning algorithms utilize Actor-Critic architectures, where both networks are typically trained using identical batches of replayed transitions. However, the learning…

机器学习 · 计算机科学 2025-12-08 Mehmet Efe Lorasdagi , Dogan Can Cicek , Furkan Burak Mutlu , Suleyman Serdar Kozat

Scaling issues are mundane yet irritating for practitioners of reinforcement learning. Error scales vary across domains, tasks, and stages of learning; sometimes by many orders of magnitude. This can be detrimental to learning speed and…

机器学习 · 计算机科学 2021-05-13 Tom Schaul , Georg Ostrovski , Iurii Kemaev , Diana Borsa

High-precision control tasks present substantial challenges for reinforcement learning (RL) algorithms, frequently resulting in suboptimal performance attributed to network approximation inaccuracies and inadequate sample quality.These…

机器学习 · 计算机科学 2025-02-05 Donghe Chen , Yubin Peng , Tengjie Zheng , Han Wang , Chaoran Qu , Lin Cheng

The use of past experiences to accelerate temporal difference (TD) learning of value functions, or experience replay, is a key component in deep reinforcement learning. Prioritization or reweighting of important experiences has shown to…

人工智能 · 计算机科学 2020-06-24 Samarth Sinha , Jiaming Song , Animesh Garg , Stefano Ermon

Multi-agent deep reinforcement learning makes optimal decisions dependent on system states observed by agents, but any uncertainty on the observations may mislead agents to take wrong actions. The Mean-Field Actor-Critic reinforcement…

机器学习 · 计算机科学 2023-06-01 Ziyuan Zhou , Guanjun Liu

Reinforcement learning, mathematically described by Markov Decision Problems, may be approached either through dynamic programming or policy search. Actor-critic algorithms combine the merits of both approaches by alternating between steps…

机器学习 · 计算机科学 2023-01-31 Harshat Kumar , Alec Koppel , Alejandro Ribeiro

This scientific paper propose a novel portfolio optimization model using an improved deep reinforcement learning algorithm. The objective function of the optimization model is the weighted sum of the expectation and value at risk(VaR) of…

机器学习 · 计算机科学 2022-08-30 Boyi Jin

In this work, we build on recent advances in distributional reinforcement learning to give a generally applicable, flexible, and state-of-the-art distributional variant of DQN. We achieve this by using quantile regression to approximate the…

机器学习 · 计算机科学 2018-06-20 Will Dabney , Georg Ostrovski , David Silver , Rémi Munos

This paper introduces a novel reinforcement learning (RL) strategy designed to facilitate rapid autonomy transfer by utilizing pre-trained critic value functions from multiple environments. Unlike traditional methods that require extensive…