中文
相关论文

相关论文: A Self-Tuning Actor-Critic Algorithm

200 篇论文

Multi-agent deep reinforcement learning makes optimal decisions dependent on system states observed by agents, but any uncertainty on the observations may mislead agents to take wrong actions. The Mean-Field Actor-Critic reinforcement…

机器学习 · 计算机科学 2023-06-01 Ziyuan Zhou , Guanjun Liu

We investigate the combination of actor-critic reinforcement learning algorithms with uniform large-scale experience replay and propose solutions for two challenges: (a) efficient actor-critic learning with experience replay (b) stability…

机器学习 · 计算机科学 2019-11-19 Simon Schmitt , Matteo Hessel , Karen Simonyan

The trend is to implement intelligent agents capable of analyzing available information and utilize it efficiently. This work presents a number of reinforcement learning (RL) architectures; one of them is designed for intelligent agents.…

机器学习 · 计算机科学 2020-04-07 Ala'eddin Masadeh , Zhengdao Wang , Ahmed E. Kamal

Actor-critic algorithms learn an explicit policy (actor), and an accompanying value function (critic). The actor performs actions in the environment, while the critic evaluates the actor's current policy. However, despite their stability…

人工智能 · 计算机科学 2019-02-08 Hélène Plisnier , Denis Steckelmacher , Diederik M. Roijers , Ann Nowé

We propose WSAC (Weighted Safe Actor-Critic), a novel algorithm for Safe Offline Reinforcement Learning (RL) under functional approximation, which can robustly optimize policies to improve upon an arbitrary reference policy with limited…

机器学习 · 计算机科学 2024-11-01 Honghao Wei , Xiyue Peng , Arnob Ghosh , Xin Liu

Recent advances in deep Reinforcement Learning (RL) have created unprecedented opportunities for intelligent automation, where a machine can autonomously learn an optimal policy for performing a given task. However, current deep RL…

机器学习 · 计算机科学 2021-05-27 Zohreh Raziei , Mohsen Moghaddam

This paper introduces Team-Attention-Actor-Critic (TAAC), a reinforcement learning algorithm designed to enhance multi-agent collaboration in cooperative environments. TAAC employs a Centralized Training/Centralized Execution scheme…

人工智能 · 计算机科学 2025-12-23 Hugo Garrido-Lestache Belinchon , Jeremy Kedziora

Deep Actor-Critic algorithms, which combine Actor-Critic with deep neural network (DNN), have been among the most prevalent reinforcement learning algorithms for decision-making problems in simulated environments. However, the existing deep…

机器学习 · 计算机科学 2024-09-19 Kexuan Wang , An Liu , Baishuo Lin

The hierarchical interaction between the actor and critic in actor-critic based reinforcement learning algorithms naturally lends itself to a game-theoretic interpretation. We adopt this viewpoint and model the actor and critic interaction…

机器学习 · 计算机科学 2021-09-28 Liyuan Zheng , Tanner Fiez , Zane Alumbaugh , Benjamin Chasnov , Lillian J. Ratliff

We propose a novel and flexible approach to meta-learning for learning-to-learn from only a few examples. Our framework is motivated by actor-critic reinforcement learning, but can be applied to both reinforcement and supervised learning.…

机器学习 · 计算机科学 2017-06-30 Flood Sung , Li Zhang , Tao Xiang , Timothy Hospedales , Yongxin Yang

Model-free deep reinforcement learning (RL) has been successfully applied to challenging continuous control domains. However, poor sample efficiency prevents these methods from being widely used in real-world domains. This paper introduces…

机器学习 · 计算机科学 2022-10-27 Sicen Li , Qinyun Tang , Yiming Pang , Xinmeng Ma , Gang Wang

To learn approximately optimal acting policies for decision problems, modern Actor Critic algorithms rely on deep Neural Networks (DNNs) to parameterize the acting policy and greedification operators to iteratively improve it. The reliance…

Multi-agent reinforcement learning (MARL) has attracted much research attention recently. However, unlike its single-agent counterpart, many theoretical and algorithmic aspects of MARL have not been well-understood. In this paper, we study…

机器学习 · 计算机科学 2021-12-08 Siliang Zeng , Tianyi Chen , Alfredo Garcia , Mingyi Hong

This paper proposes the first-ever algorithmic framework for tuning hyper-parameters of stochastic optimization algorithm based on reinforcement learning. Hyper-parameters impose significant influences on the performance of stochastic…

机器学习 · 计算机科学 2020-03-11 Haotian Zhang , Jianyong Sun , Zongben Xu

Accurate value estimates are important for off-policy reinforcement learning. Algorithms based on temporal difference learning typically are prone to an over- or underestimation bias building up over time. In this paper, we propose a…

机器学习 · 计算机科学 2022-10-24 Nicolai Dorka , Tim Welschehold , Joschka Boedecker , Wolfram Burgard

This paper explores the application of the Soft Actor-Critic (SAC) algorithm within a Distributional Reinforcement Learning setting and introduces an implementation of such algorithm named Cram\'er-based Distributional Soft Actor-Critic…

机器学习 · 计算机科学 2026-05-12 Vanya Aziz , Ivo Nowak , E. M. T Hendrix

Off-policy actor-critic algorithms have shown strong potential in deep reinforcement learning for continuous control tasks. Their success primarily comes from leveraging pessimistic state-action value function updates, which reduce function…

机器学习 · 计算机科学 2025-08-21 Bahareh Tasdighi , Nicklas Werge , Yi-Shan Wu , Melih Kandemir

Pre-training (PT) followed by fine-tuning (FT) is an effective method for training neural networks, and has led to significant performance improvements in many domains. PT can incorporate various design choices such as task and data…

机器学习 · 计算机科学 2021-11-03 Aniruddh Raghu , Jonathan Lorraine , Simon Kornblith , Matthew McDermott , David Duvenaud

Policy gradient algorithms have proven to be successful in diverse decision making and control tasks. However, these methods suffer from high sample complexity and instability issues. In this paper, we address these challenges by providing…

机器学习 · 计算机科学 2021-03-17 Yannis Flet-Berliac , Reda Ouhamma , Odalric-Ambrym Maillard , Philippe Preux

Dimension of the encoder output (i.e., the code layer) in an autoencoder is a key hyper-parameter for representing the input data in a proper space. This dimension must be carefully selected in order to guarantee the desired reconstruction…

机器学习 · 计算机科学 2021-02-02 Pedram Fekri , Ali Akbar Safavi , Mehrdad Hosseini Zadeh , Peyman Setoodeh