中文
相关论文

相关论文: Target Entropy Annealing for Discrete Soft Actor-C…

200 篇论文

Model-free deep reinforcement learning (RL) algorithms have been demonstrated on a range of challenging decision making and control tasks. However, these methods typically suffer from two major challenges: very high sample complexity and…

机器学习 · 计算机科学 2018-08-10 Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , Sergey Levine

Learning expressive stochastic policies instead of deterministic ones has been proposed to achieve better stability, sample complexity, and robustness. Notably, in Maximum Entropy Reinforcement Learning (MaxEnt RL), the policy is modeled as…

机器学习 · 计算机科学 2024-05-03 Safa Messaoud , Billel Mokeddem , Zhenghai Xue , Linsey Pang , Bo An , Haipeng Chen , Sanjay Chawla

Off-policy actor-critic algorithms have shown strong potential in deep reinforcement learning for continuous control tasks. Their success primarily comes from leveraging pessimistic state-action value function updates, which reduce function…

机器学习 · 计算机科学 2025-08-21 Bahareh Tasdighi , Nicklas Werge , Yi-Shan Wu , Melih Kandemir

When creating new reinforcement learning tasks, practitioners often accelerate the learning process by incorporating into the task several accessory components, such as breaking the environment interaction into independent episodes and…

机器学习 · 计算机科学 2025-12-09 Homayoon Farrahi , A. Rupam Mahmood

This paper explores the application of the Soft Actor-Critic (SAC) algorithm within a Distributional Reinforcement Learning setting and introduces an implementation of such algorithm named Cram\'er-based Distributional Soft Actor-Critic…

机器学习 · 计算机科学 2026-05-12 Vanya Aziz , Ivo Nowak , E. M. T Hendrix

We propose a new algorithm, Mean Actor-Critic (MAC), for discrete-action continuous-state reinforcement learning. MAC is a policy gradient algorithm that uses the agent's explicit representation of all action values to estimate the gradient…

The average-reward formulation of reinforcement learning (RL) has drawn increased interest in recent years for its ability to solve temporally-extended problems without relying on discounting. Meanwhile, in the discounted setting,…

机器学习 · 计算机科学 2025-08-06 Jacob Adamczyk , Volodymyr Makarenko , Stas Tiomkin , Rahul V. Kulkarni

Decentralized Actor-Critic (AC) algorithms have been widely utilized for multi-agent reinforcement learning (MARL) and have achieved remarkable success. Apart from its empirical success, the theoretical convergence property of decentralized…

机器学习 · 计算机科学 2023-01-31 Qijun Luo , Xiao Li

Multi-agent reinforcement learning (MARL) has been shown effective for cooperative games in recent years. However, existing state-of-the-art methods face challenges related to sample complexity, training instability, and the risk of…

多智能体系统 · 计算机科学 2025-03-14 Jiarong Liu , Yifan Zhong , Siyi Hu , Haobo Fu , Qiang Fu , Xiaojun Chang , Yaodong Yang

The varying significance of distinct primitive behaviors during the policy learning process has been overlooked by prior model-free RL algorithms. Leveraging this insight, we explore the causal relationship between different action…

机器学习 · 计算机科学 2024-11-05 Tianying Ji , Yongyuan Liang , Yan Zeng , Yu Luo , Guowei Xu , Jiawei Guo , Ruijie Zheng , Furong Huang , Fuchun Sun , Huazhe Xu

Deep reinforcement learning has made significant progress in robotic manipulation tasks and it works well in the ideal disturbance-free environment. However, in a real-world environment, both internal and external disturbances are…

机器人学 · 计算机科学 2020-11-09 Pingcheng Jian , Chao Yang , Di Guo , Huaping Liu , Fuchun Sun

This paper explores the impact of dynamic entropy tuning in Reinforcement Learning (RL) algorithms that train a stochastic policy. Its performance is compared against algorithms that train a deterministic one. Stochastic policies optimize a…

机器人学 · 计算机科学 2025-12-23 Youssef Mahran , Zeyad Gamal , Ayman El-Badawy

Proximal Policy Optimization (PPO) has become the de facto standard for training legged robots, thanks to its robustness and scalability in massively parallel simulation environments like IsaacLab. However, its on-policy nature makes it…

机器人学 · 计算机科学 2026-05-26 Gianluca Sabatini , Chenhao Li , Marco Hutter

This paper introduces Team-Attention-Actor-Critic (TAAC), a reinforcement learning algorithm designed to enhance multi-agent collaboration in cooperative environments. TAAC employs a Centralized Training/Centralized Execution scheme…

人工智能 · 计算机科学 2025-12-23 Hugo Garrido-Lestache Belinchon , Jeremy Kedziora

Multi-agent deep reinforcement learning has been applied to address a variety of complex problems with either discrete or continuous action spaces and achieved great success. However, most real-world environments cannot be described by only…

机器学习 · 计算机科学 2022-06-13 Hongzhi Hua , Kaigui Wu , Guixuan Wen

The trend is to implement intelligent agents capable of analyzing available information and utilize it efficiently. This work presents a number of reinforcement learning (RL) architectures; one of them is designed for intelligent agents.…

机器学习 · 计算机科学 2020-04-07 Ala'eddin Masadeh , Zhengdao Wang , Ahmed E. Kamal

While most current research in Reinforcement Learning (RL) focuses on improving the performance of the algorithms in controlled environments, the use of RL under constraints like those met in the video game industry is rarely studied.…

机器学习 · 计算机科学 2019-12-25 Olivier Delalleau , Maxim Peter , Eloi Alonso , Adrien Logut

Evolving next-generation mobile networks is designed to provide ubiquitous coverage and networked sensing. With utility of multi-view sensing and multi-node joint transmission, cell-free is a promising technique to realize this prospect.…

网络与互联网体系结构 · 计算机科学 2024-12-11 Fanfei Xu , Shengheng Liu , Zihuan Mao , Shangqing Shi , Dazhuan Xu , Dongming Wang , Yongming Huang

Adopting reasonable strategies is challenging but crucial for an intelligent agent with limited resources working in hazardous, unstructured, and dynamic environments to improve the system's utility, decrease the overall cost, and increase…

人工智能 · 计算机科学 2023-03-09 Qin Yang , Ramviyas Parasuraman

Due to their complex nonlinear dynamics and batch-to-batch variability, batch processes pose a challenge for process control. Due to the absence of accurate models and resulting plant-model mismatch, these problems become harder to address…

机器学习 · 计算机科学 2022-05-03 Tanuja Joshi , Hariprasad Kodamana , Harikumar Kandath , Niket Kaisare