中文
相关论文

相关论文: SARC: Soft Actor Retrospective Critic

200 篇论文

Actor-critic methods have been central to many of the recent advances in deep reinforcement learning. The most common approach is to use symmetric architectures, whereby both actor and critic have the same network topology and number of…

机器学习 · 计算机科学 2025-08-15 Olya Mastikhina , Dhruv Sreenivas , Pablo Samuel Castro

High-precision control tasks present substantial challenges for reinforcement learning (RL) algorithms, frequently resulting in suboptimal performance attributed to network approximation inaccuracies and inadequate sample quality.These…

机器学习 · 计算机科学 2025-02-05 Donghe Chen , Yubin Peng , Tengjie Zheng , Han Wang , Chaoran Qu , Lin Cheng

Multi-Agent Path Finding (MAPF) is a crucial component for many large-scale robotic systems, where agents must plan their collision-free paths to their given goal positions. Recently, multi-agent reinforcement learning has been introduced…

机器人学 · 计算机科学 2023-07-07 Qiushi Lin , Hang Ma

We propose an actor-critic framework to solve the time-continuous stochastic optimal control problem. A least square temporal difference method is applied to compute the value function for the critic. The policy gradient method is…

最优化与控制 · 数学 2025-01-27 Mo Zhou , Jianfeng Lu

Large-scale networked systems, such as traffic, power, and wireless grids, challenge reinforcement-learning agents with both scale and environment shifts. To address these challenges, we propose GSAC (Generalizable and Scalable…

机器学习 · 计算机科学 2025-10-27 Hao Liang , Shuqing Shi , Yudi Zhang , Biwei Huang , Yali Du

In cooperative stochastic games multiple agents work towards learning joint optimal actions in an unknown environment to achieve a common goal. In many real-world applications, however, constraints are often imposed on the actions that can…

多智能体系统 · 计算机科学 2020-07-14 Raghuram Bharadwaj Diddigi , Sai Koti Reddy Danda , Prabuchandran K. J. , Shalabh Bhatnagar

This paper develops a reinforcement learning-based controller for the stabilization of partial differential equation (PDE) systems. Within the soft actor-critic (SAC) framework, we embed a DeepONet, a well-known neural operator (NO), which…

最优化与控制 · 数学 2026-03-13 Chenchen Wang , Jie Qi , Jiaqi Hu

Frequent temporal patterns discovered in time-interval-based multivariate data, although syntactically correct, might be non-transparent: For some pattern instances, there might exist intervals for the same entity that contradict the…

机器学习 · 计算机科学 2021-01-12 Alexander Shknevsky , Yuval Shahar , Robert Moskovitch

Off-Policy Actor-Critic (Off-PAC) methods have proven successful in a variety of continuous control tasks. Normally, the critic's action-value function is updated using temporal-difference, and the critic in turn provides a loss for the…

机器学习 · 计算机科学 2020-11-03 Wei Zhou , Yiying Li , Yongxin Yang , Huaimin Wang , Timothy M. Hospedales

Accounting for the fact that users have different sequential patterns, the main drawback of state-of-the-art recommendation strategies is that a fixed sequence length of user-item interactions is required as input to train the models. This…

信息检索 · 计算机科学 2021-08-04 Stefanos Antaris , Dimitrios Rafailidis

Deterministic-policy actor-critic algorithms for continuous control improve the actor by plugging its actions into the critic and ascending the action-value gradient, which is obtained by chaining the actor's Jacobian matrix with the…

人工智能 · 计算机科学 2020-10-23 Pierluca D'Oro , Wojciech Jaśkowski

Deep reinforcement learning (DRL) algorithms have successfully been demonstrated on a range of challenging decision making and control tasks. One dominant component of recent deep reinforcement learning algorithms is the target network…

机器学习 · 计算机科学 2020-11-12 Lin Shao , Yifan You , Mengyuan Yan , Qingyun Sun , Jeannette Bohg

In this work, we propose Behavior-Guided Actor-Critic (BAC), an off-policy actor-critic deep RL algorithm. BAC mathematically formulates the behavior of the policy through autoencoders by providing an accurate estimation of how frequently…

机器学习 · 计算机科学 2021-04-12 Ammar Fayad , Majd Ibrahim

Actor-critic (AC) algorithms, empowered by neural networks, have had significant empirical success in recent years. However, most of the existing theoretical support for AC algorithms focuses on the case of linear function approximations,…

机器学习 · 计算机科学 2024-04-02 Yufeng Zhang , Siyu Chen , Zhuoran Yang , Michael I. Jordan , Zhaoran Wang

This study evaluates the performance of Soft Actor Critic (SAC), Greedy Actor Critic (GAC), and Truncated Quantile Critics (TQC) in high-dimensional decision-making tasks using fully observable environments. The focus is on parametrized…

机器学习 · 计算机科学 2025-10-06 Ubayd Bapoo , Clement N Nyirenda

Aspect-based sentiment classification (ASC) is an important task in fine-grained sentiment analysis.~Deep supervised ASC approaches typically model this task as a pair-wise classification task that takes an aspect and a sentence containing…

计算与语言 · 计算机科学 2019-11-06 Hu Xu , Bing Liu , Lei Shu , Philip S. Yu

In this paper, we propose SACHER (soft actor-critic (SAC) with hindsight experience replay (HER)), which constitutes a class of deep reinforcement learning (DRL) algorithms. SAC is known as an off-policy model-free DRL algorithm based on…

系统与控制 · 电气工程与系统科学 2021-06-08 Myoung Hoon Lee , Jun Moon

Adversarial Imitation Learning (AIL) is a class of popular state-of-the-art Imitation Learning algorithms commonly used in robotics. In AIL, an artificial adversary's misclassification is used as a reward signal that is optimized by any…

机器学习 · 计算机科学 2022-12-01 Ankur Deka , Changliu Liu , Katia Sycara

Advances in Reinforcement Learning (RL) have demonstrated data efficiency and optimal control over large state spaces at the cost of scalable performance. Genetic methods, on the other hand, provide scalability but depict hyperparameter…

机器学习 · 计算机科学 2021-01-19 Karush Suri , Xiao Qi Shi , Konstantinos N. Plataniotis , Yuri A. Lawryshyn

In this paper, we devise a distributional framework on actor-critic as a solution to distributional instability, action type restriction, and conflation between samples and statistics. We propose a new method that minimizes the Cram\'er…

机器学习 · 计算机科学 2021-07-16 Daniel Wontae Nam , Younghoon Kim , Chan Y. Park