中文
相关论文

相关论文: Chunking the Critic: A Transformer-based Soft Acto…

200 篇论文

Soft Actor-Critic algorithm is widely recognized for its robust performance across a range of deep reinforcement learning tasks, where it leverages the tanh transformation to constrain actions within bounded limits. However, this…

机器学习 · 计算机科学 2025-04-23 Yanjun Chen , Xinming Zhang , Xianghui Wang , Zhiqiang Xu , Xiaoyu Shen , Wei Zhang

Accounting for the fact that users have different sequential patterns, the main drawback of state-of-the-art recommendation strategies is that a fixed sequence length of user-item interactions is required as input to train the models. This…

信息检索 · 计算机科学 2021-08-04 Stefanos Antaris , Dimitrios Rafailidis

This paper explores the application of the Soft Actor-Critic (SAC) algorithm within a Distributional Reinforcement Learning setting and introduces an implementation of such algorithm named Cram\'er-based Distributional Soft Actor-Critic…

机器学习 · 计算机科学 2026-05-12 Vanya Aziz , Ivo Nowak , E. M. T Hendrix

Soft Actor-Critic (SAC) is an off-policy actor-critic deep reinforcement learning (DRL) algorithm based on maximum entropy reinforcement learning. By combining off-policy updates with an actor-critic formulation, SAC achieves…

机器学习 · 计算机科学 2019-06-11 Che Wang , Keith Ross

As hybrid electric vehicles (HEVs) gain traction in heavy-duty trucks, adaptive and efficient energy management is critical for reducing fuel consumption while maintaining battery charge for long operation times. We present a new…

系统与控制 · 电气工程与系统科学 2025-08-08 Wafeeq Jaleel , Md Ragib Rownak , Athar Hanif , Sidra Ghayour Bhatti , Qadeer Ahmed

We consider a version of actor-critic which uses proportional step-sizes and only one critic update with a single sample from the stationary distribution per actor step. We provide an analysis of this method using the small-gain theorem.…

最优化与控制 · 数学 2023-05-26 Alex Olshevsky , Bahman Gharesifard

Actor-Critic based approaches were among the first to address reinforcement learning in a general setting. Recently, these algorithms have gained renewed interest due to their generality, good convergence properties, and possible biological…

机器学习 · 计算机科学 2009-09-17 D. Di Castro , R. Meir

Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly…

机器学习 · 计算机科学 2018-10-25 Esther Derman , Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

The Soft Actor-Critic (SAC) algorithm, a state-of-the-art method in maximum entropy reinforcement learning, traditionally relies on minimizing reverse Kullback-Leibler (KL) divergence for policy updates. However, this approach leads to an…

机器学习 · 计算机科学 2025-06-03 Yixian Zhang , Huaze Tang , Changxu Wei , Wenbo Ding

Reinforcement learning has attracted great attention recently, especially policy gradient algorithms, which have been demonstrated on challenging decision making and control tasks. In this paper, we propose an active multi-step TD algorithm…

机器学习 · 计算机科学 2019-11-28 Gang Chen , Dingcheng Li , Ran Xu

When creating new reinforcement learning tasks, practitioners often accelerate the learning process by incorporating into the task several accessory components, such as breaking the environment interaction into independent episodes and…

机器学习 · 计算机科学 2025-12-09 Homayoon Farrahi , A. Rupam Mahmood

Off-policy actor-critic algorithms have shown strong potential in deep reinforcement learning for continuous control tasks. Their success primarily comes from leveraging pessimistic state-action value function updates, which reduce function…

机器学习 · 计算机科学 2025-08-21 Bahareh Tasdighi , Nicklas Werge , Yi-Shan Wu , Melih Kandemir

In the forthcoming era of 6G networks, characterized by unprecedented data rates, ultra-low latency, and ubiquitous connectivity, effective management of Virtualized Network Functions (VNFs) is essential. VNFs are software-based…

网络与互联网体系结构 · 计算机科学 2026-05-01 Cyril Shih-Huan Hsu , Anestis Dalgkitsis , Chrysa Papagianni , Paola Grosso

Adopting reasonable strategies is challenging but crucial for an intelligent agent with limited resources working in hazardous, unstructured, and dynamic environments to improve the system's utility, decrease the overall cost, and increase…

人工智能 · 计算机科学 2023-03-09 Qin Yang , Ramviyas Parasuraman

Existing imitation learning methods mainly focus on making an agent effectively mimic a demonstrated behavior, but do not address the potential contradiction between the behavior style and the objective of a task. There is a general lack of…

机器学习 · 计算机科学 2022-09-28 Mingxi Tan , Andong Tian , Ludovic Denoyer

Actor-critic (AC) is a powerful method for learning an optimal policy in reinforcement learning, where the critic uses algorithms, e.g., temporal difference (TD) learning with function approximation, to evaluate the current policy and the…

机器学习 · 计算机科学 2024-06-05 Yudan Wang , Yue Wang , Yi Zhou , Shaofeng Zou

Expressive generative policies such as diffusion and flow models are appealing for MaxEnt online reinforcement learning because of their ability to model multimodal and highly non-Gaussian action distributions. However, training effective…

机器学习 · 计算机科学 2026-05-12 Ke He , Le He , Shunpu Tang , Yafei Wang , Lisheng Fan

The option-critic architecture (Bacon, Harb, and Precup 2017) and several variants have successfully demonstrated the use of the options framework proposed by Sutton et al (Sutton, Precup, and Singh1999) to scale learning and planning in…

人工智能 · 计算机科学 2019-06-13 Elita Lobo , Scott Jordan

In this paper, we describe NeurIPS 2019 Learning to Move - Walk Around challenge physics-based environment and present our solution to this competition which scored 1303.727 mean reward points and took 3rd place. Our method combines recent…

人工智能 · 计算机科学 2020-04-13 Dmitry Akimov

We present a deep reinforcement learning framework based on Soft Actor-Critic (SAC) for safe and precise maneuvering of double-Ackermann-steering mobile robots (DASMRs). Unlike holonomic or simpler non-holonomic robots such as…

机器人学 · 计算机科学 2025-10-15 Kohio Deflesselle , Mélodie Daniel , Aly Magassouba , Miguel Aranda , Olivier Ly