中文
相关论文

相关论文: A Single-Loop Deep Actor-Critic Algorithm for Cons…

200 篇论文

This paper proposes a reinforcement learning (RL)-based backstepping control strategy to achieve fixed time consensus in nonlinear multi-agent systems with strict feedback dynamics. Agents exchange only output information with their…

系统与控制 · 电气工程与系统科学 2025-07-23 Aria Delshad , Maryam Babazadeh

Stochastic gradient descent (SGD), which updates the model parameters by adding a local gradient times a learning rate at each step, is widely used in model training of machine learning algorithms such as neural networks. It is observed…

机器学习 · 计算机科学 2017-06-01 Chang Xu , Tao Qin , Gang Wang , Tie-Yan Liu

Deep Reinforcement Learning (DRL) algorithms for continuous action spaces are known to be brittle toward hyperparameters as well as \cut{being}sample inefficient. Soft Actor Critic (SAC) proposes an off-policy deep actor critic algorithm…

机器学习 · 计算机科学 2019-06-10 Patrick Nadeem Ward , Ariella Smofsky , Avishek Joey Bose

A one-step two-critic deep reinforcement learning (OSTC-DRL) approach for inverter-based volt-var control (IB-VVC) in active distribution networks is proposed in this paper. Firstly, considering IB-VVC can be formulated as a single-period…

人工智能 · 计算机科学 2022-07-04 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun , Wenqi Huang

As an important type of reinforcement learning algorithms, actor-critic (AC) and natural actor-critic (NAC) algorithms are often executed in two ways for finding optimal policies. In the first nested-loop design, actor's one update of…

机器学习 · 计算机科学 2020-05-11 Tengyu Xu , Zhe Wang , Yingbin Liang

While deep reinforcement learning has achieved tremendous successes in various applications, most existing works only focus on maximizing the expected value of total return and thus ignore its inherent stochasticity. Such stochasticity is…

机器学习 · 计算机科学 2023-09-19 Han Zhong , Xun Deng , Ethan X. Fang , Zhuoran Yang , Zhaoran Wang , Runze Li

We propose a fully distributed actor-critic architecture, named Diff-DAC, with application to multitask reinforcement learning (MRL). During the learning process, agents communicate their value and policy parameters to their neighbours,…

机器学习 · 计算机科学 2021-10-26 Sergio Valcarcel Macua , Ian Davies , Aleksi Tukiainen , Enrique Munoz de Cote

Off-policy reinforcement learning (RL) is concerned with learning a rewarding policy by executing another policy that gathers samples of experience. While the former policy (i.e. target policy) is rewarding but in-expressive (in most cases,…

机器学习 · 计算机科学 2020-03-02 Anji Liu , Yitao Liang , Guy Van den Broeck

We propose WSAC (Weighted Safe Actor-Critic), a novel algorithm for Safe Offline Reinforcement Learning (RL) under functional approximation, which can robustly optimize policies to improve upon an arbitrary reference policy with limited…

机器学习 · 计算机科学 2024-11-01 Honghao Wei , Xiyue Peng , Arnob Ghosh , Xin Liu

Reinforcement learning (RL) has shown remarkable success in solving complex decision-making and control tasks. However, many model-free RL algorithms experience performance degradation due to inaccurate value estimation, particularly the…

机器学习 · 计算机科学 2025-08-07 Jingliang Duan , Wenxuan Wang , Liming Xiao , Jiaxin Gao , Shengbo Eben Li , Chang Liu , Ya-Qin Zhang , Bo Cheng , Keqiang Li

Interactive multimodal agents must convert raw visual observations into coherent sequences of language-conditioned actions -- a capability that current vision-language models (VLMs) still lack. Earlier reinforcement-learning (RL) efforts…

机器学习 · 计算机科学 2025-08-07 George Bredis , Stanislav Dereka , Viacheslav Sinii , Ruslan Rakhimov , Daniil Gavrilov

Policy gradient methods in actor-critic reinforcement learning (RL) have become perhaps the most promising approaches to solving continuous optimal control problems. However, the trial-and-error nature of RL and the inherent randomness…

机器学习 · 计算机科学 2024-04-19 Ruofan Wu , Junmin Zhong , Jennie Si

The two-time scale nature of SAC, which is an actor-critic algorithm, is characterised by the fact that the critic estimate has not converged for the actor at any given time, but since the critic learns faster than the actor, it ensures…

For a multi-cell, multi-user, cellular network downlink sum-rate maximization through power allocation is a nonconvex and NP-hard optimization problem. In this paper, we present an effective approach to solving this problem through single-…

信息论 · 计算机科学 2020-09-15 Ahmad Ali Khan , Raviraj Adve

Adopting reasonable strategies is challenging but crucial for an intelligent agent with limited resources working in hazardous, unstructured, and dynamic environments to improve the system's utility, decrease the overall cost, and increase…

人工智能 · 计算机科学 2023-12-06 Qin Yang , Ramviyas Parasuraman

Reinforcement Learning (RL) techniques have drawn great attention in many challenging tasks, but their performance deteriorates dramatically when applied to real-world problems. Various methods, such as domain randomization, have been…

机器学习 · 计算机科学 2022-08-05 Wangyang Yue , Yuan Zhou , Xiaochuan Zhang , Yuchen Hua , Zhiyuan Wang , Guang Kou

Reinforcement learning (RL) is a fundamental framework for sequential decision-making, in which an agent learns an optimal policy through interactions with an unknown environment. In settings with function approximation, many existing RL…

机器学习 · 计算机科学 2026-05-05 Ruiquan Huang , Donghao Li , Yingbin Liang , Jing Yang

This paper proposes a Deep Reinforcement Learning (DRL) approach for solving knapsack problem. The proposed method consists of a state aggregation step based on tabular reinforcement learning to extract features and construct states. The…

神经与进化计算 · 计算机科学 2020-04-28 Reza Refaei Afshar , Yingqian Zhang , Murat Firat , Uzay Kaymak

Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly…

机器学习 · 计算机科学 2018-10-25 Esther Derman , Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

This work examines average-reward reinforcement learning with general policy parametrization. Existing state-of-the-art (SOTA) guarantees for this problem are either suboptimal or hindered by several challenges, including poor scalability…

机器学习 · 计算机科学 2025-05-07 Swetha Ganesh , Washim Uddin Mondal , Vaneet Aggarwal