中文
相关论文

相关论文: Reinforcement Learning Architectures: SAC, TAC, an…

200 篇论文

Reinforcement learning (RL) enjoyed significant progress over the last years. One of the most important steps forward was the wide application of neural networks. However, architectures of these neural networks are typically constructed…

机器学习 · 计算机科学 2021-04-29 N. Mazyavkina , S. Moustafa , I. Trofimov , E. Burnaev

Multi-agent collaboration has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models, yet it suffers from interaction-level ambiguity that blurs generation, critique, and revision, making credit…

Designing reinforcement learning (RL) agents is typically a difficult process that requires numerous design iterations. Learning can fail for a multitude of reasons, and standard RL methods provide too few tools to provide insight into the…

机器学习 · 计算机科学 2022-10-24 James MacGlashan , Evan Archer , Alisa Devlic , Takuma Seno , Craig Sherstan , Peter R. Wurman , Peter Stone

Learning expressive stochastic policies instead of deterministic ones has been proposed to achieve better stability, sample complexity, and robustness. Notably, in Maximum Entropy Reinforcement Learning (MaxEnt RL), the policy is modeled as…

机器学习 · 计算机科学 2024-05-03 Safa Messaoud , Billel Mokeddem , Zhenghai Xue , Linsey Pang , Bo An , Haipeng Chen , Sanjay Chawla

Model-free deep reinforcement learning (RL) algorithms have achieved tremendous success on a range of challenging tasks. However, safety concerns remain when these methods are deployed on real-world applications, necessitating risk-aware…

机器学习 · 计算机科学 2026-02-10 Alonso Granados , Jason Pacheco

In the trial-and-error mechanism of reinforcement learning (RL), a notorious contradiction arises when we expect to learn a safe policy: how to learn a safe policy without enough data and prior model about the dangerous region? Existing…

机器学习 · 计算机科学 2021-11-29 Haitong Ma , Changliu Liu , Shengbo Eben Li , Sifa Zheng , Wenchao Sun , Jianyu Chen

Biological agents learn and act intelligently in spite of a highly limited capacity to process and store information. Many real-world problems involve continuous control, which represents a difficult task for artificial intelligence agents.…

机器学习 · 计算机科学 2025-05-16 Tailia Malloy , Chris R. Sims , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro

Dynamic Reinforcement Learning (Dynamic RL), proposed in this paper, directly controls system dynamics, instead of the actor (action-generating neural network) outputs at each moment, bringing about a major qualitative shift in…

机器学习 · 计算机科学 2025-02-17 Katsunari Shibata

The safety constraints commonly used by existing safe reinforcement learning (RL) methods are defined only on expectation of initial states, but allow each certain state to be unsafe, which is unsatisfying for real-world safety-critical…

机器学习 · 计算机科学 2021-06-15 Haitong Ma , Yang Guan , Shegnbo Eben Li , Xiangteng Zhang , Sifa Zheng , Jianyu Chen

Soft Actor-Critic (SAC) is an off-policy actor-critic deep reinforcement learning (DRL) algorithm based on maximum entropy reinforcement learning. By combining off-policy updates with an actor-critic formulation, SAC achieves…

机器学习 · 计算机科学 2019-06-11 Che Wang , Keith Ross

ATARI is a suite of video games used by reinforcement learning (RL) researchers to test the effectiveness of the learning algorithm. Receiving only the raw pixels and the game score, the agent learns to develop sophisticated strategies,…

机器学习 · 计算机科学 2024-07-17 Le Zhang , Yong Gu , Xin Zhao , Yanshuo Zhang , Shu Zhao , Yifei Jin , Xinxin Wu

We study the adaption of Soft Actor-Critic (SAC), which is considered as a state-of-the-art reinforcement learning (RL) algorithm, from continuous action space to discrete action space. We revisit vanilla discrete SAC and provide an…

机器学习 · 计算机科学 2024-11-21 Haibin Zhou , Tong Wei , Zichuan Lin , junyou li , Junliang Xing , Yuanchun Shi , Li Shen , Chao Yu , Deheng Ye

Despite the promising results achieved, state-of-the-art interactive reinforcement learning schemes rely on passively receiving supervision signals from advisor experts, in the form of either continuous monitoring or pre-defined rules,…

机器学习 · 计算机科学 2024-05-27 Shunyu Liu , Kaixuan Chen , Na Yu , Jie Song , Zunlei Feng , Mingli Song

Reinforcement learning (RL) is a goal-oriented learning solution that has proven to be successful for Neural Architecture Search (NAS) on the CIFAR and ImageNet datasets. However, a limitation of this approach is its high computational…

神经与进化计算 · 计算机科学 2019-12-04 J. Gomez Robles , J. Vanschoren

Reinforcement learning (RL) has shown remarkable success in solving complex decision-making and control tasks. However, many model-free RL algorithms experience performance degradation due to inaccurate value estimation, particularly the…

机器学习 · 计算机科学 2025-08-07 Jingliang Duan , Wenxuan Wang , Liming Xiao , Jiaxin Gao , Shengbo Eben Li , Chang Liu , Ya-Qin Zhang , Bo Cheng , Keqiang Li

With the increasing penetration of renewable energy sources, growing demand variability, and evolving grid control strategies, accurate and efficient load modeling has become a critical yet challenging task. Traditional methods, such as…

系统与控制 · 电气工程与系统科学 2025-03-11 Ding Lin , Han Guo , Jianhui Wang , Meng Yue , Tianqiao Zhao

Deep reinforcement learning has made significant progress in robotic manipulation tasks and it works well in the ideal disturbance-free environment. However, in a real-world environment, both internal and external disturbances are…

机器人学 · 计算机科学 2020-11-09 Pingcheng Jian , Chao Yang , Di Guo , Huaping Liu , Fuchun Sun

It is a popular belief that model-based Reinforcement Learning (RL) is more sample efficient than model-free RL, but in practice, it is not always true due to overweighed model errors. In complex and noisy settings, model-based RL tends to…

机器学习 · 计算机科学 2020-10-13 Feiyang Pan , Jia He , Dandan Tu , Qing He

Deep Reinforcement Learning (DRL) algorithms for continuous action spaces are known to be brittle toward hyperparameters as well as \cut{being}sample inefficient. Soft Actor Critic (SAC) proposes an off-policy deep actor critic algorithm…

机器学习 · 计算机科学 2019-06-10 Patrick Nadeem Ward , Ariella Smofsky , Avishek Joey Bose

Recent advancements in Large Language Models (LLMs) and Reinforcement Learning (RL) have shown significant promise in decision-making tasks. Nevertheless, for large-scale industrial decision problems, both approaches face distinct…

人工智能 · 计算机科学 2025-06-04 Xu Wan , Wenyue Xu , Chao Yang , Mingyang Sun