中文
相关论文

相关论文: Soft Actor-Critic With Integer Actions

200 篇论文

The average-reward formulation of reinforcement learning (RL) has drawn increased interest in recent years for its ability to solve temporally-extended problems without relying on discounting. Meanwhile, in the discounted setting,…

机器学习 · 计算机科学 2025-08-06 Jacob Adamczyk , Volodymyr Makarenko , Stas Tiomkin , Rahul V. Kulkarni

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we…

最优化与控制 · 数学 2020-06-12 Guannan Qu , Yiheng Lin , Adam Wierman , Na Li

In the trial-and-error mechanism of reinforcement learning (RL), a notorious contradiction arises when we expect to learn a safe policy: how to learn a safe policy without enough data and prior model about the dangerous region? Existing…

机器学习 · 计算机科学 2021-11-29 Haitong Ma , Changliu Liu , Shengbo Eben Li , Sifa Zheng , Wenchao Sun , Jianyu Chen

Reinforcement learning algorithms have shown great success in solving different problems ranging from playing video games to robotics. However, they struggle to solve delicate robotic problems, especially those involving contact…

机器人学 · 计算机科学 2020-07-15 Miroslav Bogdanovic , Majid Khadiv , Ludovic Righetti

Offline reinforcement learning (RL) is a promising approach for many control applications but faces challenges such as limited data coverage and value function overestimation. In this paper, we propose an implicit actor-critic (iAC)…

机器学习 · 计算机科学 2024-08-29 Vanshaj Khattar , Ming Jin

In federated learning (FL), model aggregation has been widely adopted for data privacy. In recent years, assigning different weights to local models has been used to alleviate the FL performance degradation caused by differences between…

机器学习 · 计算机科学 2022-02-01 Chenghao Huang , Weilong Chen , Yuxi Chen , Shunji Yang , Yanru Zhang

Training a model-free deep reinforcement learning model to solve image-to-image translation is difficult since it involves high-dimensional continuous state and action spaces. In this paper, we draw inspiration from the recent success of…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Ziwei Luo , Jing Hu , Xin Wang , Siwei Lyu , Bin Kong , Youbing Yin , Qi Song , Xi Wu

We study robust reinforcement learning (RL) with the goal of determining a well-performing policy that is robust against model mismatch between the training simulator and the testing environment. Previous policy-based robust RL algorithms…

机器学习 · 计算机科学 2023-12-12 Ruida Zhou , Tao Liu , Min Cheng , Dileep Kalathil , P. R. Kumar , Chao Tian

In this paper, we propose SACHER (soft actor-critic (SAC) with hindsight experience replay (HER)), which constitutes a class of deep reinforcement learning (DRL) algorithms. SAC is known as an off-policy model-free DRL algorithm based on…

系统与控制 · 电气工程与系统科学 2021-06-08 Myoung Hoon Lee , Jun Moon

In this work, we propose Behavior-Guided Actor-Critic (BAC), an off-policy actor-critic deep RL algorithm. BAC mathematically formulates the behavior of the policy through autoencoders by providing an accurate estimation of how frequently…

机器学习 · 计算机科学 2021-04-12 Ammar Fayad , Majd Ibrahim

The effectiveness of credit assignment in reinforcement learning (RL) when dealing with high-dimensional data is influenced by the success of representation learning via deep neural networks, and has implications for the sample efficiency…

机器学习 · 计算机科学 2025-02-03 Burcu Küçükoğlu , Sander Dalm , Marcel van Gerven

This paper proposes a reinforcement learning--based framework for cryptocurrency portfolio management using the Soft Actor--Critic (SAC) and Deep Deterministic Policy Gradient (DDPG) algorithms. Traditional portfolio optimization methods…

计算金融 · 定量金融 2025-11-27 Kamal Paykan

Discrete reinforcement learning (RL) algorithms have demonstrated exceptional performance in solving sequential decision tasks with discrete action spaces, such as Atari games. However, their effectiveness is hindered when applied to…

机器学习 · 计算机科学 2023-08-22 Yechen Zhang , Jian Sun , Gang Wang , Zhuo Li , Wei Chen

Biological agents learn and act intelligently in spite of a highly limited capacity to process and store information. Many real-world problems involve continuous control, which represents a difficult task for artificial intelligence agents.…

机器学习 · 计算机科学 2025-05-16 Tailia Malloy , Chris R. Sims , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro

This paper proposes a new Reinforcement Learning (RL) based control architecture for quadrotors. With the literature focusing on controlling the four rotors' RPMs directly, this paper aims to control the quadrotor's thrust vector. The RL…

机器人学 · 计算机科学 2025-12-23 Youssef Mahran , Zeyad Gamal , Ayman El-Badawy

Reinforcement Learning (RL) has been widely applied to many control tasks and substantially improved the performances compared to conventional control methods in many domains where the reward function is well defined. However, for many…

机器学习 · 计算机科学 2024-03-22 Baohe Zhang , Yuan Zhang , Lilli Frison , Thomas Brox , Joschka Bödecker

We identify two issues with the family of algorithms based on the Adversarial Imitation Learning framework. The first problem is implicit bias present in the reward functions used in these algorithms. While these biases might work well for…

机器学习 · 计算机科学 2018-10-16 Ilya Kostrikov , Kumar Krishna Agrawal , Debidatta Dwibedi , Sergey Levine , Jonathan Tompson

We present a Multi-task Soft Actor-Critic (SAC) Reinforcement Learning framework designed for open-system quantum control across diverse Hamiltonians, which learns optimal pulse sequences while simultaneously discovering problem-specific…

量子物理 · 物理学 2026-05-27 Haftu W. Fentaw , Steve Campbell , Simon Caton

Reinforcement learning is a promising model-free and adaptive controller for demand side management, as part of the future smart grid, at the district level. This paper presents the results of the algorithm that was submitted for the…

机器学习 · 计算机科学 2021-04-27 Anjukan Kathirgamanathan , Kacper Twardowski , Eleni Mangina , Donal Finn

The deployment of robots in uncontrolled environments requires them to operate robustly under previously unseen scenarios, like irregular terrain and wind conditions. Unfortunately, while rigorous safety frameworks from robust optimal…

机器学习 · 计算机科学 2024-06-11 Kai-Chieh Hsu , Duy Phuong Nguyen , Jaime Fernández Fisac