English
Related papers

Related papers: Curriculum-Based Soft Actor-Critic for Multi-Secti…

200 papers

The intrinsic compliance and high degree of freedom (DoF) of redundant soft manipulators facilitate safe interaction and flexible task execution. However, effective kinematic control remains highly challenging, as it must handle…

Robotics · Computer Science 2025-07-24 Yinan Meng , Kun Qian , Jiong Yang , Renbo Su , Zhenhong Li , Charlie C. L. Wang

Closed-loop control remains an open challenge in soft robotics. The nonlinear responses of soft actuators under dynamic loading conditions limit the use of analytic models for soft robot control. Traditional methods of controlling soft…

The Soft Actor-Critic (SAC) algorithm, a state-of-the-art method in maximum entropy reinforcement learning, traditionally relies on minimizing reverse Kullback-Leibler (KL) divergence for policy updates. However, this approach leads to an…

Machine Learning · Computer Science 2025-06-03 Yixian Zhang , Huaze Tang , Changxu Wei , Wenbo Ding

Safe reinforcement learning (RL) seeks to mitigate unsafe behaviors that arise from exploration during training by reducing constraint violations while maintaining task performance. Existing approaches typically rely on a single policy to…

Robotics · Computer Science 2026-05-12 Murad Dawood , Usama Ahmed Siddiquie , Shahram Khorshidi , Maren Bennewitz

Text-based games are a popular testbed for language-based reinforcement learning (RL). In previous work, deep Q-learning is commonly used as the learning agent. Q-learning algorithms are challenging to apply to complex real-world domains…

Machine Learning · Computer Science 2023-06-28 Weichen Li , Rati Devidze , Sophie Fellenz

Reinforcement learning (RL) has emerged as a powerful tool for tackling control problems, but its practical application is often hindered by the complexity arising from intricate reward functions with multiple terms. The reward hypothesis…

Machine Learning · Computer Science 2025-02-11 Kilian Freitag , Kristian Ceder , Rita Laezza , Knut Åkesson , Morteza Haghir Chehreghani

Roll-to-roll (R2R) printing technologies are promising for high-volume continuous production of substrate-based electronic products. One of the major challenges in R2R flexible electronics printing is achieving tight alignment tolerances,…

Systems and Control · Electrical Eng. & Systems 2025-09-30 Zifeng Wang , Xiaoning Jin

Solving complex problems using reinforcement learning necessitates breaking down the problem into manageable tasks and learning policies to solve these tasks. These policies, in turn, have to be controlled by a master policy that takes…

Artificial Intelligence · Computer Science 2022-08-09 Ambedkar Dukkipati , Rajarshi Banerjee , Ranga Shaarad Ayyagari , Dhaval Parmar Udaybhai

Visual reinforcement learning is appealing for robotics but expensive -- off-policy methods are sample-efficient yet slow; on-policy methods parallelize well but waste samples. Recent work has shown that off-policy methods can train faster…

Robotics · Computer Science 2026-02-25 Abdulaziz Almuzairee , Henrik I. Christensen

Reusing previously trained models is critical in deep reinforcement learning to speed up training of new agents. However, it is unclear how to acquire new skills when objectives and constraints are in conflict with previously learned…

Machine Learning · Computer Science 2022-02-09 Jaime S. Ide , Daria Mićović , Michael J. Guarino , Kevin Alcedo , David Rosenbluth , Adrian P. Pope

A critical problem with the practical utility of controllers trained with deep Reinforcement Learning (RL) is the notable lack of smoothness in the actions learned by the RL policies. This trend often presents itself in the form of control…

Robotics · Computer Science 2021-05-28 Siddharth Mysore , Bassel Mabsout , Renato Mancuso , Kate Saenko

Deep Reinforcement Learning is emerging as a promising approach for the continuous control task of robotic arm movement. However, the challenges of learning robust and versatile control capabilities are still far from being resolved for…

Recent advances in deep reinforcement learning have achieved impressive results in a wide range of complex tasks, but poor sample efficiency remains a major obstacle to real-world deployment. Soft actor-critic (SAC) mitigates this problem…

Machine Learning · Computer Science 2024-09-10 Luca Della Libera

We study online control for continuous-time linear systems with finite sampling rates, where the objective is to design an online procedure that learns under non-stochastic noise and performs comparably to a fixed optimal linear controller.…

Optimization and Control · Mathematics 2025-06-10 Jingwei Li , Jing Dong , Can Chang , Baoxiang Wang , Jingzhao Zhang

This paper explores the application of the Soft Actor-Critic (SAC) algorithm within a Distributional Reinforcement Learning setting and introduces an implementation of such algorithm named Cram\'er-based Distributional Soft Actor-Critic…

Machine Learning · Computer Science 2026-05-12 Vanya Aziz , Ivo Nowak , E. M. T Hendrix

Dynamic Reinforcement Learning (Dynamic RL), proposed in this paper, directly controls system dynamics, instead of the actor (action-generating neural network) outputs at each moment, bringing about a major qualitative shift in…

Machine Learning · Computer Science 2025-02-17 Katsunari Shibata

Reinforcement Learning (RL) has been widely applied to many control tasks and substantially improved the performances compared to conventional control methods in many domains where the reward function is well defined. However, for many…

Machine Learning · Computer Science 2024-03-22 Baohe Zhang , Yuan Zhang , Lilli Frison , Thomas Brox , Joschka Bödecker

Soft Actor-Critic is a state-of-the-art reinforcement learning algorithm for continuous action settings that is not applicable to discrete action settings. Many important settings involve discrete actions, however, and so here we derive an…

Machine Learning · Computer Science 2019-10-21 Petros Christodoulou

Balancing reward and safety in constrained reinforcement learning remains challenging due to poor generalization from sharp value minima and inadequate handling of heavy-tailed risk distribution. We introduce Safe Langevin Soft Actor-Critic…

Machine Learning · Computer Science 2026-02-03 Mahesh Keswani , Samyak Jain , Raunak P. Bhattacharyya

Purpose: Real-life applications using quadrotors introduce a number of disturbances and time-varying properties that pose a challenge to flight controllers. We observed that, when a quadrotor is tasked with picking up and dropping a…

Robotics · Computer Science 2022-10-07 Guilherme Siqueira Eduardo , Wouter Caarls