English
Related papers

Related papers: Curriculum-Based Soft Actor-Critic for Multi-Secti…

200 papers

We present temporally abstract actor-critic (TAAC), a simple but effective off-policy RL algorithm that incorporates closed-loop temporal abstraction into the actor-critic framework. TAAC adds a second-stage binary policy to choose between…

Machine Learning · Computer Science 2021-10-13 Haonan Yu , Wei Xu , Haichao Zhang

To maintain structural integrity and functionality during the designed life cycle of a structure, engineers are expected to accommodate for natural hazards as well as operational load levels. Active control systems are an efficient solution…

Systems and Control · Electrical Eng. & Systems 2021-03-16 Soheila Sadeghi Eshkevari , Soheil Sadeghi Eshkevari , Debarshi Sen , Shamim N. Pakzad

The success of reinforcement learning (RL) is fundamentally tied to having a reward function that accurately reflects the task objective. Yet, designing reward functions is notoriously time-consuming and prone to misspecification. To…

Machine Learning · Computer Science 2026-01-26 Calarina Muslimani , Yunshu Du , Kenta Kawamoto , Kaushik Subramanian , Peter Stone , Peter Wurman

This work presents a comprehensive analysis to regularize the Soft Actor-Critic (SAC) algorithm with automatic temperature adjustment. The the policy evaluation, the policy improvement and the temperature adjustment are reformulated,…

Machine Learning · Computer Science 2023-05-24 Ben You

This paper focuses on developing a deep reinforcement learning (DRL) control strategy to mitigate aerodynamic forces acting on a three dimensional (3D) square cylinder under high Reynolds number flow conditions. Four jets situated at the…

Fluid Dynamics · Physics 2024-01-24 Lei Yan , Gang Hu , Wenli Chen , Bernd R. Noack

Policy gradient methods in actor-critic reinforcement learning (RL) have become perhaps the most promising approaches to solving continuous optimal control problems. However, the trial-and-error nature of RL and the inherent randomness…

Machine Learning · Computer Science 2024-04-19 Ruofan Wu , Junmin Zhong , Jennie Si

Control of batch processes is a difficult task due to their complex nonlinear dynamics and unsteady-state operating conditions within batch and batch-to-batch. It is expected that some of these challenges can be addressed by developing…

Systems and Control · Electrical Eng. & Systems 2021-09-20 Tanuja Joshi , Shikhar Makker , Hariprasad Kodamana , Harikumar Kandath

Robust control of mechanical systems with multiple uncertainties remains a fundamental challenge, particularly when nonlinear dynamics and operating-condition variations are intricately intertwined. Although deep reinforcement learning…

Machine Learning · Computer Science 2026-03-11 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

While most current research in Reinforcement Learning (RL) focuses on improving the performance of the algorithms in controlled environments, the use of RL under constraints like those met in the video game industry is rarely studied.…

Machine Learning · Computer Science 2019-12-25 Olivier Delalleau , Maxim Peter , Eloi Alonso , Adrien Logut

Reinforcement learning (RL) has proven effective for fine-tuning large language models (LLMs), significantly enhancing their reasoning abilities in domains such as mathematics and code generation. A crucial factor influencing RL fine-tuning…

Artificial Intelligence · Computer Science 2025-10-31 Xiaoyin Chen , Jiarui Lu , Minsu Kim , Dinghuai Zhang , Jian Tang , Alexandre Piché , Nicolas Gontier , Yoshua Bengio , Ehsan Kamalloo

StarCraft II (SC2) poses a grand challenge for reinforcement learning (RL), of which the main difficulties include huge state space, varying action space, and a long time horizon. In this work, we investigate a set of RL techniques for the…

Machine Learning · Computer Science 2022-10-05 Ruo-Ze Liu , Zhen-Jia Pang , Zhou-Yu Meng , Wenhai Wang , Yang Yu , Tong Lu

The ability of a soft robot to perform specific tasks is determined by its contact configuration, and transitioning between configurations is often necessary to reach a desired position or manipulate an object. Based on this observation, we…

Robotics · Computer Science 2024-02-22 Etienne Ménager , Christian Duriez

Actor-critic (AC) methods are widely used in reinforcement learning (RL) and benefit from the flexibility of using any policy gradient method as the actor and value-based method as the critic. The critic is usually trained by minimizing the…

Machine Learning · Computer Science 2023-11-01 Sharan Vaswani , Amirreza Kazemi , Reza Babanezhad , Nicolas Le Roux

Variable stiffness actuator (VSA) designs are manifold. Conventional model-based control of these nonlinear systems is associated with high effort and design-dependent assumptions. In contrast, machine learning offers a promising…

Systems and Control · Electrical Eng. & Systems 2024-04-17 Tim-Lukas Habich , Sarah Kleinjohann , Moritz Schappler

The capability of a reinforcement learning (RL) agent heavily depends on the diversity of the learning scenarios generated by the environment. Generation of diverse realistic scenarios is challenging for real-time strategy (RTS)…

Machine Learning · Computer Science 2023-03-30 Abdus Salam Azad , Edward Kim , Qiancheng Wu , Kimin Lee , Ion Stoica , Pieter Abbeel , Sanjit A. Seshia

Exploration in multi-agent reinforcement learning is a challenging problem, especially in environments with sparse rewards. We propose a general method for efficient exploration by sharing experience amongst agents. Our proposed algorithm,…

Multiagent Systems · Computer Science 2021-05-20 Filippos Christianos , Lukas Schäfer , Stefano V. Albrecht

Autonomous control of multi-stage industrial processes requires both local specialization and global coordination. Reinforcement learning (RL) offers a promising approach, but its industrial adoption remains limited due to challenges such…

Machine Learning · Computer Science 2025-10-24 Tom Maus , Asma Atamna , Tobias Glasmachers

Recent advances in deep reinforcement learning have demonstrated the capability of learning complex control policies from many types of environments. When learning policies for safety-critical applications, it is essential to be sensitive…

Machine Learning · Computer Science 2019-11-12 Yichuan Charlie Tang , Jian Zhang , Ruslan Salakhutdinov

Recent self-supervised learning approaches focus on using a few thousand data points to learn policies for high-level, low-dimensional action spaces. However, scaling this framework for high-dimensional control require either scaling up the…

Robotics · Computer Science 2018-02-14 Adithyavairavan Murali , Lerrel Pinto , Dhiraj Gandhi , Abhinav Gupta

Quadrotors are highly nonlinear dynamical systems that require carefully tuned controllers to be pushed to their physical limits. Recently, learning-based control policies have been proposed for quadrotors, as they would potentially allow…

Robotics · Computer Science 2022-02-23 Elia Kaufmann , Leonard Bauersfeld , Davide Scaramuzza