English
Related papers

Related papers: Soft Actor-Critic Deep Reinforcement Learning for …

200 papers

This paper enhances the feedback linearization controller for multirotors with a learned acceleration error model and a thrust input delay mitigation model. Feedback linearization controllers are theoretically appealing but their…

Robotics · Computer Science 2021-12-15 Alexander Spitzer , Nathan Michael

Automation of berthing maneuvers in shipping is a pressing issue as the berthing maneuver is one of the most stressful tasks seafarers undertake. Berthing control problems are often tackled via tracking a predefined trajectory or path.…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Kouki Wakita , Youhei Akimoto , Dimas M. Rachman , Yoshiki Miyauchi , Umeda Naoya , Atsuo Maki

Agile flights of autonomous quadrotors in cluttered environments require constrained motion planning and control subject to translational and rotational dynamics. Traditional model-based methods typically demand complicated design and heavy…

Robotics · Computer Science 2022-09-23 Yixiao Wang , Bingheng Wang , Shenning Zhang , Han Wei Sia , Lin Zhao

This research study explores the applicability of Deep Reinforcement Learning (DRL) for thermal control based on Computational Fluid Dynamics. To accomplish that, the forced convection on a hot plate prone to a pulsating cooling jet with…

Numerical Analysis · Mathematics 2024-02-19 Sajad Salavatidezfouli , Giovanni Stabile , Gianluigi Rozza

A data-efficient learning-based control design method is proposed in this paper. It is based on learning a system dynamics model that is then leveraged in a two-level procedure. On the higher level, a simple but powerful optimization…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Ludvig Svedlund , Constantin Cronrath , Jonas Fredriksson , Bengt Lennartson

This paper aims to improve the action smoothness of a cascaded online learning flight control system. Although the cascaded structure is widely used in flight control design, its stability can be compromised by oscillatory control actions,…

Systems and Control · Electrical Eng. & Systems 2026-04-20 Yifei Li , Erik-jan van Kampen

This paper introduces a learning-based visual planner for agile drone flight in cluttered environments. The proposed planner generates collision-free waypoints in milliseconds, enabling drones to perform agile maneuvers in complex…

Robotics · Computer Science 2025-11-21 Minwoo Kim , Geunsik Bae , Jinwoo Lee , Woojae Shin , Changseung Kim , Myong-Yol Choi , Heejung Shin , Hyondong Oh

Unmanned Aerial Vehicles (UAVs) depend on onboard sensors for perception, navigation, and control. However, these sensors are susceptible to physical attacks, such as GPS spoofing, that can corrupt state estimates and lead to unsafe…

Machine Learning · Computer Science 2025-06-30 Pritam Dash , Ethan Chan , Nathan P. Lawrence , Karthik Pattabiraman

Reinforcement Learning (RL) has shown promise in control tasks but faces significant challenges in real-world applications, primarily due to the absence of safety guarantees during the learning process. Existing methods often struggle with…

Machine Learning · Computer Science 2025-04-29 Donghe Chen , Han Wang , Lin Cheng , Shengping Gong

Reinforcement learning is commonly associated with training of reward-maximizing (or cost-minimizing) agents, in other words, controllers. It can be applied in model-free or model-based fashion, using a priori or online collected system…

Systems and Control · Electrical Eng. & Systems 2022-09-01 Lukas Beckenbach , Pavel Osinenko , Stefan Streif

Air traffic control is a real-time safety-critical decision making process in highly dynamic and stochastic environments. In today's aviation practice, a human air traffic controller monitors and directs many aircraft flying through its…

Machine Learning · Computer Science 2019-05-07 Marc Brittain , Peng Wei

In the field of fixed wing aircraft, many morphing technologies have been applied to the wing, such as adaptive airfoil, variable span aircraft, variable swept angle aircraft, etc., but few are aimed at the tail. The traditional fixed wing…

Fluid Dynamics · Physics 2020-10-09 Liming Zheng , Zhou Zhou , Pengbo Sun , Zhilin Zhang , Rui Wang

In marine operations underwater manipulators play a primordial role. However, due to uncertainties in the dynamic model and disturbances caused by the environment, low-level control methods require great capabilities to adapt to change.…

Robotics · Computer Science 2021-08-06 Ignacio Carlucho , Mariano De Paula , Gerardo G. Acosta , Corina Barbalata

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

Robotics · Computer Science 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

Over the last decade, there has been increasing interest in autonomous driving systems. Reinforcement Learning (RL) shows great promise for training autonomous driving controllers, being able to directly optimize a combination of criteria…

Robotics · Computer Science 2024-07-25 Tianyu Shi , Ilia Smirnov , Omar ElSamadisy , Baher Abdulhai

Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Steven Spielberg , Aditya Tulsyan , Nathan P. Lawrence , Philip D Loewen , R. Bhushan Gopaluni

Recently, needs for unmanned aerial vehicles (UAVs) that are attachable to the wall have been highlighted. As one of the ways to address the need, researches on various tilting multirotors that can increase maneuverability has been…

Robotics · Computer Science 2021-08-13 Hyungyu Lee , Myeongwoo Jeong , Chanyoung Kim , Hyungtae Lim , Changgue Park , Sungwon Hwang , Hyun Myung

This study presents an innovative approach to optimal gait control for a soft quadruped robot enabled by four Compressible Tendon-driven Soft Actuators (CTSAs). Improving our previous studies of using model-free reinforcement learning for…

Robotics · Computer Science 2026-05-08 Xuezhi Niu , Kaige Tan , Lei Feng

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

Fluid Dynamics · Physics 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

This study presents an Actor-Critic reinforcement learning Compensated Model Predictive Controller (AC2MPC) designed for high-speed, off-road autonomous driving on deformable terrains. Addressing the difficulty of modeling unknown…

Robotics · Computer Science 2026-01-23 Prakhar Gupta , Jonathon M. Smereka , Yunyi Jia