English
Related papers

Related papers: Autonomous Blimp Control via H-infinity Robust Dee…

200 papers

We demonstrate experimentally the feasibility of applying reinforcement learning (RL) in flow control problems by automatically discovering active control strategies without any prior knowledge of the flow physics. We consider the turbulent…

Fluid Dynamics · Physics 2020-03-10 Dixia Fan , Liu Yang , Michael S Triantafyllou , George Em Karniadakis

Neural control is an exciting mystery which we instinctively master. Yet, researchers have a hard time explaining the motor control trajectories. Physiologically accurate biomechanical simulations can, to some extent, mimic live subjects…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Amir H. Abdi , Masoud Malakoutian , Thomas Oxland , Sidney Fels

Optimizing accelerator control is a critical challenge in experimental particle physics, requiring significant manual effort and resource expenditure. Traditional tuning methods are often time-consuming and reliant on expert input,…

Accelerator Physics · Physics 2026-01-27 Anwar Ibrahim , Denis Derkach , Alexey Petrenko , Fedor Ratnikov , Maxim Kaledin

Despite the many recent advances in reinforcement learning (RL), the question of learning policies that robustly satisfy state constraints under unknown disturbances remains open. In this paper, we offer a new perspective on achieving…

Machine Learning · Computer Science 2025-12-23 Pierre-François Massiani , Alexander von Rohr , Lukas Haverbeck , Sebastian Trimpe

The learning inefficiency of reinforcement learning (RL) from scratch hinders its practical application towards continuous robotic tracking control, especially for high-dimensional robots. This work proposes a data-informed residual…

Systems and Control · Electrical Eng. & Systems 2024-06-10 Cong Li , Fangzhou Liu , Yongchao Wang , Martin Buss

The ability to achieve and maintain inverted poses is essential for unlocking the full agility of miniature blimp robots (MBRs). However, developing reliable inverted control strategies for MBRs remains challenging due to their complex and…

Robotics · Computer Science 2026-03-09 Yuanlin Yang , Lin Hong , Fumin Zhang

Robotic systems are increasingly employed for industrial automation, with contact-rich tasks like polishing requiring dexterity and compliant behaviour. These tasks are difficult to model, making classical control challenging. Deep…

Robotics · Computer Science 2025-06-03 Emma Cramer , Lukas Jäschke , Sebastian Trimpe

This paper focuses on a drag-reducing control strategy on a 2D-simulated laminar flow past a cylinder. Deep reinforcement learning algorithms have been implemented to discover efficient control schemes, using two synthetic jets located on…

Fluid Dynamics · Physics 2020-06-23 Romain Paris , Samir Beneddine , Julien Dandois

There has recently been an increased interest in reinforcement learning for nonlinear control problems. However standard reinforcement learning algorithms can often struggle even on seemingly simple set-point control problems. This paper…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Ruoqi Zhang , Per Mattsson , Torbjörn Wigren

Quadrotor unmanned aerial vehicles (UAVs) are increasingly deployed in complex missions that demand reliable autonomous navigation and robust obstacle avoidance. However, traditional modular pipelines often incur cumulative latency, whereas…

Robotics · Computer Science 2026-02-10 Jiarui Zhang , Chengyong Lei , Chengjiang Dai , Lijie Wang , Zhichao Han , Fei Gao

End-to-end reinforcement learning (RL) for humanoid locomotion is appealing for its compact perception-action mapping, yet practical policies often suffer from training instability, inefficient feature fusion, and high actuation cost. We…

Robotics · Computer Science 2026-02-12 Yinuo Wang , Yuanyang Qi , Jinzhao Zhou , Pengxiang Meng , Xiaowen Tao

Deep reinforcement learning (DRL) has achieved tremendous success in many complex decision-making tasks of autonomous systems with high-dimensional state and/or action spaces. However, the safety and stability still remain major concerns…

Machine Learning · Computer Science 2023-03-30 Hongpeng Cao , Yanbing Mao , Lui Sha , Marco Caccamo

Deep reinforcement learning (DRL) is a machine learning-based method suited for complex and high-dimensional control problems. In this study, a real-time control system based on DRL is developed for long-term voltage stability events. The…

Systems and Control · Electrical Eng. & Systems 2022-07-12 Hannes Hagmar , Le Anh Tuan , Robert Eriksson

Deep reinforcement learning (DRL) has recently been adopted in a wide range of physics and engineering domains for its ability to solve decision-making problems that were previously out of reach due to a combination of non-linearity and…

Computational Physics · Physics 2024-06-19 Paul Garnier , Jonathan Viquerat , Jean Rabault , Aurélien Larcher , Alexander Kuhnle , Elie Hachem

Recent advances in deep reinforcement learning (RL) have demonstrated its potential to learn complex robotic manipulation tasks. However, RL still requires the robot to collect a large amount of real-world experience. To address this…

Robotics · Computer Science 2020-03-12 Bohan Wu , Feng Xu , Zhanpeng He , Abhi Gupta , Peter K. Allen

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

This paper investigates a hybrid solution which combines deep reinforcement learning (RL) and classical trajectory planning for the following in front application. Here, an autonomous robot aims to stay ahead of a person as the person…

Robotics · Computer Science 2020-11-09 Payam Nikdel , Richard Vaughan , Mo Chen

Modern quadrupeds are skillful in traversing or even sprinting on uneven terrains in a remote uncontrolled environment. However, survival in the wild requires not only maneuverability, but also the ability to handle potential critical…

Robotics · Computer Science 2024-10-28 Dikai Liu , Tianwei Zhang , Jianxiong Yin , Simon See

Improving robustness to uncertainty and rejection of external disturbances represents a significant challenge in aerial robotics. Nonlinear controllers based on Incremental Nonlinear Dynamic Inversion (INDI), known for their ability in…

Robotics · Computer Science 2025-01-14 Mohamad Hachem , Clément Roos , Thierry Miquel , Murat Bronz

Closed-loop control remains an open challenge in soft robotics. The nonlinear responses of soft actuators under dynamic loading conditions limit the use of analytic models for soft robot control. Traditional methods of controlling soft…