English
Related papers

Related papers: A Q-learning Control Method for a Soft Robotic Arm…

200 papers

This paper introduces a novel data-driven approach to design a linear quadratic regulator (LQR) using a reinforcement learning (RL) algorithm that does not require a system model. The key contribution is to perform policy iteration (PI) by…

Systems and Control · Electrical Eng. & Systems 2023-11-20 Soroush Asri , Luis Rodrigues

Tracking control for soft robots is challenging due to uncertainties in the system model and environment. Using high feedback gains to overcome this issue results in an increasing stiffness that clearly destroys the inherent safety property…

Systems and Control · Electrical Eng. & Systems 2019-06-26 Thomas Beckers , Sandra Hirche

Learning-based model predictive control has emerged as a powerful approach for handling complex dynamics in mechatronic systems, enabling data-driven performance improvements while respecting safety constraints. However, when computational…

Systems and Control · Electrical Eng. & Systems 2025-12-19 Mark Benazet , Francesco Ricca , Dario Bralla , Melanie N. Zeilinger , Andrea Carron

Accurately modeling soft robots in simulation is computationally expensive and commonly falls short of representing the real world. This well-known discrepancy, known as the sim-to-real gap, can have several causes, such as coarsely…

Robotics · Computer Science 2024-09-10 Junpeng Gao , Mike Yan Michelis , Andrew Spielberg , Robert K. Katzschmann

Buildings sector is one of the major consumers of energy in the United States. The buildings HVAC (Heating, Ventilation, and Air Conditioning) systems, whose functionality is to maintain thermal comfort and indoor air quality (IAQ), account…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Chi Zhang , Sanmukh R. Kuppannagari , Rajgopal Kannan , Viktor K. Prasanna

Obtaining dynamic models of continuum soft robots is central to the analysis and control of soft robots, and researchers have devoted much attention to the challenge of proposing both data-driven and first-principle solutions. Both avenues…

Robotics · Computer Science 2025-02-21 Ricardo Valadas , Maximilian Stölzle , Jingyue Liu , Cosimo Della Santina

Offline reinforcement learning, which learns solely from datasets without environmental interaction, has gained attention. This approach, similar to traditional online deep reinforcement learning, is particularly promising for robot control…

Robotics · Computer Science 2025-07-21 Shingo Ayabe , Takuto Otomo , Hiroshi Kera , Kazuhiko Kawamoto

Flexible robots may overcome some of the industry's major challenges, such as enabling intrinsically safe human-robot collaboration and achieving a higher payload-to-mass ratio. However, controlling flexible robots is complicated due to…

Humanoid robots that can autonomously operate in diverse environments have the potential to help address labour shortages in factories, assist elderly at homes, and colonize new planets. While classical controllers for humanoid robots have…

Robotics · Computer Science 2023-12-15 Ilija Radosavovic , Tete Xiao , Bike Zhang , Trevor Darrell , Jitendra Malik , Koushil Sreenath

Dexterous manipulation with anthropomorphic robot hands remains a challenging problem in robotics because of the high-dimensional state and action spaces and complex contacts. Nevertheless, skillful closed-loop manipulation is required to…

Robotics · Computer Science 2022-12-06 Malte Mosbach , Kara Moraw , Sven Behnke

This study tackles the representative yet challenging contact-rich peg-in-hole task of robotic assembly, using a soft wrist that can operate more safely and tolerate lower-frequency control signals than a rigid one. Previous studies often…

Robotics · Computer Science 2024-05-01 Hai Nguyen , Tadashi Kozuno , Cristian C. Beltran-Hernandez , Masashi Hamaya

One of the major challenges in Deep Reinforcement Learning for control is the need for extensive training to learn the policy. Motivated by this, we present the design of the Control-Tutored Deep Q-Networks (CT-DQN) algorithm, a Deep…

Machine Learning · Computer Science 2022-12-05 Francesco De Lellis , Marco Coraggio , Giovanni Russo , Mirco Musolesi , Mario di Bernardo

The Reinforcement Learning (RL) paradigm has been an essential tool for automating robotic tasks. Despite the advances in RL, it is still not widely adopted in the industry due to the need for an expensive large amount of robot interaction…

The superiority of Multi-Robot Systems (MRS) in various complex environments is unquestionable. However, in complex situations such as search and rescue, environmental monitoring, and automated production, robots are often required to work…

Robotics · Computer Science 2024-08-22 Bin Wu , C Steve Suh

Reinforcement learning (RL) is a promising approach for optimizing HVAC control. RL offers a framework for improving system performance, reducing energy consumption, and enhancing cost efficiency. We benchmark two popular classical and deep…

Machine Learning · Computer Science 2023-08-11 Marshall Wang , John Willes , Thomas Jiralerspong , Matin Moezzi

There is an increased demand for task automation in robots. Contact-rich tasks, wherein multiple contact transitions occur in a series of operations, are extensively being studied to realize high accuracy. In this study, we propose a…

Robotics · Computer Science 2020-02-28 Masahide Oikawa , Kyo Kutsuzawa , Sho Sakaino , Toshiaki Tsuji

Amphibious legged robots inspired by salamanders are promising in applications in complex amphibious environments. However, despite the significant success of training controllers that achieve diverse locomotion behaviors in conventional…

Robotics · Computer Science 2026-03-18 Mengze Tian , Qiyuan Fu , Chuanfang Ning , Javier Jia Jie Pey , Auke Ijspeert

In the context of surgery, robots can provide substantial assistance by performing small, repetitive tasks such as suturing, needle exchange, and tissue retraction, thereby enabling surgeons to concentrate on more complex aspects of the…

Machine Learning · Computer Science 2023-09-06 Amritpal Singh , Wenqi Shi , May D Wang

Reinforcement Learning algorithms have recently been proposed to learn time-sequential control policies in the field of autonomous driving. Direct applications of Reinforcement Learning algorithms with discrete action space will yield…

Machine Learning · Computer Science 2019-12-03 Pin Wang , Hanhan Li , Ching-Yao Chan

Current control algorithms for aerial robots struggle with robustness in dynamic environments and adverse conditions. Model-based reinforcement learning (RL) has shown strong potential in handling these challenges while remaining…

Robotics · Computer Science 2025-11-25 Eashan Vytla , Bhavanishankar Kalavakolanu , Andrew Perrault , Matthew McCrink