English
Related papers

Related papers: Sim-to-real transfer of active suspension control …

200 papers

This paper proposes a novel approach to controller design for MR-damped vehicle suspension system. This approach is predicated on the premise that the optimal control strategy can be learned through real-world or simulated experiments…

Systems and Control · Electrical Eng. & Systems 2023-09-06 AmirReza BabaAhmadi , Masoud ShariatPanahi , Moosa Ayati

The U.S. Defense Advanced Research Projects Agency (DARPA) Subterranean Challenge requires teams of robots to traverse difficult and diverse underground environments. Traversing small gaps is one of the challenging scenarios that robots…

Robotics · Computer Science 2021-11-03 Brendan Tidd , Akansel Cosgun , Jurgen Leitner , Nicolas Hudson

Reinforcement learning has shown a wide usage in robotics tasks, such as insertion and grasping. However, without a practical sim2real strategy, the policy trained in simulation could fail on the real task. There are also wide researches in…

Robotics · Computer Science 2022-06-07 Yiwen Chen , Xue Li , Sheng Guo , Xian Yao Ng , Marcelo Ang

This paper proposes a simulation-based reinforcement learning algorithm for controlling systems with uncertain and varying system parameters. While simulators are useful for safely learning control policies, the reality gap remains a major…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Junya Ikemoto

Deep reinforcement learning (DRL) has shown remarkable success in simulation domains, yet its application in designing robot controllers remains limited, due to its single-task orientation and insufficient adaptability to environmental…

Robotics · Computer Science 2024-09-20 Yu Tang Liu , Nilaksh Singh , Aamir Ahmad

Quadrotor stabilizing controllers often require careful, model-specific tuning for safe operation. We use reinforcement learning to train policies in simulation that transfer remarkably well to multiple different physical quadrotors. Our…

Robotics · Computer Science 2019-04-17 Artem Molchanov , Tao Chen , Wolfgang Hönig , James A. Preiss , Nora Ayanian , Gaurav S. Sukhatme

Reliable autonomous navigation across the unstructured terrains of distant planetary surfaces is a critical enabler for future space exploration. However, the deployment of learning-based controllers is hindered by the inherent sim-to-real…

Robotics · Computer Science 2025-10-22 Andrej Orsula , Matthieu Geist , Miguel Olivares-Mendez , Carol Martinez

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

Object pushing presents a key non-prehensile manipulation problem that is illustrative of more complex robotic manipulation tasks. While deep reinforcement learning (RL) methods have demonstrated impressive learning capabilities using…

Robotics · Computer Science 2023-07-27 Max Yang , Yijiong Lin , Alex Church , John Lloyd , Dandan Zhang , David A. W. Barton , Nathan F. Lepora

Deep reinforcement learning has proven to be successful for learning tasks in simulated environments, but applying same techniques for robots in real-world domain is more challenging, as they require hours of training. To address this,…

Machine Learning · Computer Science 2020-03-24 Janne Karttunen , Anssi Kanervisto , Ville Kyrki , Ville Hautamäki

While deep learning has had significant successes in computer vision thanks to the abundance of visual data, collecting sufficiently large real-world datasets for robot learning can be costly. To increase the practicality of these…

Robotics · Computer Science 2017-12-20 Fangyi Zhang , Jürgen Leitner , Michael Milford , Peter Corke

Unprecedented agility and dexterous manipulation have been demonstrated with controllers based on deep reinforcement learning (RL), with a significant impact on legged and humanoid robots. Modern tooling and simulation platforms, such as…

Legged robots must achieve both robust locomotion and energy efficiency to be practical in real-world environments. Yet controllers trained in simulation often fail to transfer reliably, and most existing approaches neglect…

Robotics · Computer Science 2025-09-09 Filip Bjelonic , Fabian Tischhauser , Marco Hutter

Deep reinforcement learning (DRL) is a promising method to learn control policies for robots only from demonstration and experience. To cover the whole dynamic behaviour of the robot, DRL training is an active exploration process typically…

Sim-to-real transfer remains a fundamental challenge in robot manipulation due to the entanglement of perception and control in end-to-end learning. We present a decoupled framework that learns each component where it is most reliable:…

Robotics · Computer Science 2025-10-01 Jialei Huang , Zhaoheng Yin , Yingdong Hu , Shuo Wang , Xingyu Lin , Yang Gao

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Legged robots often use separate control policiesthat are highly engineered for traversing difficult terrain suchas stairs, gaps, and steps, where switching between policies isonly possible when the robot is in a region that is commonto…

Robotics · Computer Science 2021-09-30 Brendan Tidd , Nicolas Hudson , Akansel Cosgun , Jurgen Leitner

Reinforcement learning (RL) is widely used in autonomous driving tasks and training RL models typically involves in a multi-step process: pre-training RL models on simulators, uploading the pre-trained model to real-life robots, and…

Machine Learning · Computer Science 2019-10-15 Xinle Liang , Yang Liu , Tianjian Chen , Ming Liu , Qiang Yang

Deep reinforcement learning has emerged as a popular and powerful way to develop locomotion controllers for quadruped robots. Common approaches have largely focused on learning actions directly in joint space, or learning to modify and…

Robotics · Computer Science 2023-03-16 Guillaume Bellegarda , Yiyu Chen , Zhuochen Liu , Quan Nguyen

For the deployment of legged robots in real-world environments, it is essential to develop robust locomotion control methods for challenging terrains that may exhibit unexpected deformability and irregularity. In this paper, we explore the…

Robotics · Computer Science 2025-04-21 Rohan P. Singh , Mitsuharu Morisawa , Mehdi Benallegue , Zhaoming Xie , Fumio Kanehiro