English
Related papers

Related papers: Sim-to-real transfer of active suspension control …

200 papers

Nowadays, autonomous vehicles are gaining traction due to their numerous potential applications in resolving a variety of other real-world challenges. However, developing autonomous vehicles need huge amount of training and testing before…

Robotics · Computer Science 2023-06-21 Jumman Hossain

Simulation-to-simulation and simulation-to-real world transfer of neural network models have been a difficult problem. To close the reality gap, prior methods to simulation-to-real world transfer focused on domain adaptation, decoupling…

Machine Learning · Computer Science 2020-01-06 Sahika Genc , Sunil Mallya , Sravan Bodapati , Tao Sun , Yunzhe Tao

Current research directions in deep reinforcement learning include bridging the simulation-reality gap, improving sample efficiency of experiences in distributed multi-agent reinforcement learning, together with the development of robust…

Machine Learning · Computer Science 2020-08-19 Wenshuai Zhao , Jorge Peña Queralta , Li Qingqing , Tomi Westerlund

The physical design of a robot and the policy that controls its motion are inherently coupled, and should be determined according to the task and environment. In an increasing number of applications, data-driven and learning-based…

Robotics · Computer Science 2018-09-18 Charles Schaff , David Yunis , Ayan Chakrabarti , Matthew R. Walter

High-fidelity physics simulation is essential for scalable robotic learning, but the sim-to-real gap persists, especially for tasks involving complex, dynamic, and discontinuous interactions like physical contacts. Explicit system…

Robotics · Computer Science 2026-01-21 Changwei Jing , Jai Krishna Bandi , Jianglong Ye , Yan Duan , Pieter Abbeel , Xiaolong Wang , Sha Yi

We present a deep learning method for composite and task-driven motion control for physically simulated characters. In contrast to existing data-driven approaches using reinforcement learning that imitate full-body motions, we learn…

Graphics · Computer Science 2023-05-08 Pei Xu , Xiumin Shang , Victor Zordan , Ioannis Karamouzas

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

Existing Advanced Driver Assistance Systems primarily focus on the vehicle directly ahead, often overlooking potential risks from following vehicles. This oversight can lead to ineffective handling of high risk situations, such as high…

Robotics · Computer Science 2025-02-25 Dianwei Chen , Yaobang Gong , Xianfeng Yang

Deep reinforcement learning (RL) has made it possible to solve complex robotics problems using neural networks as function approximators. However, the policies trained on stationary environments suffer in terms of generalization when…

Robotics · Computer Science 2021-11-09 Aditya M. Deshpande , Ali A. Minai , Manish Kumar

While deep reinforcement learning (RL) methods have achieved unprecedented successes in a range of challenging problems, their applicability has been mainly limited to simulation or game domains due to the high sample complexity of the…

Artificial Intelligence · Computer Science 2017-09-26 Siyi Li , Tianbo Liu , Chi Zhang , Dit-Yan Yeung , Shaojie Shen

For legged robots to match the athletic capabilities of humans and animals, they must not only produce robust periodic walking and running, but also seamlessly switch between nominal locomotion gaits and more specialized transient…

Robotics · Computer Science 2022-07-19 Fangzhou Yu , Ryan Batke , Jeremy Dao , Jonathan Hurst , Kevin Green , Alan Fern

Drifting is a complicated task for autonomous vehicle control. Most traditional methods in this area are based on motion equations derived by the understanding of vehicle dynamics, which is difficult to be modeled precisely. We propose a…

Robotics · Computer Science 2020-03-10 Peide Cai , Xiaodong Mei , Lei Tai , Yuxiang Sun , Ming Liu

Traditional planning and control methods could fail to find a feasible trajectory for an autonomous vehicle to execute amongst dense traffic on roads. This is because the obstacle-free volume in spacetime is very small in these scenarios…

Robotics · Computer Science 2022-12-29 Dhruv Mauria Saxena , Sangjae Bae , Alireza Nakhaei , Kikuo Fujimura , Maxim Likhachev

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. With the conventional…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Qingrui Zhang , Wei Pan , Vasso Reppa

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real…

Robotics · Computer Science 2025-06-06 Haoyu Wang , Ruyi Zhou , Liang Ding , Tie Liu , Zhelin Zhang , Peng Xu , Haibo Gao , Zongquan Deng

We present a low-cost legged mobile manipulation system that solves long-horizon real-world tasks, trained by reinforcement learning purely in simulation. This system is made possible by 1) a hierarchical design of a high-level policy for…

Robotics · Computer Science 2025-01-31 Haichao Zhang , Haonan Yu , Le Zhao , Andrew Choi , Qinxun Bai , Break Yang , Wei Xu

Developing robust walking controllers for bipedal robots is a challenging endeavor. Traditional model-based locomotion controllers require simplifying assumptions and careful modelling; any small errors can result in unstable control. To…

Robotics · Computer Science 2021-03-29 Zhongyu Li , Xuxin Cheng , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

For the task with complicated manipulation in unstructured environments, traditional hand-coded methods are ineffective, while reinforcement learning can provide more general and useful policy. Although the reinforcement learning is able to…

Robotics · Computer Science 2025-12-03 Nan Lin , Linrui Zhang , Yuxuan Chen , Zhenrui Chen , Yujun Zhu , Ruoxi Chen , Peichen Wu , Xiaoping Chen

This paper presents a sensor-level mapless collision avoidance algorithm for use in mobile robots that map raw sensor data to linear and angular velocities and navigate in an unknown environment without a map. An efficient training strategy…

Artificial Intelligence · Computer Science 2021-02-24 Hanlin Niu , Ze Ji , Farshad Arvin , Barry Lennox , Hujun Yin , Joaquin Carrasco

This paper investigates how the performance of visual navigation policies trained in simulation compares to policies trained with real-world data. Performance degradation of simulator-trained policies is often significant when they are…