English
Related papers

Related papers: Sim-to-Real Transfer of Robotic Assembly with Visu…

200 papers

Robotic insertion tasks are characterized by contact and friction mechanics, making them challenging for conventional feedback control methods due to unmodeled physical effects. Reinforcement learning (RL) is a promising approach for…

Machine Learning · Computer Science 2020-05-26 Gerrit Schoettler , Ashvin Nair , Juan Aparicio Ojea , Sergey Levine , Eugen Solowjow

Despite the substantial progress in deep learning, its adoption in industrial robotics projects remains limited, primarily due to challenges in data acquisition and labeling. Previous sim2real approaches using domain randomization require…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Kaixin Bai , Lei Zhang , Zhaopeng Chen , Fang Wan , Jianwei Zhang

Robotic assembly is a longstanding challenge, requiring contact-rich interaction and high precision and accuracy. Many applications also require adaptivity to diverse parts, poses, and environments, as well as low cycle times. In other…

Learning robot tasks or controllers using deep reinforcement learning has been proven effective in simulations. Learning in simulation has several advantages. For example, one can fully control the simulated environment, including halting…

Machine Learning · Computer Science 2018-09-18 Jeroen van Baar , Alan Sullivan , Radu Cordorel , Devesh Jha , Diego Romeres , Daniel Nikovski

Deep reinforcement learning (DRL) has shown remarkable success in simulation domains, yet its application in designing robot controllers remains limited, due to its single-task orientation and insufficient adaptability to environmental…

Robotics · Computer Science 2024-09-20 Yu Tang Liu , Nilaksh Singh , Aamir Ahmad

As learning-based approaches progress towards automating robot controllers design, transferring learned policies to new domains with different dynamics (e.g. sim-to-real transfer) still demands manual effort. This paper introduces SimGAN, a…

Robotics · Computer Science 2021-06-01 Yifeng Jiang , Tingnan Zhang , Daniel Ho , Yunfei Bai , C. Karen Liu , Sergey Levine , Jie Tan

Employing machine learning models in the real world requires collecting large amounts of data, which is both time consuming and costly to collect. A common approach to circumvent this is to leverage existing, similar data-sets with large…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Michael Lomnitz , Zigfried Hampel-Arias , Nina Lopatina , Felipe A. Mejia

We propose an approach for semantic imitation, which uses demonstrations from a source domain, e.g. human videos, to accelerate reinforcement learning (RL) in a different target domain, e.g. a robotic manipulator in a simulated kitchen.…

Machine Learning · Computer Science 2022-12-15 Karl Pertsch , Ruta Desai , Vikash Kumar , Franziska Meier , Joseph J. Lim , Dhruv Batra , Akshara Rai

Reinforcement learning (RL) control approach with application into power electronics systems has become an emerging topic whilst the sim-to-real issue remains a challenging problem as very few results can be referred to in the literature.…

Systems and Control · Electrical Eng. & Systems 2021-10-22 Chenggang Cui , Tianxiao Yang , Yuxuan Dai , Chuanlin Zhang

Robots which make use of soft or compliant inter- actions often leverage tendon-driven actuation which enables actuators to be placed more flexibly, and compliance to be maintained. However, controlling complex tendon systems is…

Robotics · Computer Science 2026-03-05 Valentin Yuryev , Josie Hughes

This innovative practice category paper presents an innovative framework for teaching Reinforcement Learning (RL) at the undergraduate level. Recognizing the challenges posed by the complex theoretical foundations of the subject and the…

Computers and Society · Computer Science 2025-09-30 Muhammad Ahmed Atif , Mohammad Shahid Shaikh

Autonomous driving is complex, requiring sophisticated 3D scene understanding, localization, mapping, and control. Rather than explicitly modelling and fusing each of these components, we instead consider an end-to-end approach via…

Machine Learning · Computer Science 2022-10-27 John So , Amber Xie , Sunggoo Jung , Jeffrey Edlund , Rohan Thakker , Ali Agha-mohammadi , Pieter Abbeel , Stephen James

For the task with complicated manipulation in unstructured environments, traditional hand-coded methods are ineffective, while reinforcement learning can provide more general and useful policy. Although the reinforcement learning is able to…

Robotics · Computer Science 2025-12-03 Nan Lin , Linrui Zhang , Yuxuan Chen , Zhenrui Chen , Yujun Zhu , Ruoxi Chen , Peichen Wu , Xiaoping Chen

Robotic learning in simulation environments provides a faster, more scalable, and safer training methodology than learning directly with physical robots. Also, synthesizing images in a simulation environment for collecting large-scale image…

Robotics · Computer Science 2017-09-21 Tadanobu Inoue , Subhajit Chaudhury , Giovanni De Magistris , Sakyasingha Dasgupta

Simulation is essential to reinforcement learning (RL) before implementation in the real world, especially for safety-critical applications like robot manipulation. Conventionally, RL agents are sensitive to the discrepancies between the…

Robotics · Computer Science 2023-08-08 Ram Dershan , Amir M. Soufi Enayati , Zengjie Zhang , Dean Richert , Homayoun Najjaran

Deep reinforcement learning (DRL) is a promising method to learn control policies for robots only from demonstration and experience. To cover the whole dynamic behaviour of the robot, DRL training is an active exploration process typically…

In robotic vision, a de-facto paradigm is to learn in simulated environments and then transfer to real-world applications, which poses an essential challenge in bridging the sim-to-real domain gap. While mainstream works tackle this problem…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Xingyu Liu , Chenyangguang Zhang , Gu Wang , Ruida Zhang , Xiangyang Ji

Current methods for image-to-image translation produce compelling results, however, the applied transformation is difficult to control, since existing mechanisms are often limited and non-intuitive. We propose ParGAN, a generalization of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Diego Martin Arroyo , Alessio Tonioni , Federico Tombari

The drive for efficiency and safety in construction has boosted the role of robotics and automation. However, complex tasks like welding and pipe insertion pose challenges due to their need for precise adaptive force control, which…

Robotics · Computer Science 2025-01-28 Hengxu You , Yang Ye , Tianyu Zhou , Jing Du

Learning contact-rich manipulation skills is essential. Such skills require the robots to interact with the environment with feasible manipulation trajectories and suitable compliance control parameters to enable safe and stable contact.…

Robotics · Computer Science 2023-10-17 Xiang Zhang , Changhao Wang , Lingfeng Sun , Zheng Wu , Xinghao Zhu , Masayoshi Tomizuka