English
Related papers

Related papers: Sim-to-Real Transfer Learning using Robustified Co…

200 papers

Soft robots have gained increased popularity in recent years due to their adaptability and compliance. In this paper, we use a digital twin model of cable-driven soft robots to learn control parameters in simulation. In doing so, we take…

Robotics · Computer Science 2024-04-12 Kasra Arnavaz , Kenny Erleben

Control strategies for robotic needle steering in soft tissues must account for complex interactions between the needle and the tissue to achieve accurate needle tip positioning. Recent findings show faster robotic command rate can improve…

Reinforcement learning encounters many challenges when applied directly in the real world. Sim-to-real transfer is widely used to transfer the knowledge learned from simulation to the real world. Domain randomization -- one of the most…

Machine Learning · Computer Science 2022-03-15 Xiaoyu Chen , Jiachen Hu , Chi Jin , Lihong Li , Liwei Wang

Soft robots have the potential to revolutionize the use of robotic systems with their capability of establishing safe, robust, and adaptable interactions with their environment, but their precise control remains challenging. In contrast,…

Deep reinforcement learning has enabled robots to learn motor skills from environmental interactions with minimal to no prior knowledge. However, existing reinforcement learning algorithms assume an episodic setting, in which the agent…

Machine Learning · Computer Science 2022-05-27 Jigang Kim , J. hyeon Park , Daesol Cho , H. Jin Kim

Operating under real world conditions is challenging due to the possibility of a wide range of failures induced by execution errors and state uncertainty. In relatively benign settings, such failures can be overcome by retrying or executing…

Robotics · Computer Science 2023-03-10 Shivam Vats , Maxim Likhachev , Oliver Kroemer

Training robots with reinforcement learning (RL) typically involves heavy interactions with the environment, and the acquired skills are often sensitive to changes in task environments and robot kinematics. Transfer RL aims to leverage…

Robotics · Computer Science 2023-09-26 Pingcheng Jian , Easop Lee , Zachary Bell , Michael M. Zavlanos , Boyuan Chen

Autonomous systems increasingly rely on machine learning techniques to transform high-dimensional raw inputs into predictions that are then used for decision-making and control. However, it is often easy to maliciously manipulate such…

Machine Learning · Computer Science 2023-02-07 Jinghan Yang , Hunmin Kim , Wenbin Wan , Naira Hovakimyan , Yevgeniy Vorobeychik

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as…

Robotics · Computer Science 2022-04-29 Sunwoo Kim , Maks Sorokin , Jehee Lee , Sehoon Ha

For a robot to learn a good policy, it often requires expensive equipment (such as sophisticated sensors) and a prepared training environment conducive to learning. However, it is seldom possible to perfectly equip robots for economic…

Artificial Intelligence · Computer Science 2019-07-19 Hélène Plisnier , Denis Steckelmacher , Diederik Roijers , Ann Nowé

One of the great promises of robot learning systems is that they will be able to learn from their mistakes and continuously adapt to ever-changing environments. Despite this potential, most of the robot learning systems today are deployed…

Machine Learning · Computer Science 2020-08-03 Ryan Julian , Benjamin Swanson , Gaurav S. Sukhatme , Sergey Levine , Chelsea Finn , Karol Hausman

Integrating learning-based techniques, especially reinforcement learning, into robotics is promising for solving complex problems in unstructured environments. However, most existing approaches are trained in well-tuned simulators and…

Robotics · Computer Science 2024-11-07 Puze Liu , Haitham Bou-Ammar , Jan Peters , Davide Tateo

Learning robotic control policies in the real world gives rise to challenges in data efficiency, safety, and controlling the initial condition of the system. On the other hand, simulations are a useful alternative as they provide an…

Developing robot controllers in a simulated environment is advantageous but transferring the controllers to the target environment presents challenges, often referred to as the "sim-to-real gap". We present a method for continuous…

Robotics · Computer Science 2022-11-24 Sirui Chen , Keenon Werling , Albert Wu , C. Karen Liu

Offline reinforcement learning, which learns solely from datasets without environmental interaction, has gained attention. This approach, similar to traditional online deep reinforcement learning, is particularly promising for robot control…

Robotics · Computer Science 2025-07-21 Shingo Ayabe , Takuto Otomo , Hiroshi Kera , Kazuhiko Kawamoto

Learning-based adaptive control methods hold the premise of enabling autonomous agents to reduce the effect of process variations with minimal human intervention. However, its application to autonomous underwater vehicles (AUVs) has so far…

The deployment of robot controllers is hindered by modeling discrepancies due to necessary simplifications for computational tractability or inaccuracies in data-generating simulators. Such discrepancies typically require ad-hoc tuning to…

Robotics · Computer Science 2025-06-02 Lokesh Krishna , Sheng Cheng , Junheng Li , Naira Hovakimyan , Quan Nguyen

Recent breakthroughs both in reinforcement learning and trajectory optimization have made significant advances towards real world robotic system deployment. Reinforcement learning (RL) can be applied to many problems without needing any…

Robotics · Computer Science 2019-10-23 Guillaume Bellegarda , Katie Byl

Bounding is one of the important gaits in quadrupedal locomotion for negotiating obstacles. The authors proposed an effective approach that can learn robust bounding gaits more efficiently despite its large variation in dynamic body…

Robotics · Computer Science 2023-10-31 Zhicheng Wang , Anqiao Li , Yixiao Zheng , Anhuan Xie , Zhibin Li , Jun Wu , Qiuguo Zhu

Reinforcement learning (RL) is recognized as lacking generalization and robustness under environmental perturbations, which excessively restricts its application for real-world robotics. Prior work claimed that adding regularization to the…

Machine Learning · Computer Science 2023-12-06 Yuan Zhang , Jianhong Wang , Joschka Boedecker