English
Related papers

Related papers: Closed-Loop Sim-to-Real Reinforcement Learning for…

200 papers

In sim-to-real Reinforcement Learning (RL), a policy is trained in a simulated environment and then deployed on the physical system. The main challenge of sim-to-real RL is to overcome the reality gap - the discrepancies between the real…

Robotics · Computer Science 2023-06-13 Nghia Vuong , Quang-Cuong Pham

Object insertion under tight tolerances ($< \hspace{-.02in} 1mm$) is an important but challenging assembly task as even small errors can result in undesirable contacts. Recent efforts focused on Reinforcement Learning (RL), which often…

For the shape control of deformable free-form surfaces, simulation plays a crucial role in establishing the mapping between the actuation parameters and the deformed shapes. The differentiation of this forward kinematic mapping is usually…

Robotics · Computer Science 2024-05-16 Yingjun Tian , Guoxin Fang , Renbo Su , Weiming Wang , Simeon Gill , Andrew Weightman , Charlie C. L. Wang

We have seen much recent progress in rigid object manipulation, but interaction with deformable objects has notably lagged behind. Due to the large configuration space of deformable objects, solutions using traditional modelling approaches…

Robotics · Computer Science 2018-10-09 Jan Matas , Stephen James , Andrew J. Davison

This paper presents a correspondence-free, function-based sim-to-real learning method for controlling deformable freeform surfaces. Unlike traditional sim-to-real transfer methods that strongly rely on marker points with full…

Precise shape control of Deformable Linear Objects (DLOs) is crucial in robotic applications such as industrial and medical fields. However, existing methods face challenges in handling complex large deformation tasks, especially those…

Robotics · Computer Science 2026-02-26 Zhaowei Liang , Song Wang , Zhao Jin , Shirui Wu , Dan Wu

Most successes in robotic manipulation have been restricted to single-arm robots, which limits the range of solvable tasks to pick-and-place, insertion, and objects rearrangement. In contrast, dual and multi arm robot platforms unlock a…

Robotics · Computer Science 2022-03-17 Satoshi Kataoka , Seyed Kamyar Seyed Ghasemipour , Daniel Freeman , Igor Mordatch

Learning generalizable robot manipulation policies, especially for complex multi-fingered humanoids, remains a significant challenge. Existing approaches primarily rely on extensive data collection and imitation learning, which are…

Robotics · Computer Science 2025-09-03 Toru Lin , Kartik Sachdev , Linxi Fan , Jitendra Malik , Yuke Zhu

Most successes in robotic manipulation have been restricted to single-arm gripper robots, whose low dexterity limits the range of solvable tasks to pick-and-place, inser-tion, and object rearrangement. More complex tasks such as assembly…

This paper proposes a new control framework for manipulating soft objects. A Deep Reinforcement Learning (DRL) approach is used to make the shape of a deformable object reach a set of desired points by controlling a robotic arm which…

Autonomous manipulation of granular media, such as sand, is crucial for applications in construction, excavation, and additive manufacturing. However, shaping granular materials presents unique challenges due to their high-dimensional…

Robotics · Computer Science 2025-09-10 Benedikt Kreis , Malte Mosbach , Anny Ripke , Muhammad Ehsan Ullah , Sven Behnke , Maren Bennewitz

Non-prehensile manipulation is challenging due to complex contact interactions between objects, the environment, and robots. Model-based approaches can efficiently generate complex trajectories of robots and objects under contact…

Robotics · Computer Science 2025-08-07 Yuki Shirai , Kei Ota , Devesh K. Jha , Diego Romeres

Object pushing presents a key non-prehensile manipulation problem that is illustrative of more complex robotic manipulation tasks. While deep reinforcement learning (RL) methods have demonstrated impressive learning capabilities using…

Robotics · Computer Science 2023-07-27 Max Yang , Yijiong Lin , Alex Church , John Lloyd , Dandan Zhang , David A. W. Barton , Nathan F. Lepora

Learning-based methods, particularly Reinforcement Learning (RL), hold great promise for streamlining deployment, enhancing performance, and achieving generalization in the control of autonomous multirotor aerial vehicles. Deep RL has been…

Robotics · Computer Science 2024-04-10 Jonas Eschmann , Dario Albani , Giuseppe Loianno

Using Reinforcement Learning (RL) in simulation to construct policies useful in real life is challenging. This is often attributed to the sequential decision making aspect: inaccuracies in simulation accumulate over multiple steps, hence…

Machine Learning · Computer Science 2017-06-09 Rika Antonova , Silvia Cruciani

Robotic manipulation of cloth is a challenging task due to the high dimensionality of the configuration space and the complexity of dynamics affected by various material properties. The effect of complex dynamics is even more pronounced in…

Robotics · Computer Science 2023-02-09 Julius Hietala , David Blanco-Mulero , Gokhan Alcan , Ville Kyrki

Closed-loop control remains an open challenge in soft robotics. The nonlinear responses of soft actuators under dynamic loading conditions limit the use of analytic models for soft robot control. Traditional methods of controlling soft…

In many practical control applications, the performance level of a closed-loop system degrades over time due to the change of plant characteristics. Thus, there is a strong need for redesigning a controller without going through the system…

Systems and Control · Electrical Eng. & Systems 2023-12-01 Mei Minami , Yuka Masumoto , Yoshihiro Okawa , Tomotake Sasaki , Yutaka Hori

Human-like dexterous hands with multiple fingers offer human-level manipulation capabilities, but training control policies that can directly deploy on real hardware remains difficult due to contact-rich physics and imperfect actuation. We…

Robotics · Computer Science 2026-01-12 Zhe Zhao , Haoyu Dong , Zhengmao He , Yang Li , Xinyu Yi , Zhibin Li

Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired…

Robotics · Computer Science 2025-08-12 Jiyue Tao , Yunsong Zhang , Sunil Kumar Rajendran , Feitian Zhang
‹ Prev 1 2 3 10 Next ›