English
Related papers

Related papers: Solving Rubik's Cube with a Robot Hand

200 papers

Simulation-based reinforcement learning (RL) has significantly advanced humanoid locomotion tasks, yet direct real-world RL from scratch or adapting from pretrained policies remains rare, limiting the full potential of humanoid robots.…

Robotics · Computer Science 2025-08-27 Kaizhe Hu , Haochen Shi , Yao He , Weizhuo Wang , C. Karen Liu , Shuran Song

Many real-world control problems involve both discrete decision variables - such as the choice of control modes, gear switching or digital outputs - as well as continuous decision variables - such as velocity setpoints, control gains or…

This paper describes a deep reinforcement learning (DRL) approach that won Phase 1 of the Real Robot Challenge (RRC) 2021, and then extends this method to a more difficult manipulation task. The RRC consisted of using a TriFinger robot to…

Robotic grasping refers to making a robotic system pick an object by applying forces and torques on its surface. Many recent studies use data-driven approaches to address grasping, but the sparse reward nature of this task made the learning…

Robotics · Computer Science 2023-10-10 Johann Huber , François Hélénon , Hippolyte Watrelot , Faiz Ben Amar , Stéphane Doncieux

Deep Reinforcement Learning (DRL) has been successfully used to solve different challenges, e.g. complex board and computer games, recently. However, solving real-world robotics tasks with DRL seems to be a more difficult challenge. The…

Robotics · Computer Science 2020-10-08 Péter Almási , Róbert Moni , Bálint Gyires-Tóth

Learning visuomotor policies in simulation is much safer and cheaper than in the real world. However, due to discrepancies between the simulated and real data, simulator-trained policies often fail when transferred to real robots. One…

Robotics · Computer Science 2023-07-31 Ricardo Garcia , Robin Strudel , Shizhe Chen , Etienne Arlaud , Ivan Laptev , Cordelia Schmid

A hyper-redundant robotic arm is a manipulator with many degrees of freedom, capable of executing tasks in cluttered environments where robotic arms with fewer degrees of freedom are unable to operate. This paper introduces a new method for…

Robotics · Computer Science 2018-03-13 Marios P. Xanthidis , Kostantinos J. Kyriakopoulos , Ioannis Rekleitis

Humanoid robots will be able to assist humans in their daily life, in particular due to their versatile action capabilities. However, while these robots need a certain degree of autonomy to learn and explore, they also should respect…

Human dexterity is an invaluable capability for precise manipulation of objects in complex tasks. The capability of robots to similarly grasp and perform in-hand manipulation of objects is critical for their use in the ever changing human…

Robotics · Computer Science 2024-10-25 Abraham Itzhak Weinberg , Alon Shirizly , Osher Azulay , Avishai Sintov

In the real world, robots with embodiment face various issues such as dynamic continuous changes of the environment and input/output disturbances. The key to solving these issues can be found in daily life; people `do actions associated…

Robotics · Computer Science 2013-07-29 Megumi Fujita , Yuki Goto , Naoyuki Nide , Ken Satoh , Hiroshi Hosobe

How to explore corner cases as efficiently and thoroughly as possible has long been one of the top concerns in the context of deep reinforcement learning (DeepRL) autonomous driving. Training with simulated data is less costly and dangerous…

Robotics · Computer Science 2021-07-27 Haoyi Niu , Jianming Hu , Zheyu Cui , Yi Zhang

This study is aimed at addressing the problem of fault tolerance of quadruped robots to actuator failure, which is critical for robots operating in remote or extreme environments. In particular, an adaptive curriculum reinforcement learning…

Robotics · Computer Science 2024-10-28 Wataru Okamoto , Hiroshi Kera , Kazuhiko Kawamoto

In-hand manipulation is a crucial ability for reorienting and repositioning objects within grasps. The main challenges in this are not only the complexity of the computational models, but also the risks of grasp instability caused by active…

Robotics · Computer Science 2025-07-18 Hayden Webb , Podshara Chanrungmaneekul , Shenli Yuan , Kaiyu Hang

Accurate and efficient simulation of modern robots remains challenging due to their high degrees of freedom and intricate mechanisms. Neural simulators have emerged as a promising alternative to traditional analytical simulators, capable of…

Robotics · Computer Science 2025-08-22 Jie Xu , Eric Heiden , Iretiayo Akinola , Dieter Fox , Miles Macklin , Yashraj Narang

Training a robotic arm to accomplish real-world tasks has been attracting increasing attention in both academia and industry. This work discusses the role of computer vision algorithms in this field. We focus on low-cost arms on which no…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yiming Zuo , Weichao Qiu , Lingxi Xie , Fangwei Zhong , Yizhou Wang , Alan L. Yuille

We address the problem of safely solving complex bimanual robot manipulation tasks with sparse rewards. Such challenging tasks can be decomposed into sub-tasks that are accomplishable by different robots concurrently or sequentially for…

Machine Learning · Computer Science 2021-10-07 Minghao Zhang , Pingcheng Jian , Yi Wu , Huazhe Xu , Xiaolong Wang

Robots are becoming a vital ingredient in society. Some of their daily tasks require dual-arm manipulation skills in the rapidly changing, dynamic and unpredictable real-world environments where they have to operate. Given the expertise of…

Robotics · Computer Science 2019-04-03 Èric Pairet , Paola Ardón , Frank Broz , Michael Mistry , Yvan Petillot

Deep learning has provided new ways of manipulating, processing and analyzing data. It sometimes may achieve results comparable to, or surpassing human expert performance, and has become a source of inspiration in the era of artificial…

Reinforcement learning (RL) has demonstrated great success in the past several years. However, most of the scenarios focus on simulated environments. One of the main challenges of transferring the policy learned in a simulated environment…

Robotics · Computer Science 2021-02-24 Ya-Yen Tsai , Hui Xu , Zihan Ding , Chong Zhang , Edward Johns , Bidan Huang

Soft robots are gaining popularity thanks to their intrinsic safety to contacts and adaptability. However, the potentially infinite number of Degrees of Freedom makes their modeling a daunting task, and in many cases only an approximated…

Robotics · Computer Science 2024-01-26 Gabriele Tiboni , Andrea Protopapa , Tatiana Tommasi , Giuseppe Averta