English
Related papers

Related papers: Twisting Lids Off with Two Hands

200 papers

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Robotic dexterous manipulation is a challenging problem due to high degrees of freedom (DoFs) and complex contacts of multi-fingered robotic hands. Many existing deep reinforcement learning (DRL) based methods aim at improving sample…

Robotics · Computer Science 2026-02-26 Qingtao Liu , Zhengnan Sun , Yu Cui , Haoming Li , Gaofeng Li , Lin Shao , Jiming Chen , Qi Ye

Robotic knot-tying represents a fundamental challenge in robotics due to the complex interactions between deformable objects and strict topological constraints. We present TWISTED-RL, a framework that improves upon the previous…

Robotics · Computer Science 2026-02-17 Guy Freund , Tom Jurgenson , Matan Sudry , Erez Karpas

We present a low-cost legged mobile manipulation system that solves long-horizon real-world tasks, trained by reinforcement learning purely in simulation. This system is made possible by 1) a hierarchical design of a high-level policy for…

Robotics · Computer Science 2025-01-31 Haichao Zhang , Haonan Yu , Le Zhao , Andrew Choi , Qinxun Bai , Break Yang , Wei Xu

Opening heavy, self closing doors, especially those that require pulling remains a long standing challenge in robotics. Humans naturally employ both arms in a dexterous manner, rotating the handle, widening the gap, holding the door,…

Robotics · Computer Science 2026-05-18 Shangqun Yu , Matthew En , Daniel Wu , Sangjun Park , Ziyi Zhou , Seyed Fakoorian , Donghyun Kim

Multi-fingered robotic hands have potential to enable robots to perform sophisticated manipulation tasks. However, teaching a robot to grasp objects with an anthropomorphic hand is an arduous problem due to the high dimensionality of state…

Robotics · Computer Science 2024-06-11 Federico Ceola , Elisa Maiettini , Lorenzo Rosasco , Lorenzo Natale

Robot assistants for older adults and people with disabilities need to interact with their users in collaborative tasks. The core component of these systems is an interaction manager whose job is to observe and assess the task, and infer…

Dexterous in-hand manipulation remains a foundational challenge in robotics, with progress often constrained by the prevailing paradigm of imitating the human hand. This anthropomorphic approach creates two critical barriers: 1) it limits…

Robotics · Computer Science 2025-09-26 Sun Zhaole , Xiaofeng Mao , Jihong Zhu , Yuanlong Zhang , Robert B. Fisher

Object handover is a common form of interaction that is widely present in collaborative tasks. However, achieving it efficiently remains a challenge. We address the problem of ensuring resilient robotic actions that can adapt to complex…

Robotics · Computer Science 2026-04-30 Omar Faris , Sławomir Tadeja , Fulvio Forni

This paper addresses the challenge of occluded robot grasping, i.e. grasping in situations where the desired grasp poses are kinematically infeasible due to environmental constraints such as surface collisions. Traditional robot…

Robotics · Computer Science 2025-02-17 Jun Yamada , Alexander L. Mitchell , Jack Collins , Ingmar Posner

Automation holds the potential to assist surgeons in robotic interventions, shifting their mental work load from visuomotor control to high level decision making. Reinforcement learning has shown promising results in learning complex…

Robotic manipulation of slender objects is challenging, especially when the induced deformations are large and nonlinear. Traditionally, learning-based control approaches, such as imitation learning, have been used to address deformable…

Robotics · Computer Science 2024-02-21 Andrew Choi , Dezhong Tong , Demetri Terzopoulos , Jungseock Joo , M. Khalid Jawed

Tool use is an important milestone in the evolution of intelligence. In this paper, we investigate different modes of tool use that emerge in a reaching and dragging task. In this task, a jointed arm with a gripper must grab a tool (T, I,…

Robotics · Computer Science 2020-12-10 Khuong Nguyen , Yoonsuck Choe

Autonomous learning of dexterous, long-horizon robotic skills has been a longstanding pursuit of embodied AI. Recent advances in robotic reinforcement learning (RL) have demonstrated remarkable performance and robustness in real-world…

Reinforcement learning (RL) has gained traction for its success in solving complex tasks for robotic applications. However, its deployment on physical robots remains challenging due to safety risks and the comparatively high costs of…

Robotics · Computer Science 2025-02-24 Jefferson Silveira , Joshua A. Marshall , Sidney N. Givigi

Many real-world manipulation tasks consist of a series of subtasks that are significantly different from one another. Such long-horizon, complex tasks highlight the potential of dexterous hands, which possess adaptability and versatility,…

Robotics · Computer Science 2023-10-17 Yuanpei Chen , Chen Wang , Li Fei-Fei , C. Karen Liu

Deep imitation learning is promising for robot manipulation because it only requires demonstration samples. In this study, deep imitation learning is applied to tasks that require force feedback. However, existing demonstration methods have…

Robotics · Computer Science 2024-02-27 Heecheol Kim , Yoshiyuki Ohmura , Akihiko Nagakubo , Yasuo Kuniyoshi

Robotic systems driven by artificial muscles present unique challenges due to the nonlinear dynamics of actuators and the complex designs of mechanical structures. Traditional model-based controllers often struggle to achieve desired…

Robotics · Computer Science 2025-08-12 Jiyue Tao , Yunsong Zhang , Sunil Kumar Rajendran , Feitian Zhang

Human-robot cooperation is essential in environments such as warehouses and retail stores, where workers frequently handle deformable objects like paper, bags, and fabrics. Coordinating robotic actions with human assistance remains…

Robotics · Computer Science 2025-11-06 Rewida Ali , Cristian C. Beltran-Hernandez , Weiwei Wan , Kensuke Harada

Artificial touch would seem well-suited for Reinforcement Learning (RL), since both paradigms rely on interaction with an environment. Here we propose a new environment and set of tasks to encourage development of tactile reinforcement…

Robotics · Computer Science 2020-08-07 Alex Church , John Lloyd , Raia Hadsell , Nathan F. Lepora