English
Related papers

Related papers: Learning Visual Feedback Control for Dynamic Cloth…

200 papers

Deep reinforcement learning (DRL) has been proven to be a powerful paradigm for learning complex control policy autonomously. Numerous recent applications of DRL in robotic grasping have successfully trained DRL robotic agents end-to-end,…

Robotics · Computer Science 2020-07-03 Zhixin Chen , Mengxiang Lin , Zhixin Jia , Shibo Jian

Combined visual and force feedback play an essential role in contact-rich robotic manipulation tasks. Current methods focus on developing the feedback control around a single modality while underrating the synergy of the sensors. Fusing…

Robotics · Computer Science 2022-02-18 Piaopiao Jin , Yinjie Lin , Yanchao Tan , Tiefeng Li , Wei Yang

The complex physical properties of highly deformable materials such as clothes pose significant challenges fanipulation systems. We present a novel visual feedback dictionary-based method for manipulating defoor autonomous robotic mrmable…

Robotics · Computer Science 2019-01-18 Biao Jia , Zhe Hu , Jia Pan , Dinesh Manocha

Simulation-to-reality transfer has emerged as a popular and highly successful method to train robotic control policies for a wide variety of tasks. However, it is often challenging to determine when policies trained in simulation are ready…

Enabling autonomous robots to interact in unstructured environments with dynamic objects requires manipulation capabilities that can deal with clutter, changes, and objects' variability. This paper presents a comparison of different…

Robotics · Computer Science 2019-02-01 Michel Breyer , Fadri Furrer , Tonci Novkovic , Roland Siegwart , Juan Nieto

Dynamic manipulation of flexible objects such as fabric, which is difficult to modelize, is one of the major challenges in robotics. With the development of deep learning, we are beginning to see results in simulations and in some actual…

Robotics · Computer Science 2024-09-25 Kento Kawaharazuka , Akihiro Miki , Masahiro Bando , Kei Okada , Masayuki Inaba

Robotic manipulation of cloth remains challenging for robotics due to the complex dynamics of the cloth, lack of a low-dimensional state representation, and self-occlusions. In contrast to previous model-based approaches that learn a…

Robotics · Computer Science 2022-01-07 Xingyu Lin , Yufei Wang , Zixuan Huang , David Held

Using Reinforcement Learning (RL) in simulation to construct policies useful in real life is challenging. This is often attributed to the sequential decision making aspect: inaccuracies in simulation accumulate over multiple steps, hence…

Machine Learning · Computer Science 2017-06-09 Rika Antonova , Silvia Cruciani

Robotic cloth manipulation is a relevant challenging problem for autonomous robotic systems. Highly deformable objects as textile items can adopt multiple configurations and shapes during their manipulation. Hence, robots should not only…

Robotics · Computer Science 2022-09-21 Adrià Luque , David Parent , Adrià Colomé , Carlos Ocampo-Martinez , Carme Torras

Robotic manipulation of cloth has applications ranging from fabrics manufacturing to handling blankets and laundry. Cloth manipulation is challenging for robots largely due to their high degrees of freedom, complex dynamics, and severe…

Robotics · Computer Science 2022-07-25 Sashank Tirumala , Thomas Weng , Daniel Seita , Oliver Kroemer , Zeynep Temel , David Held

Human-robot cooperation is essential in environments such as warehouses and retail stores, where workers frequently handle deformable objects like paper, bags, and fabrics. Coordinating robotic actions with human assistance remains…

Robotics · Computer Science 2025-11-06 Rewida Ali , Cristian C. Beltran-Hernandez , Weiwei Wan , Kensuke Harada

Sequential pulling policies to flatten and smooth fabrics have applications from surgery to manufacturing to home tasks such as bed making and folding clothes. Due to the complexity of fabric states and dynamics, we apply deep imitation…

The use of multi-camera views simultaneously has been shown to improve the generalization capabilities and performance of visual policies. However, the hardware cost and design constraints in real-world scenarios can potentially make it…

Robotics · Computer Science 2023-12-05 Cihan Acar , Kuluhan Binici , Alp Tekirdağ , Yan Wu

Cloth folding is a complex task due to the inevitable self-occlusions of clothes, their complicated dynamics, and the disparate materials, geometries, and textures that garments can have. In this work, we learn folding actions conditioned…

Robotics · Computer Science 2025-06-17 Oriol Barbany , Adrià Colomé , Carme Torras

An appropriate user interface to collect human demonstration data for deformable object manipulation has been mostly overlooked in the literature. We present an interaction design for demonstrating cloth folding to robots. Users choose pick…

Current end-to-end deep Reinforcement Learning (RL) approaches require jointly learning perception, decision-making and low-level control from very sparse reward signals and high-dimensional inputs, with little capability of incorporating…

Machine Learning · Computer Science 2019-10-10 Vibhavari Dasagi , Robert Lee , Serena Mou , Jake Bruce , Niko Sünderhauf , Jürgen Leitner

Manipulation of deformable objects is a challenging task for a robot. It will be problematic to use a single sensory input to track the behaviour of such objects: vision can be subjected to occlusions, whereas tactile inputs cannot capture…

Robotics · Computer Science 2023-05-01 Leszek Pecyna , Siyuan Dong , Shan Luo

We present a general framework for the garment animation problem through unsupervised deep learning inspired in physically based simulation. Existing trends in the literature already explore this possibility. Nonetheless, these approaches…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Hugo Bertiche , Meysam Madadi , Sergio Escalera

Robotic fabric manipulation has applications in home robotics, textiles, senior care and surgery. Existing fabric manipulation techniques, however, are designed for specific tasks, making it difficult to generalize across different but…

Autonomous fabric manipulation is a longstanding challenge in robotics, but evaluating progress is difficult due to the cost and diversity of robot hardware. Using Reach, a cloud robotics platform that enables low-latency remote execution…