English
Related papers

Related papers: SculptBot: Pre-Trained Models for 3D Deformable Ob…

200 papers

This paper proposes a new control framework for manipulating soft objects. A Deep Reinforcement Learning (DRL) approach is used to make the shape of a deformable object reach a set of desired points by controlling a robotic arm which…

Representing 3D shape in deep learning frameworks in an accurate, efficient and compact manner still remains an open challenge. Most existing work addresses this issue by employing voxel-based representations. While these approaches benefit…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Dominic Jack , Jhony K. Pontes , Sridha Sridharan , Clinton Fookes , Sareh Shirazi , Frederic Maire , Anders Eriksson

Humans are capable of continuously manipulating a wide variety of deformable objects into complex shapes. This is made possible by our intuitive understanding of material properties and mechanics of the object, for reasoning about object…

Robotics · Computer Science 2024-08-06 Uksang Yoo , Adam Hung , Jonathan Francis , Jean Oh , Jeffrey Ichnowski

3D articulated objects are inherently challenging for manipulation due to the varied geometries and intricate functionalities associated with articulated objects.Point-level affordance, which predicts the per-point actionable score and thus…

Robotics · Computer Science 2024-03-08 Suhan Ling , Yian Wang , Shiguang Wu , Yuzheng Zhuang , Tianyi Xu , Yu Li , Chang Liu , Hao Dong

In this paper, we present a novel deep method to reconstruct a point cloud of an object from a single still image. Prior arts in the field struggle to reconstruct an accurate and scalable 3D model due to either the inefficient and expensive…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Anh-Duc Nguyen , Seonghwa Choi , Woojae Kim , Sanghoon Lee

Real-life control tasks involve matters of various substances---rigid or soft bodies, liquid, gas---each with distinct physical behaviors. This poses challenges to traditional rigid-body physics engines. Particle-based simulators have been…

Machine Learning · Computer Science 2019-04-19 Yunzhu Li , Jiajun Wu , Russ Tedrake , Joshua B. Tenenbaum , Antonio Torralba

Effective planning of long-horizon deformable object manipulation requires suitable abstractions at both the spatial and temporal levels. Previous methods typically either focus on short-horizon tasks or make strong assumptions that…

Robotics · Computer Science 2023-06-26 Xingyu Lin , Carl Qi , Yunchu Zhang , Zhiao Huang , Katerina Fragkiadaki , Yunzhu Li , Chuang Gan , David Held

Robot manipulation of rope-like objects is an interesting problem that has some critical applications, such as autonomous robotic suturing. Solving for and controlling rope is difficult due to the complexity of rope physics and the…

Robotics · Computer Science 2022-02-22 Fei Liu , Entong Su , Jingpei Lu , Mingen Li , Michael C. Yip

Soft object manipulation tasks in domestic scenes pose a significant challenge for existing robotic skill learning techniques due to their complex dynamics and variable shape characteristics. Since learning new manipulation skills from…

Robotics · Computer Science 2023-09-06 Junjia Liu , Zhihao Li , Wanyu Lin , Sylvain Calinon , Kay Chen Tan , Fei Chen

Manipulating deformable objects arises in daily life and numerous applications. Despite phenomenal advances in industrial robotics, manipulation of deformable objects remains mostly a manual task. This is because of the high number of…

Robotics · Computer Science 2024-01-31 Burak Aksoy , John Wen

Reliable robotic grasping, especially with deformable objects such as fruits, remains a challenging task due to underactuated contact interactions with a gripper, unknown object dynamics and geometries. In this study, we propose a…

Robotics · Computer Science 2023-07-25 Yunhai Han , Kelin Yu , Rahul Batra , Nathan Boyd , Chaitanya Mehta , Tuo Zhao , Yu She , Seth Hutchinson , Ye Zhao

Robotic grasping of 3D deformable objects (e.g., fruits/vegetables, internal organs, bottles/boxes) is critical for real-world applications such as food processing, robotic surgery, and household automation. However, developing grasp…

Deformable object manipulation tasks have long been regarded as challenging robotic problems. However, until recently very little work has been done on the subject, with most robotic manipulation methods being developed for rigid objects.…

Robotics · Computer Science 2022-08-04 Rita Laezza , Yiannis Karayiannidis

To realize a robust robotic grasping system for unknown objects in an unstructured environment, large amounts of grasp data and 3D model data for the object are required, the sizes of which directly affect the rate of successful grasps. To…

Robotics · Computer Science 2021-02-02 Gang Peng , Zhenyu Ren , Hao Wang , Xinde Li

We present an approach to robustly track the geometry of an object that deforms over time from a set of input point clouds captured from a single viewpoint. The deformations we consider are caused by applying forces to known locations on…

Computer Vision and Pattern Recognition · Computer Science 2015-03-31 Stefanie Wuhrer , Jochen Lang , Motahareh Tekieh , Chang Shu

Studying the manipulation of deformable linear objects has significant practical applications in industry, including car manufacturing, textile production, and electronics automation. However, deformable linear object manipulation poses a…

Robotics · Computer Science 2023-07-20 Kejia Chen , Zhenshan Bing , Fan Wu , Yuan Meng , Andre Kraft , Sami Haddadin , Alois Knoll

Point set registration is a powerful method that enables robots to manipulate deformable objects. By mapping the point cloud of the current object to the pre-trained point cloud, a transformation function can be constructed. The…

Robotics · Computer Science 2018-10-10 Rui Wang , Te Tang , Masayoshi Tomizuka

Dynamic surface reconstruction of objects from point cloud sequences is a challenging field in computer graphics. Existing approaches either require multiple regularization terms or extensive training data which, however, lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Julian Kaltheuner , Alexander Oebel , Hannah Droege , Patrick Stotko , Reinhard Klein

Using visual model-based learning for deformable object manipulation is challenging due to difficulties in learning plannable visual representations along with complex dynamic models. In this work, we propose a new learning framework that…

Machine Learning · Computer Science 2020-03-12 Wilson Yan , Ashwin Vangipuram , Pieter Abbeel , Lerrel Pinto

Grasping with anthropomorphic robotic hands involves much more hand-object interactions compared to parallel-jaw grippers. Modeling hand-object interactions is essential to the study of multi-finger hand dextrous manipulation. This work…

Robotics · Computer Science 2022-11-22 Wei Wei , Daheng Li , Peng Wang , Yiming Li , Wanyi Li , Yongkang Luo , Jun Zhong