English
Related papers

Related papers: Learning Part Motion of Articulated Objects Using …

200 papers

We propose a novel unsupervised method to learn the pose and part-segmentation of articulated objects with rigid parts. Given two observations of an object in different articulation states, our method learns the geometry and appearance of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Jianning Deng , Kartic Subr , Hakan Bilen

Compositional representations are thought to enable humans to generalize across combinatorially vast state spaces. Models with learnable object slots, which encode information about objects in separate latent codes, have shown promise for…

Machine Learning · Computer Science 2024-10-08 Tankred Saanum , Luca M. Schulze Buschoff , Peter Dayan , Eric Schulz

In order for robots to operate effectively in homes and workplaces, they must be able to manipulate the articulated objects common within environments built for and by humans. Previous work learns kinematic models that prescribe this…

Robotics · Computer Science 2016-07-04 Zhengyang Wu , Mohit Bansal , Matthew R. Walter

We address the task of simultaneous part-level reconstruction and motion parameter estimation for articulated objects. Given two sets of multi-view images of an object in two static articulation states, we decouple the movable part from the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jiayi Liu , Ali Mahdavi-Amiri , Manolis Savva

Reconstructing articulated objects is essential for building digital twins of interactive environments. However, prior methods typically decouple geometry and motion by first reconstructing object shape in distinct states and then…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Licheng Shen , Saining Zhang , Honghan Li , Peilin Yang , Zihao Huang , Zongzheng Zhang , Hao Zhao

We present Neural Articulated Radiance Field (NARF), a novel deformable 3D representation for articulated objects learned from images. While recent advances in 3D implicit representation have made it possible to learn models of complex…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Atsuhiro Noguchi , Xiao Sun , Stephen Lin , Tatsuya Harada

Articulated objects are commonly found in daily life. It is essential that robots can exhibit robust perception and manipulation skills for articulated objects in real-world robotic applications. However, existing methods for articulated…

Robotics · Computer Science 2024-10-01 Junbo Wang , Wenhai Liu , Qiaojun Yu , Yang You , Liu Liu , Weiming Wang , Cewu Lu

From dishwashers to cabinets, humans interact with articulated objects every day, and for a robot to assist in common manipulation tasks, it must learn a representation of articulation. Recent deep learning learning methods can provide…

Robotics · Computer Science 2023-09-29 Russell Buchanan , Adrian Röfer , João Moura , Abhinav Valada , Sethu Vijayakumar

We present a novel neural implicit representation for articulated human bodies. Compared to explicit template meshes, neural implicit body representations provide an efficient mechanism for modeling interactions with the environment, which…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Marko Mihajlovic , Shunsuke Saito , Aayush Bansal , Michael Zollhoefer , Siyu Tang

3D articulated objects modeling has long been a challenging problem, since it requires to capture both accurate surface geometries and semantically meaningful and spatially precise structures, parts, and joints. Existing methods heavily…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Xiaowen Qiu , Jincheng Yang , Yian Wang , Zhehuan Chen , Yufei Wang , Tsun-Hsuan Wang , Zhou Xian , Chuang Gan

Neural implicit representation has attracted attention in 3D reconstruction through various success cases. For further applications such as scene understanding or editing, several works have shown progress towards object compositional…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Taekbeom Lee , Youngseok Jang , H. Jin Kim

Active soft bodies can affect their shape through an internal actuation mechanism that induces a deformation. Similar to recent work, this paper utilizes a differentiable, quasi-static, and physics-based simulation layer to optimize for…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Lingchen Yang , Byungsoo Kim , Gaspard Zoss , Baran Gözcü , Markus Gross , Barbara Solenthaler

Representing articulated objects remains a difficult problem within the field of robotics. Objects such as pliers, clamps, or cabinets require representations that capture not only geometry and color information, but also part seperation,…

Robotics · Computer Science 2025-06-17 Stanley Lewis , Vishal Chandra , Tom Gao , Odest Chadwicke Jenkins

We address the challenge of creating 3D assets for household articulated objects from a single image. Prior work on articulated object creation either requires multi-view multi-state input, or only allows coarse control over the generation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jiayi Liu , Denys Iliash , Angel X. Chang , Manolis Savva , Ali Mahdavi-Amiri

Building articulated objects is a key challenge in computer vision. Existing methods often fail to effectively integrate information across different object states, limiting the accuracy of part-mesh reconstruction and part dynamics…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yu Liu , Baoxiong Jia , Ruijie Lu , Junfeng Ni , Song-Chun Zhu , Siyuan Huang

From refrigerators to kitchen drawers, humans interact with articulated objects effortlessly every day while completing household chores. For automating these tasks, service robots must be capable of manipulating arbitrary articulated…

Robotics · Computer Science 2026-01-06 Russell Buchanan , Adrian Röfer , João Moura , Abhinav Valada , Sethu Vijayakumar

Neural implicit surface representations have recently emerged as popular alternative to explicit 3D object encodings, such as polygonal meshes, tabulated points, or voxels. While significant work has improved the geometric fidelity of these…

Graphics · Computer Science 2023-06-27 Yanran Guan , Andrei Chubarau , Ruby Rao , Derek Nowrouzezahrai

We propose an online spatiotemporal articulation model estimation framework that estimates both articulated structure as well as a temporal prediction model solely using passive observations. The resulting model can predict future mo- tions…

Robotics · Computer Science 2016-04-13 Suren Kumar , Vikas Dhiman , Madan Ravi Ganesh , Jason J. Corso

Modeling the dynamics of deformable objects is challenging due to their diverse physical properties and the difficulty of estimating states from limited visual information. We address these challenges with a neural dynamics framework that…

Robotics · Computer Science 2025-11-07 Kaifeng Zhang , Baoyu Li , Kris Hauser , Yunzhu Li

Manipulating unseen articulated objects through visual feedback is a critical but challenging task for real robots. Existing learning-based solutions mainly focus on visual affordance learning or other pre-trained visual models to guide…

Robotics · Computer Science 2024-04-29 Pengwei Xie , Rui Chen , Siang Chen , Yuzhe Qin , Fanbo Xiang , Tianyu Sun , Jing Xu , Guijin Wang , Hao Su