English
Related papers

Related papers: URDF-Anything+: Autoregressive Articulated 3D Mode…

200 papers

Building articulated objects is a key challenge in computer vision. Existing methods often fail to effectively integrate information across different object states, limiting the accuracy of part-mesh reconstruction and part dynamics…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yu Liu , Baoxiong Jia , Ruijie Lu , Junfeng Ni , Song-Chun Zhu , Siyuan Huang

Manipulating unseen articulated objects through visual feedback is a critical but challenging task for real robots. Existing learning-based solutions mainly focus on visual affordance learning or other pre-trained visual models to guide…

Robotics · Computer Science 2024-04-29 Pengwei Xie , Rui Chen , Siang Chen , Yuzhe Qin , Fanbo Xiang , Tianyu Sun , Jing Xu , Guijin Wang , Hao Su

We address the problem of building digital twins of unknown articulated objects from two RGBD scans of the object at different articulation states. We decompose the problem into two stages, each addressing distinct aspects. Our method first…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Yijia Weng , Bowen Wen , Jonathan Tremblay , Valts Blukis , Dieter Fox , Leonidas Guibas , Stan Birchfield

Robot description models are essential for simulation and control, yet their creation often requires significant manual effort. To streamline this modeling process, we introduce AutoURDF, an unsupervised approach for constructing…

Robotics · Computer Science 2025-05-15 Jiong Lin , Lechen Zhang , Kwansoo Lee , Jialong Ning , Judah Goldfeder , Hod Lipson

Being able to reproduce physical phenomena ranging from light interaction to contact mechanics, simulators are becoming increasingly useful in more and more application domains where real-world interaction or labeled data are difficult to…

Robotics · Computer Science 2022-09-13 Eric Heiden , Ziang Liu , Vibhav Vineet , Erwin Coumans , Gaurav S. Sukhatme

Articulated objects pose diverse manipulation challenges for robots. Since their internal structures are not directly observable, robots must adaptively explore and refine actions to generate successful manipulation trajectories. While…

Robotics · Computer Science 2025-07-25 Xiaojie Zhang , Yuanfei Wang , Ruihai Wu , Kunqi Xu , Yu Li , Liuyu Xiang , Hao Dong , Zhaofeng He

Articulated objects are common in the real world, yet modeling their structure and motion remains a challenging task for 3D reconstruction methods. In this work, we introduce Part$^{2}$GS, a novel framework for modeling articulated digital…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Tianjiao Yu , Vedant Shah , Muntasir Wahed , Ying Shen , Kiet A. Nguyen , Ismini Lourentzou

Articulated 3D objects play a vital role in realistic simulation and embodied robotics, yet manually constructing such assets remains costly and difficult to scale. In this paper, we present UniArt, a diffusion-based framework that directly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Bu Jin , Weize Li , Songen Gu , Yupeng Zheng , Yuhang Zheng , Zhengyi Zhou , Yao Yao

Articulated objects and their representations pose a difficult problem for robots. These objects require not only representations of geometry and texture, but also of the various connections and joint parameters that make up each…

Robotics · Computer Science 2024-09-17 Stanley Lewis , Tom Gao , Odest Chadwicke Jenkins

Building high-fidelity digital twins of articulated objects from visual data remains a central challenge. Existing approaches depend on multi-view captures of the object in discrete, static states, which severely constrains their real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Lijun Guo , Haoyu Zhao , Xingyue Zhao , Rong Fu , Linghao Zhuang , Siteng Huang , Zhongyu Li , Hua Zou

Simulation is a central tool for scalable robot learning, but its effectiveness depends on the quality of object assets. While modern 3D datasets provide rich geometric and kinematic representations, they typically lack the physical…

Robotics · Computer Science 2026-05-20 Anh-Quan Pham

3D scene graphs have empowered robots with semantic understanding for navigation and planning. However, current functional scene graphs primarily focus on static element detection, lacking the actionable kinematic information required for…

Articulated object generation has seen increasing advancements, yet existing models often lack the ability to be conditioned on text prompts. To address the significant gap between textual descriptions and 3D articulated object…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Hao Sun , Lei Fan , Donglin Di , Shaohui Liu

Reconstructing articulated objects into high-fidelity digital twins is crucial for applications such as robotic manipulation and interactive simulation. Recent self-supervised methods using differentiable rendering frameworks like 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Xuelu Li , Zhaonan Wang , Xiaogang Wang , Lei Wu , Manyi Li , Changhe Tu

Reconstructing articulated objects is essential for building digital twins of interactive environments. However, prior methods typically decouple geometry and motion by first reconstructing object shape in distinct states and then…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Licheng Shen , Saining Zhang , Honghan Li , Peilin Yang , Zihao Huang , Zongzheng Zhang , Hao Zhao

Object functionality is often expressed through part articulation -- as when the two rigid parts of a scissor pivot against each other to perform the cutting function. Such articulations are often similar across objects within the same…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Li Yi , Haibin Huang , Difan Liu , Evangelos Kalogerakis , Hao Su , Leonidas Guibas

Building digital twins of articulated objects from monocular video presents an essential challenge in computer vision, which requires simultaneous reconstruction of object geometry, part segmentation, and articulation parameters from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yu Liu , Baoxiong Jia , Ruijie Lu , Chuyue Gan , Huayu Chen , Junfeng Ni , Song-Chun Zhu , Siyuan Huang

Neural reconstruction models for autonomous driving simulation have made significant strides in recent years, with dynamic models becoming increasingly prevalent. However, these models are typically limited to handling in-domain objects…

Accurate 3D shape representation is essential in engineering applications such as design, optimization, and simulation. In practice, engineering workflows require structured, part-based representations, as objects are inherently designed as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Nicolas Talabot , Olivier Clerc , Arda Cinar Demirtas , Alexis Goujon , Hieu Le , Doruk Oner , Pascal Fua

3D objects (artefacts) are made to fulfill functions. Designing an object often starts with defining a list of functionalities that it should provide, also known as functional requirements. Today, the design of 3D object models is still a…

Artificial Intelligence · Computer Science 2018-10-18 Mihai Andries , Atabak Dehban , José Santos-Victor