English
Related papers

Related papers: ArtLLM: Generating Articulated Assets via 3D LLM

200 papers

We present LL3M, a multi-agent system that leverages pretrained large language models (LLMs) to generate 3D assets by writing interpretable Python code in Blender. We break away from the typical generative approach that learns from a…

Graphics · Computer Science 2025-08-12 Sining Lu , Guan Chen , Nam Anh Dinh , Itai Lang , Ari Holtzman , Rana Hanocka

Articulated 3D objects play a vital role in realistic simulation and embodied robotics, yet manually constructing such assets remains costly and difficult to scale. In this paper, we present UniArt, a diffusion-based framework that directly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Bu Jin , Weize Li , Songen Gu , Yupeng Zheng , Yuhang Zheng , Zhengyi Zhou , Yao Yao

The emergence of generative artificial intelligence (GenAI) and large language models (LLMs) has revolutionized the landscape of digital content creation in different modalities. However, its potential use in Physical AI for engineering…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Melvin Wong , Yueming Lyu , Thiago Rios , Stefan Menzel , Yew-Soon Ong

Articulated 3D objects are critical for embodied AI, robotics, and interactive scene understanding, yet creating simulation-ready assets remains labor-intensive and requires expert modeling of part hierarchies and motion structures. We…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yumeng He , Ying Jiang , Jiayin Lu , Yin Yang , Chenfanfu Jiang

Articulated object manipulation remains a critical challenge in robotics due to the complex kinematic constraints and the limited physical reasoning of existing methods. In this work, we introduce ArtGS, a novel framework that extends 3D…

Robotics · Computer Science 2025-07-04 Qiaojun Yu , Xibin Yuan , Yu jiang , Junting Chen , Dongzhe Zheng , Ce Hao , Yang You , Yixing Chen , Yao Mu , Liu Liu , Cewu Lu

We address the challenge of creating 3D assets for household articulated objects from a single image. Prior work on articulated object creation either requires multi-view multi-state input, or only allows coarse control over the generation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jiayi Liu , Denys Iliash , Angel X. Chang , Manolis Savva , Ali Mahdavi-Amiri

Building high-fidelity digital twins of articulated objects from visual data remains a central challenge. Existing approaches depend on multi-view captures of the object in discrete, static states, which severely constrains their real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Lijun Guo , Haoyu Zhao , Xingyue Zhao , Rong Fu , Linghao Zhuang , Siteng Huang , Zhongyu Li , Hua Zou

Articulated objects, as prevalent entities in human life, their 3D representations play crucial roles across various applications. However, achieving both high-fidelity textured surface reconstruction and dynamic generation for articulated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Di Wu , Liu Liu , Zhou Linli , Anran Huang , Liangtu Song , Qiaojun Yu , Qi Wu , Cewu Lu

This work explores expanding the capabilities of large language models (LLMs) pretrained on text to generate 3D meshes within a unified model. This offers key advantages of (1) leveraging spatial knowledge already embedded in LLMs, derived…

Machine Learning · Computer Science 2024-11-15 Zhengyi Wang , Jonathan Lorraine , Yikai Wang , Hang Su , Jun Zhu , Sanja Fidler , Xiaohui Zeng

3D modeling is shifting from static visual representations toward physical, articulated assets that can be directly used in simulation and interaction. However, most existing 3D generation methods overlook key physical and articulation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ziang Cao , Fangzhou Hong , Zhaoxi Chen , Liang Pan , Ziwei Liu

This paper presents a novel framework for modeling and conditional generation of 3D articulated objects. Troubled by flexibility-quality tradeoffs, existing methods are often limited to using predefined structures or retrieving shapes from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Jiayi Su , Youhe Feng , Zheng Li , Jinhua Song , Yangfan He , Botao Ren , Botian Xu

With the explosive growth of 3D content creation, there is an increasing demand for automatically converting static 3D models into articulation-ready versions that support realistic animation. Traditional approaches rely heavily on manual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Chaoyue Song , Jianfeng Zhang , Xiu Li , Fan Yang , Yiwen Chen , Zhongcong Xu , Jun Hao Liew , Xiaoyang Guo , Fayao Liu , Jiashi Feng , Guosheng Lin

We present ArtMesh, a mesh-native method for reconstructing articulated objects explicitly as connected triangle meshes with per-part rigid motion from multi-view images in start and end states. Existing 3D Gaussian Splatting pipelines for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Sylvia Yuan , Dan Wang , Ravi Ramamoorthi , Xinrui Cui

We build rearticulable models for arbitrary everyday man-made objects containing an arbitrary number of parts that are connected together in arbitrary ways via 1 degree-of-freedom joints. Given point cloud videos of such everyday objects,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Shaowei Liu , Saurabh Gupta , Shenlong Wang

Access to high-quality and diverse 3D articulated digital human assets is crucial in various applications, ranging from virtual reality to social platforms. Generative approaches, such as 3D generative adversarial networks (GANs), are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yinghao Xu , Wang Yifan , Alexander W. Bergman , Menglei Chai , Bolei Zhou , Gordon Wetzstein

This paper presents DreamLLM, a learning framework that first achieves versatile Multimodal Large Language Models (MLLMs) empowered with frequently overlooked synergy between multimodal comprehension and creation. DreamLLM operates on two…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Runpei Dong , Chunrui Han , Yuang Peng , Zekun Qi , Zheng Ge , Jinrong Yang , Liang Zhao , Jianjian Sun , Hongyu Zhou , Haoran Wei , Xiangwen Kong , Xiangyu Zhang , Kaisheng Ma , Li Yi

We present Real2Code, a novel approach to reconstructing articulated objects via code generation. Given visual observations of an object, we first reconstruct its part geometry using an image segmentation model and a shape completion model.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Zhao Mandi , Yijia Weng , Dominik Bauer , Shuran Song

Large Language Models(LLMs) have revolutionized text generation and multimodal perception,but their capabilities in 3D content generation remain underexplored. Existing methods compromise by producing either low-resolution meshes or coarse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Junming Huang , Chi Wang , Letian Li , Guangkai Xu , Donglin Huang , Hao Chen , Qiang Dai , Weiwei Xu

Articulated objects like cabinets and doors are widespread in daily life. However, directly manipulating 3D articulated objects is challenging because they have diverse geometrical shapes, semantic categories, and kinetic constraints. Prior…

Robotics · Computer Science 2024-03-04 Qiaojun Yu , Junbo Wang , Wenhai Liu , Ce Hao , Liu Liu , Lin Shao , Weiming Wang , Cewu Lu

Manipulating unseen articulated objects through visual feedback is a critical but challenging task for real robots. Existing learning-based solutions mainly focus on visual affordance learning or other pre-trained visual models to guide…

Robotics · Computer Science 2024-04-29 Pengwei Xie , Rui Chen , Siang Chen , Yuzhe Qin , Fanbo Xiang , Tianyu Sun , Jing Xu , Guijin Wang , Hao Su