English
Related papers

Related papers: ArtGen: Conditional Generative Modeling of Articul…

200 papers

We introduce a framework for joint grounded scene graph - image generation, a challenging task involving high-dimensional, multi-modal structured data. To effectively model this complex joint distribution, we adopt a factorized approach:…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Bicheng Xu , Qi Yan , Renjie Liao , Lele Wang , Leonid Sigal

Articulated 3D object generation is fundamental for creating realistic, functional, and interactable virtual assets which are not simply static. We introduce MeshArt, a hierarchical transformer-based approach to generate articulated 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Daoyi Gao , Yawar Siddiqui , Lei Li , Angela Dai

We introduce ART, Articulated Reconstruction Transformer -- a category-agnostic, feed-forward model that reconstructs complete 3D articulated objects from only sparse, multi-state RGB images. Previous methods for articulated object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Zizhang Li , Cheng Zhang , Zhengqin Li , Henry Howard-Jenkins , Zhaoyang Lv , Chen Geng , Jiajun Wu , Richard Newcombe , Jakob Engel , Zhao Dong

Animatable 3D assets, defined as geometry equipped with an articulated skeleton and skinning weights, are fundamental to interactive graphics, embodied agents, and animation production. While recent 3D generative models can synthesize…

Simulation is essential for autonomous driving, yet current frameworks often model vehicles as rigid assets and fail to capture part-level articulation. With perception algorithms increasingly leveraging dynamics such as wheel steering or…

Artificial Intelligence · Computer Science 2026-04-08 Shiyao Qian , Yuan Ren , Dongfeng Bai , Bingbing Liu

Articulated object manipulation remains a critical challenge in robotics due to the complex kinematic constraints and the limited physical reasoning of existing methods. In this work, we introduce ArtGS, a novel framework that extends 3D…

Robotics · Computer Science 2025-07-04 Qiaojun Yu , Xibin Yuan , Yu jiang , Junting Chen , Dongzhe Zheng , Ce Hao , Yang You , Yixing Chen , Yao Mu , Liu Liu , Cewu Lu

We present ArtMesh, a mesh-native method for reconstructing articulated objects explicitly as connected triangle meshes with per-part rigid motion from multi-view images in start and end states. Existing 3D Gaussian Splatting pipelines for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Sylvia Yuan , Dan Wang , Ravi Ramamoorthi , Xinrui Cui

The creation of manufacturable and editable 3D shapes through Computer-Aided Design (CAD) remains a highly manual and time-consuming task, hampered by the complex topology of boundary representations of 3D solids and unintuitive design…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Md Ferdous Alam , Faez Ahmed

Recent advances in large reconstruction and generative models have significantly improved scene reconstruction and novel view generation. However, due to compute limitations, each inference with these large models is confined to a small…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangjin Zhai , Zhichao Ye , Jialin Liu , Weijian Xie , Jiaqi Hu , Zhen Peng , Hua Xue , Danpeng Chen , Xiaomeng Wang , Lei Yang , Nan Wang , Haomin Liu , Guofeng Zhang

Generative models can be used to synthesize 3D objects of high quality and diversity. However, there is typically no control over the properties of the generated object.This paper proposes a novel generative adversarial network (GAN) setup…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Larissa T. Triess , Andre Bühler , David Peter , Fabian B. Flohr , J. Marius Zöllner

Generating realistic 3D point clouds is a fundamental problem in computer vision with applications in remote sensing, robotics, and digital object modeling. Existing generative approaches primarily capture geometry, and when semantics are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Gunner Stone , Sushmita Sarker , Alireza Tavakkoli

We introduce Infinigen-Articulated, a toolkit for generating realistic, procedurally generated articulated assets for robotics simulation. We include procedural generators for 18 common articulated object categories along with high-level…

We propose Neural 3D Articulation Prior (NAP), the first 3D deep generative model to synthesize 3D articulated object models. Despite the extensive research on generating 3D objects, compositions, or scenes, there remains a lack of focus on…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jiahui Lei , Congyue Deng , Bokui Shen , Leonidas Guibas , Kostas Daniilidis

We present a novel alignment-before-generation approach to tackle the challenging task of generating general 3D shapes based on 2D images or texts. Directly learning a conditional generative model from images or texts to 3D shapes is prone…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zibo Zhao , Wen Liu , Xin Chen , Xianfang Zeng , Rui Wang , Pei Cheng , Bin Fu , Tao Chen , Gang Yu , Shenghua Gao

Conditional waveform synthesis models learn a distribution of audio waveforms given conditioning such as text, mel-spectrograms, or MIDI. These systems employ deep generative models that model the waveform via either sequential…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-07 Max Morrison , Rithesh Kumar , Kundan Kumar , Prem Seetharaman , Aaron Courville , Yoshua Bengio

This work introduces a novel system for the generation of images that contain multiple classes of objects. Recent work in Generative Adversarial Networks have produced high quality images, but many focus on generating images of a single…

Machine Learning · Computer Science 2019-11-11 Elijah D. Bolluyt , Cristina Comaniciu

Constrained generative modeling is fundamental to applications such as robotic control and autonomous driving, where models must respect physical laws and safety-critical constraints. In real-world settings, these constraints rarely take…

Machine Learning · Computer Science 2026-03-10 Xiaoxuan Liang , Saeid Naderiparizi , Yunpeng Liu , Berend Zwartsenberg , Frank Wood

Recent advances in 3D scene generation produce visually appealing output, but current representations hinder artists' workflows that require modifiable 3D textured mesh scenes for visual effects and game development. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Tobias Sautter , Jan-Niklas Dihlmann , Hendrik P. A. Lensch

The ability to generate diverse 3D articulated head avatars is vital to a plethora of applications, including augmented reality, cinematography, and education. Recent work on text-guided 3D object generation has shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Alexander W. Bergman , Wang Yifan , Gordon Wetzstein

Conditional image generation has paved the way for several breakthroughs in image editing, generating stock photos and 3-D object generation. This continues to be a significant area of interest with the rise of new state-of-the-art methods…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Vedant Singh , Surgan Jandial , Ayush Chopra , Siddharth Ramesh , Balaji Krishnamurthy , Vineeth N. Balasubramanian