English
Related papers

Related papers: ArtFormer: Controllable Generation of Diverse 3D A…

200 papers

3D generation from natural language offers significant potential to reduce expert manual modeling efforts and enhance accessibility to 3D assets. However, existing methods often yield unstructured meshes and exhibit poor interactivity,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Shuyuan Zhang , Chenhan Jiang , Zuoou Li , Jiankang Deng

We present a novel approach to the generation of static and articulated 3D assets that has a 3D autodecoder at its core. The 3D autodecoder framework embeds properties learned from the target dataset in the latent space, which can then be…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Evangelos Ntavelis , Aliaksandr Siarohin , Kyle Olszewski , Chaoyang Wang , Luc Van Gool , Sergey Tulyakov

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Dario Pavllo , Graham Spinks , Thomas Hofmann , Marie-Francine Moens , Aurelien Lucchi

This thesis presents a framework that integrates state-of-the-art generative AI models for real-time creation of three-dimensional (3D) objects in augmented reality (AR) environments. The primary goal is to convert diverse inputs, such as…

Graphics · Computer Science 2025-02-25 Majid Behravan

We present a novel motion generation approach for robot arms, with high degrees of freedom, in complex settings that can adapt online to obstacles or new via points. Learning from Demonstration facilitates rapid adaptation to new tasks and…

We tackle the problem of text-driven 3D generation from a geometry alignment perspective. Given a set of text prompts, we aim to generate a collection of objects with semantically corresponding parts aligned across them. Recent methods…

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

Articulated 3D objects play a vital role in realistic simulation and embodied robotics, yet manually constructing such assets remains costly and difficult to scale. In this paper, we present UniArt, a diffusion-based framework that directly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Bu Jin , Weize Li , Songen Gu , Yupeng Zheng , Yuhang Zheng , Zhengyi Zhou , Yao Yao

Auto-regressive models have achieved impressive results in 2D image generation by modeling joint distributions in grid space. In this paper, we extend auto-regressive models to 3D domains, and seek a stronger ability of 3D shape generation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xuelin Qian , Yu Wang , Simian Luo , Yinda Zhang , Ying Tai , Zhenyu Zhang , Chengjie Wang , Xiangyang Xue , Bo Zhao , Tiejun Huang , Yunsheng Wu , Yanwei Fu

Diffusion models have emerged as powerful tools for high-quality image generation and editing, but guiding these models to produce specific outputs remains a challenge. Conventional approaches rely on conditioning mechanisms, such as text…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Nithesh Chandher Karthikeyan , Jonas Unger , Gabriel Eilertsen

We introduce MolMiner, a fragment-based, geometry-aware, and order-agnostic autoregressive model for molecular design. MolMiner supports conditional generation of molecules over twelve properties, enabling flexible control across…

Machine Learning · Computer Science 2025-05-27 Raul Ortega-Ochoa , Tejs Vegge , Jes Frellsen

This work concerns a structural topology optimisation problem for 4D printing based on the phase field approach. The concept of 4D printing as a targeted evolution of 3D printed structures can be realised in a two-step process. One first…

Optimization and Control · Mathematics 2023-05-03 Harald Garcke , Kei Fong Lam , Robert Nürnberg , Andrea Signori

In this paper, the problem of automating the pre-grasps generation for novel 3d objects has been discussed. The objects represented as cloud of 3D points are split into parts and organized in a tree structure, where parts are approximated…

Robotics · Computer Science 2019-10-01 IA Sainul , Sankha Deb , AK Deb

Recent years have seen an explosion of work and interest in text-to-3D shape generation. Much of the progress is driven by advances in 3D representations, large-scale pretraining and representation learning for text and image data enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Han-Hung Lee , Manolis Savva , Angel X. Chang

Manipulating articulated objects with robotic arms is challenging due to the complex kinematic structure, which requires precise part segmentation for efficient manipulation. In this work, we introduce a novel superpoint-based perception…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Qiaojun Yu , Ce Hao , Xibin Yuan , Li Zhang , Liu Liu , Yukang Huo , Rohit Agarwal , Cewu Lu

In this paper, we present a framework to represent mock 3D objects and scenes, which are not 3D but appear 3D. In our framework, each mock-3D object is represented using 2D non-conservative vector fields and thickness information that are…

Graphics · Computer Science 2024-01-02 Ergun Akleman , Youyou Wang , Ozgur Gonen

Learning geometry, motion, and appearance priors of object classes is important for the solution of a large variety of computer vision problems. While the majority of approaches has focused on static objects, dynamic objects, especially…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Fangyin Wei , Rohan Chabra , Lingni Ma , Christoph Lassner , Michael Zollhöfer , Szymon Rusinkiewicz , Chris Sweeney , Richard Newcombe , Mira Slavcheva

We present DIPO, a novel framework for the controllable generation of articulated 3D objects from a pair of images: one depicting the object in a resting state and the other in an articulated state. Compared to the single-image approach,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Ruiqi Wu , Xinjie Wang , Liu Liu , Chunle Guo , Jiaxiong Qiu , Chongyi Li , Lichao Huang , Zhizhong Su , Ming-Ming Cheng

We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves representing 3D shapes as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jiangbei Hu , Ben Fei , Baixin Xu , Fei Hou , Weidong Yang , Shengfa Wang , Na Lei , Chen Qian , Ying He

We present LTM3D, a Latent Token space Modeling framework for conditional 3D shape generation that integrates the strengths of diffusion and auto-regressive (AR) models. While diffusion-based methods effectively model continuous latent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Xin Kang , Zihan Zheng , Lei Chu , Yue Gao , Jiahao Li , Hao Pan , Xuejin Chen , Yan Lu