English
Related papers

Related papers: CRAG: Can 3D Generative Models Help 3D Assembly?

200 papers

In this paper, we define and study a new Cloth2Body problem which has a goal of generating 3D human body meshes from a 2D clothing image. Unlike the existing human mesh recovery problem, Cloth2Body needs to address new and emerging…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Lu Dai , Liqian Ma , Shenhan Qian , Hao Liu , Ziwei Liu , Hui Xiong

Data-driven generative modeling has made remarkable progress by leveraging the power of deep neural networks. A reoccurring challenge is how to enable a model to generate a rich variety of samples from the entire target distribution, rather…

Graphics · Computer Science 2019-09-04 Nadav Schor , Oren Katzir , Hao Zhang , Daniel Cohen-Or

Generative AI models have made significant progress in automating the creation of 3D shapes, which has the potential to transform car design. In engineering design and optimization, evaluating engineering metrics is crucial. To make…

Machine Learning · Computer Science 2023-06-13 Binyang Song , Chenyang Yuan , Frank Permenter , Nikos Arechiga , Faez Ahmed

Generating realistic full-body motion interacting with objects is critical for applications in robotics, virtual reality, and human-computer interaction. While existing methods can generate full-body motion within 3D scenes, they often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Kunal Bhosikar , Siddharth Katageri , Vivek Madhavaram , Kai Han , Charu Sharma

Given a single image of a target object, image-to-3D generation aims to reconstruct its texture and geometric shape. Recent methods often utilize intermediate media, such as multi-view images or videos, to bridge the gap between input image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jiacheng Wang , Zhedong Zheng , Wei Xu , Ping Liu

Single-image 3D generation with part-level structure remains challenging: learned priors struggle to cover the long tail of part geometries and maintain multi-view consistency, and existing systems provide limited support for precise,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Peize Li , Zeyu Zhang , Hao Tang

A crucial ability of human intelligence is to build up models of individual 3D objects from partial scene observations. Recent works achieve object-centric generation but without the ability to infer the representation, or achieve 3D scene…

Machine Learning · Computer Science 2021-07-05 Chang Chen , Fei Deng , Sungjin Ahn

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Dario Pavllo , Graham Spinks , Thomas Hofmann , Marie-Francine Moens , Aurelien Lucchi

Inspired by traditional handmade crafts, where a person improvises assemblies based on the available objects, we formally introduce the Craft Assembly Task. It is a robotic assembly task that involves building an accurate representation of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Vitor Hideyo Isume , Takuya Kiyokawa , Natsuki Yamanobe , Yukiyasu Domae , Weiwei Wan , Kensuke Harada

The convergence of generative artificial intelligence and advanced computer vision technologies introduces a groundbreaking approach to transforming textual descriptions into three-dimensional representations. This research proposes a fully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Venkat Kumar R , Deepak Saravanan

It is desirable to enable robots capable of automatic assembly. Structural understanding of object parts plays a crucial role in this task yet remains relatively unexplored. In this paper, we focus on the setting of furniture assembly from…

Robotics · Computer Science 2022-07-07 Rufeng Zhang , Tao Kong , Weihao Wang , Xuan Han , Mingyu You

Triple-based Iterative Retrieval-Augmented Generation (iRAG) mitigates document-level noise for multi-hop question answering. However, existing methods still face limitations: (i) greedy single-path expansion, which propagates early errors…

Computation and Language · Computer Science 2026-01-13 Zili Wei , Xiaocui Yang , Yilin Wang , Zihan Wang , Weidong Bao , Shi Feng , Daling Wang , Yifei Zhang

We propose a method for constructing generative models of 3D objects from a single 3D mesh and improving them through unsupervised low-shot learning from 2D images. Our method produces a 3D morphable model that represents shape and albedo…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Skylar Sutherland , Bernhard Egger , Joshua Tenenbaum

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

Auto-regressive models have achieved impressive results in 2D image generation by modeling joint distributions in grid space. In this paper, we extend auto-regressive models to 3D domains, and seek a stronger ability of 3D shape generation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xuelin Qian , Yu Wang , Simian Luo , Yinda Zhang , Ying Tai , Zhenyu Zhang , Chengjie Wang , Xiangyang Xue , Bo Zhao , Tiejun Huang , Yunsheng Wu , Yanwei Fu

Shape primitive abstraction, which decomposes complex 3D shapes into simple geometric elements, plays a crucial role in human visual cognition and has broad applications in computer vision and graphics. While recent advances in 3D content…

Graphics · Computer Science 2025-05-08 Jingwen Ye , Yuze He , Yanning Zhou , Yiqin Zhu , Kaiwen Xiao , Yong-Jin Liu , Wei Yang , Xiao Han

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Recent breakthroughs in 3D generation have enabled the synthesis of high-fidelity individual assets. However, generating 3D compositional objects from single images--particularly under occlusions--remains challenging. Existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hui Shan , Keyang Luo , Ming Li , Sizhe Zheng , Yanwei Fu , Zhen Chen , Xiangru Huang

Generating animatable human avatars from a single image is essential for various digital human modeling applications. Existing 3D reconstruction methods often struggle to capture fine details in animatable models, while generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Lingteng Qiu , Shenhao Zhu , Qi Zuo , Xiaodong Gu , Yuan Dong , Junfei Zhang , Chao Xu , Zhe Li , Weihao Yuan , Liefeng Bo , Guanying Chen , Zilong Dong

While human cognition inherently retrieves information from diverse and specialized knowledge sources during decision-making processes, current Retrieval-Augmented Generation (RAG) systems typically operate through single-source knowledge…

Machine Learning · Computer Science 2025-03-19 Zhengsheng Guo , Linwei Zheng , Xinyang Chen , Xuefeng Bai , Kehai Chen , Min Zhang