English
Related papers

Related papers: Interact3D: Compositional 3D Generation of Interac…

200 papers

Generating 3D models has traditionally been a complex task requiring specialized expertise. While recent advances in generative AI have sought to automate this process, existing methods produce non-editable representation, such as meshes or…

Graphics · Computer Science 2026-01-21 Fadlullah Raji , Stefano Petrangeli , Matheus Gadelha , Yu Shen , Uttaran Bhattacharya , Gang Wu

Generative latent-variable models are emerging as promising tools in robotics and reinforcement learning. Yet, even though tasks in these domains typically involve distinct objects, most state-of-the-art generative models do not explicitly…

Machine Learning · Computer Science 2020-11-24 Martin Engelcke , Adam R. Kosiorek , Oiwi Parker Jones , Ingmar Posner

3D Gaussian Splatting (3DGS) has become a state-of-the-art framework for real-time, high-fidelity novel view synthesis. However, its substantial storage requirements and inherently unstructured representation pose challenges for deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yuqin Lu , Yang Zhou , Yihua Dai , Guiqing Li , Shengfeng He

Articulated 3D objects play a vital role in realistic simulation and embodied robotics, yet manually constructing such assets remains costly and difficult to scale. In this paper, we present UniArt, a diffusion-based framework that directly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Bu Jin , Weize Li , Songen Gu , Yupeng Zheng , Yuhang Zheng , Zhengyi Zhou , Yao Yao

This paper propose a interactive 3D modeling method and corresponding system based on single or multiple uncalibrated images. The main feature of this method is that, according to the modeling habits of ordinary people, the 3D model of the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhi He , Rui Wang , Wei Hua , Yuchi Huo

Separable 3D reconstruction of multiple objects from multi-view RGB images -- resulting in two different 3D shapes for the two objects with a clear separation between them -- remains a sparsely researched problem. It is challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Suhas Gopal , Rishabh Dabral , Vladislav Golyanik , Christian Theobalt

Reconstructing 3D geometry and appearance from a sparse set of fixed cameras is a foundational task with broad applications, yet it remains fundamentally constrained by the limited viewpoints. We show that this bound can be broken by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Ryosuke Hirai , Kohei Yamashita , Antoine Guédon , Ryo Kawahara , Vincent Lepetit , Ko Nishino

Compositional 3D scene generation from a single view requires the simultaneous recovery of scene layout and 3D assets. Existing approaches mainly fall into two categories: feed-forward generation methods and per-instance generation methods.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Ze-Xin Yin , Liu Liu , Xinjie Wang , Wei Sui , Zhizhong Su , Jian Yang , Jin Xie

This paper presents a novel generative approach that outputs 3D indoor environments solely from a textual description of the scene. Current methods often treat scene synthesis as a mere layout prediction task, leading to rooms with…

Machine Learning · Computer Science 2025-02-12 Yao Wei , Matteo Toso , Pietro Morerio , Michael Ying Yang , Alessio Del Bue

While existing image-guided composition methods may help insert a foreground object onto a user-specified region of a background image, achieving natural blending inside the region with the rest of the image unchanged, we observe that these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Dong Liang , Jinyuan Jia , Yuhao Liu , Rynson W. H. Lau

Unified multimodal models that couple visual understanding with image generation have advanced rapidly, yet most systems still focus on visual grounding-aligning language with image regions-while their generative counterpart,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xuanke Shi , Boxuan Li , Xiaoyang Han , Zhongang Cai , Lei Yang , Quan Wang , Dahua Lin

3D human interaction generation has emerged as a key research area, focusing on producing dynamic and contextually relevant interactions between humans and various interactive entities. Recent rapid advancements in 3D model representation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Siyuan Fan , Wenke Huang , Xiantao Cai , Bo Du

Active 3D reconstruction enables an agent to autonomously select viewpoints to efficiently obtain accurate and complete scene geometry, rather than passively reconstructing scenes from pre-collected images. However, existing active…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Tianling Xu , Shengzhe Gan , Leslie Gu , Yuelei Li , Fangneng Zhan , Hanspeter Pfister

Recent advances in 3D-native generative models have accelerated asset creation for games, film, and design. However, most methods still rely primarily on image or text conditioning and lack fine-grained, cross-modal controls, which limits…

Interactive 3D simulated objects are crucial in AR/VR, animations, and robotics, driving immersive experiences and advanced automation. However, creating these articulated objects requires extensive human effort and expertise, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Long Le , Jason Xie , William Liang , Hung-Ju Wang , Yue Yang , Yecheng Jason Ma , Kyle Vedder , Arjun Krishna , Dinesh Jayaraman , Eric Eaton

3D generation methods have shown visually compelling results powered by diffusion image priors. However, they often fail to produce realistic geometric details, resulting in overly smooth surfaces or geometric details inaccurately baked in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ruihan Gao , Kangle Deng , Gengshan Yang , Wenzhen Yuan , Jun-Yan Zhu

Recent advances in 3D generation have transitioned from multi-view 2D rendering approaches to 3D-native latent diffusion frameworks that exploit geometric priors in ground truth data. Despite progress, three key limitations persist: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shaocong Dong , Lihe Ding , Xiao Chen , Yaokun Li , Yuxin Wang , Yucheng Wang , Qi Wang , Jaehyeok Kim , Chenjian Gao , Zhanpeng Huang , Zibin Wang , Tianfan Xue , Dan Xu

In the pursuit of efficient automated content creation, procedural generation, leveraging modifiable parameters and rule-based systems, emerges as a promising approach. Nonetheless, it could be a demanding endeavor, given its intricate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Chunyi Sun , Junlin Han , Weijian Deng , Xinlong Wang , Zishan Qin , Stephen Gould

3D grasp synthesis generates grasping poses given an input object. Existing works tackle the problem by learning a direct mapping from objects to the distributions of grasping poses. However, because the physical contact is sensitive to…

Robotics · Computer Science 2023-05-09 Haoming Li , Xinzhuo Lin , Yang Zhou , Xiang Li , Yuchi Huo , Jiming Chen , Qi Ye

We introduce X-Ray, a novel 3D sequential representation inspired by the penetrability of x-ray scans. X-Ray transforms a 3D object into a series of surface frames at different layers, making it suitable for generating 3D models from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Tao Hu , Wenhang Ge , Yuyang Zhao , Gim Hee Lee