English
Related papers

Related papers: SceneWiz3D: Towards Text-guided 3D Scene Compositi…

200 papers

Recent advances in diffusion models have demonstrated exceptional capabilities in image and video generation, further improving the effectiveness of 4D synthesis. Existing 4D generation methods can generate high-quality 4D objects or scenes…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Bohan Zeng , Ling Yang , Siyu Li , Jiaming Liu , Zixiang Zhang , Juanxi Tian , Kaixin Zhu , Yongzhen Guo , Fu-Yun Wang , Minkai Xu , Stefano Ermon , Wentao Zhang

We present SceneSuggest: an interactive 3D scene design system providing context-driven suggestions for 3D model retrieval and placement. Using a point-and-click metaphor we specify regions in a scene in which to automatically place and…

Graphics · Computer Science 2017-03-02 Manolis Savva , Angel X. Chang , Maneesh Agrawala

We introduce SceneTransporter, an end-to-end framework for structured 3D scene generation from a single image. While existing methods generate part-level 3D objects, they often fail to organize these parts into distinct instances in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Ling Wang , Hao-Xiang Guo , Xinzhou Wang , Fuchun Sun , Kai Sun , Pengkun Liu , Hang Xiao , Zhong Wang , Guangyuan Fu , Eric Li , Yang Liu , Yikai Wang

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jaeseok Lee , Jaekoo Lee

City scene generation has gained significant attention in autonomous driving, smart city development, and traffic simulation. It helps enhance infrastructure planning and monitoring solutions. Existing methods have employed a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Jie Deng , Wenhao Chai , Junsheng Huang , Zhonghan Zhao , Qixuan Huang , Mingyan Gao , Jianshu Guo , Shengyu Hao , Wenhao Hu , Jenq-Neng Hwang , Xi Li , Gaoang Wang

Generating flexible-view 3D scenes, including 360{\deg} rotation and zooming, from single images is challenging due to a lack of 3D data. To this end, we introduce FlexWorld, a novel framework consisting of two key components: (1) a strong…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Luxi Chen , Zihan Zhou , Min Zhao , Yikai Wang , Ge Zhang , Wenhao Huang , Hao Sun , Ji-Rong Wen , Chongxuan Li

Recent developments in 2D visual generation have been remarkably successful. However, 3D and 4D generation remain challenging in real-world applications due to the lack of large-scale 4D data and effective model design. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yuyang Zhao , Chung-Ching Lin , Kevin Lin , Zhiwen Yan , Linjie Li , Zhengyuan Yang , Jianfeng Wang , Gim Hee Lee , Lijuan Wang

The ability to synthesize long-term human motion sequences in real-world scenes can facilitate numerous applications. Previous approaches for scene-aware motion synthesis are constrained by pre-defined target objects or positions and thus…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jingbo Wang , Yu Rong , Jingyuan Liu , Sijie Yan , Dahua Lin , Bo Dai

We introduce a recipe for generating immersive 3D worlds from a single image by framing the task as an in-context learning problem for 2D inpainting models. This approach requires minimal training and uses existing generative models. Our…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Katja Schwarz , Denys Rozumnyi , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder

Recent methods in text-to-3D leverage powerful pretrained diffusion models to optimize NeRF. Notably, these methods are able to produce high-quality 3D scenes without training on 3D data. Due to the open-ended nature of the task, most…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yuze He , Yushi Bai , Matthieu Lin , Wang Zhao , Yubin Hu , Jenny Sheng , Ran Yi , Juanzi Li , Yong-Jin Liu

Single-view 3D reconstruction is currently approached from two dominant perspectives: reconstruction of scenes with limited diversity using 3D data supervision or reconstruction of diverse singular objects using large image priors. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Andreea Ardelean , Mert Özer , Bernhard Egger

With the onset of diffusion-based generative models and their ability to generate text-conditioned images, content generation has received a massive invigoration. Recently, these models have been shown to provide useful guidance for the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Alexander Vilesov , Pradyumna Chari , Achuta Kadambi

Existing text-based 3D generation methods generate attractive results but lack detailed geometry control. Sketches, known for their conciseness and expressiveness, have contributed to intuitive 3D modeling but are confined to producing…

Graphics · Computer Science 2024-05-15 Feng-Lin Liu , Hongbo Fu , Yu-Kun Lai , Lin Gao

State-of-the-art novel view synthesis methods achieve impressive results for multi-view captures of static 3D scenes. However, the reconstructed scenes still lack "liveliness," a key component for creating engaging 3D experiences. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Thomas Wimmer , Michael Oechsle , Michael Niemeyer , Federico Tombari

Text-to-3D synthesis has recently emerged as a new approach to sampling 3D models by adopting pretrained text-to-image models as guiding visual priors. An intriguing but underexplored problem with existing text-to-3D methods is that 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Uy Dieu Tran , Minh Luu , Phong Ha Nguyen , Khoi Nguyen , Binh-Son Hua

Generating realistic 3D scenes from text is crucial for immersive applications like VR, AR, and gaming. While text-driven approaches promise efficiency, existing methods suffer from limited 3D-text data and inconsistent multi-view…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xin Zhang , Shen Chen , Jiale Zhou , Lei Li

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

Text-to-3D generation has shown great promise in generating novel 3D content based on given text prompts. However, existing generative methods mostly focus on geometric or visual plausibility while ignoring precise physics perception for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Qingshan Xu , Jiao Liu , Melvin Wong , Caishun Chen , Yew-Soon Ong

Synthesizing realistic and diverse indoor 3D scene layouts in a controllable fashion opens up applications in simulated navigation and virtual reality. As concise and robust representations of a scene, scene graphs have proven to be…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Pietro Bonazzi , Mengqi Wang , Diego Martin Arroyo , Fabian Manhardt , Nico Messikomer , Federico Tombari , Davide Scaramuzza

We present DiffuScene for indoor 3D scene synthesis based on a novel scene configuration denoising diffusion model. It generates 3D instance properties stored in an unordered object set and retrieves the most similar geometry for each…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Jiapeng Tang , Yinyu Nie , Lev Markhasin , Angela Dai , Justus Thies , Matthias Nießner