English
Related papers

Related papers: FreeScene: Mixed Graph Diffusion for 3D Scene Synt…

200 papers

City scene generation has gained significant attention in autonomous driving, smart city development, and traffic simulation. It helps enhance infrastructure planning and monitoring solutions. Existing methods have employed a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Jie Deng , Wenhao Chai , Junsheng Huang , Zhonghan Zhao , Qixuan Huang , Mingyan Gao , Jianshu Guo , Shengyu Hao , Wenhao Hu , Jenq-Neng Hwang , Xi Li , Gaoang Wang

Controllable pathology image synthesis requires reliable regulation of spatial layout, tissue morphology, and semantic detail. However, existing text-guided diffusion models offer only coarse global control and lack the ability to enforce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yuntao Shou , Xiangyong Cao , Qian Zhao , Deyu Meng

World building with 3D scene representations is increasingly important for content creation, simulation, and interactive experiences, yet real workflows are inherently iterative: creators must repeatedly extend an existing scene under user…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Zijian He , Renjie Liu , Yihao Wang , Weizhi Zhong , Huan Yuan , Kun Gai , Guangrun Wang , Guanbin Li

Recent multimodal face generation models address the spatial control limitations of text-to-image diffusion models by augmenting text-based conditioning with spatial priors such as segmentation masks, sketches, or edge maps. This multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Bharath Krishnamurthy , Ajita Rattani

We address the task of indoor scene generation by generating a sequence of objects, along with their locations and orientations conditioned on a room layout. Large-scale indoor scene datasets allow us to extract patterns from user-designed…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Xinpeng Wang , Chandan Yeshwanth , Matthias Nießner

Recent breakthroughs in text-guided image generation have led to remarkable progress in the field of 3D synthesis from text. By optimizing neural radiance fields (NeRF) directly from text, recent methods are able to produce remarkable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Dana Cohen-Bar , Elad Richardson , Gal Metzer , Raja Giryes , Daniel Cohen-Or

Text-to-image models are showcasing the impressive ability to create high-quality and diverse generative images. Nevertheless, the transition from freehand sketches to complex scene images remains challenging using diffusion models. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tianyu Zhang , Xiaoxuan Xie , Xusheng Du , Haoran Xie

Collecting multi-view driving scenario videos to enhance the performance of 3D visual perception tasks presents significant challenges and incurs substantial costs, making generative models for realistic data an appealing alternative. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Junpeng Jiang , Gangyi Hong , Miao Zhang , Hengtong Hu , Kun Zhan , Rui Shao , Liqiang Nie

Texture map production is an important part of 3D modeling and determines the rendering quality. Recently, diffusion-based methods have opened a new way for texture generation. However, restricted control flexibility and limited prompt…

Graphics · Computer Science 2025-06-04 Dongyu Yan , Leyi Wu , Jiantao Lin , Luozhou Wang , Tianshuo Xu , Zhifei Chen , Zhen Yang , Lie Xu , Shunsi Zhang , Yingcong Chen

We introduce a framework for joint grounded scene graph - image generation, a challenging task involving high-dimensional, multi-modal structured data. To effectively model this complex joint distribution, we adopt a factorized approach:…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Bicheng Xu , Qi Yan , Renjie Liao , Lele Wang , Leonid Sigal

We present a physics-based character control framework for synthesizing human-scene interactions. Recent advances adopt physics simulation to mitigate artifacts produced by data-driven kinematic approaches. However, existing physics-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Liang Pan , Jingbo Wang , Buzhen Huang , Junyu Zhang , Haofan Wang , Xu Tang , Yangang Wang

A proper scene representation is central to the pursuit of spatial intelligence where agents can robustly reconstruct and efficiently understand 3D scenes. A scene representation is either metric, such as landmark maps in 3D reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Juexiao Zhang , Gao Zhu , Sihang Li , Xinhao Liu , Haorui Song , Xinran Tang , Chen Feng

Simulation is crucial for developing and evaluating autonomous vehicle (AV) systems. Recent literature builds on a new generation of generative models to synthesize highly realistic images for full-stack simulation. However, purely…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Zehao Zhu , Yuliang Zou , Chiyu Max Jiang , Bo Sun , Vincent Casser , Xiukun Huang , Jiahao Wang , Zhenpei Yang , Ruiqi Gao , Leonidas Guibas , Mingxing Tan , Dragomir Anguelov

Text-to-image diffusion generative models can generate high quality images at the cost of tedious prompt engineering. Controllability can be improved by introducing layout conditioning, however existing methods lack layout editing ability…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Alessandro Fontanella , Petru-Daniel Tudosiu , Yongxin Yang , Shifeng Zhang , Sarah Parisot

Structure aware graph generation aims to generate graphs that satisfy given topological properties. It has applications in domains such as drug discovery, social network modeling, and knowledge graph construction. Unlike existing methods…

Artificial Intelligence · Computer Science 2026-05-05 Nidhi Vakil , Hadi Amiri

With the rapid development of data-driven techniques, data has played an essential role in various computer vision tasks. Many realistic and synthetic datasets have been proposed to address different problems. However, there are lots of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Haocheng Ren , Hao Zhang , Jia Zheng , Jiaxiang Zheng , Rui Tang , Yuchi Huo , Hujun Bao , Rui Wang

This paper aims to tackle the problem of photorealistic view synthesis from vehicle sensor data. Recent advancements in neural scene representation have achieved notable success in rendering high-quality autonomous driving scenes, but the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Yunzhi Yan , Zhen Xu , Haotong Lin , Haian Jin , Haoyu Guo , Yida Wang , Kun Zhan , Xianpeng Lang , Hujun Bao , Xiaowei Zhou , Sida Peng

2D concept art generation for 3D scenes is a crucial yet challenging task in computer graphics, as creating natural intuitive environments still demands extensive manual effort in concept design. While generative AI has simplified 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Zhenhong Sun , Yifu Wang , Yonhon Ng , Yongzhi Xu , Daoyi Dong , Hongdong Li , Pan Ji

Textual image generation spans diverse fields like advertising, education, product packaging, social media, information visualization, and branding. Despite recent strides in language-guided image synthesis using diffusion models, current…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Shubham Paliwal , Arushi Jain , Monika Sharma , Vikram Jamwal , Lovekesh Vig

Synthetic data is emerging as a promising solution to the scalability issue of supervised deep learning, especially when real data are difficult to acquire or hard to annotate. Synthetic data generation, however, can itself be prohibitively…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Aayush Prakash , Shoubhik Debnath , Jean-Francois Lafleche , Eric Cameracci , Gavriel State , Stan Birchfield , Marc T. Law