English
Related papers

Related papers: SemCity: Semantic Scene Generation with Triplane D…

200 papers

Synthetic datasets are widely used for training urban scene recognition models, but even highly realistic renderings show a noticeable gap to real imagery. This gap is particularly pronounced when adapting to a specific target domain, such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Denis Zavadski , Damjan Kalšan , Tim Küchler , Haebom Lee , Stefan Roth , Carsten Rother

We propose a method that augments a simulated dataset using diffusion models to improve the performance of pedestrian detection in real-world data. The high cost of collecting and annotating data in the real-world has motivated the use of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Andrew Farley , Mohsen Zand , Michael Greenspan

The performance of leaning-based perception algorithms suffer when deployed in out-of-distribution and underrepresented environments. Outdoor robots are particularly susceptible to rapid changes in visual scene appearance due to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Peter Mortimer , Mirko Maehlisch

Existing approaches to 3D semantic urban scene generation predominantly rely on voxel-based representations, which are bound by fixed resolution, challenging to edit, and memory-intensive in their dense form. In contrast, we advocate for a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Christina Ourania Tze , Daniel Dauner , Yiyi Liao , Dzmitry Tsishkou , Andreas Geiger

Controllable synthetic data generation can substantially lower the annotation cost of training data. Prior works use diffusion models to generate driving images conditioned on the 3D object layout. However, those models are trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yunsong Zhou , Michael Simon , Zhenghao Peng , Sicheng Mo , Hongzi Zhu , Minyi Guo , Bolei Zhou

Automatically generating high-quality real world 3D scenes is of enormous interest for applications such as virtual reality and robotics simulation. Towards this goal, we introduce NeuralField-LDM, a generative model capable of synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seung Wook Kim , Bradley Brown , Kangxue Yin , Karsten Kreis , Katja Schwarz , Daiqing Li , Robin Rombach , Antonio Torralba , Sanja Fidler

City scene generation has gained significant attention in autonomous driving, smart city development, and traffic simulation. It helps enhance infrastructure planning and monitoring solutions. Existing methods have employed a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Jie Deng , Wenhao Chai , Junsheng Huang , Zhonghan Zhao , Qixuan Huang , Mingyan Gao , Jianshu Guo , Shengyu Hao , Wenhao Hu , Jenq-Neng Hwang , Xi Li , Gaoang Wang

Generative models have advanced significantly in realistic image synthesis, with diffusion models excelling in quality and stability. Recent multi-view diffusion models improve 3D-aware street view generation, but they struggle to produce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Ji Li , Zhiwei Li , Shihao Li , Zhenjiang Yu , Boyang Wang , Haiou Liu

3D semantic scene understanding remains a long-standing challenge in the 3D computer vision community. One of the key issues pertains to limited real-world annotated data to facilitate generalizable models. The common practice to tackle…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Duc Nguyen , Yan-Ling Lai , Qilin Zhang , Prabin Gyawali , Benedikt Schwab , Olaf Wysocki , Thomas H. Kolbe

We present a system for 3D semantic scene perception consisting of a network of distributed smart edge sensors. The sensor nodes are based on an embedded CNN inference accelerator and RGB-D and thermal cameras. Efficient vision CNN models…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Simon Bultmann , Sven Behnke

This study aims to investigate the challenge of insufficient three-dimensional context in synthetic datasets for scene text rendering. Although recent advances in diffusion models and related techniques have improved certain aspects of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Li-Syun Hsiung , Jun-Kai Tu , Kuan-Wu Chu , Yu-Hsuan Chiu , Yan-Tsung Peng , Sheng-Luen Chung , Gee-Sern Jison Hsu

Recent advancements in generative AI, particularly diffusion-based image editing, have enabled the transformation of images into highly realistic scenes using only text instructions. This technology offers significant potential for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Naufal Suryanto , Andro Aprila Adiputra , Ahmada Yusril Kadiptya , Thi-Thu-Huong Le , Derry Pratama , Yongsu Kim , Howon Kim

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Stefan Ainetter , Thomas Deixelberger , Edoardo A. Dominici , Philipp Drescher , Konstantinos Vardis , Markus Steinberger

Diffusion models (DMs) excel in photo-realistic image synthesis, but their adaptation to LiDAR scene generation poses a substantial hurdle. This is primarily because DMs operating in the point space struggle to preserve the curve-like…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Haoxi Ran , Vitor Guizilini , Yue Wang

Generative AI offers new opportunities for automating urban planning by creating site-specific urban layouts and enabling flexible design exploration. However, existing approaches often struggle to produce realistic and practical designs at…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Qingyi Wang , Yuebing Liang , Yunhan Zheng , Kaiyuan Xu , Jinhua Zhao , Shenhao Wang

When exploring new areas, robotic systems generally exclusively plan and execute controls over geometry that has been directly measured. When entering space that was previously obstructed from view such as turning corners in hallways or…

Robotics · Computer Science 2024-03-19 Alec Reed , Brendan Crowe , Doncey Albin , Lorin Achey , Bradley Hayes , Christoffer Heckman

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

Realistic scene-level multi-agent motion simulations are crucial for developing and evaluating self-driving algorithms. However, most existing works focus on generating trajectories for a certain single agent type, and typically ignore the…

Robotics · Computer Science 2023-11-28 Zhiming Guo , Xing Gao , Jianlan Zhou , Xinyu Cai , Botian Shi

Semantic understanding of scenes in three-dimensional space (3D) is a quintessential part of robotics oriented applications such as autonomous driving as it provides geometric cues such as size, orientation and true distance of separation…

Computer Vision and Pattern Recognition · Computer Science 2019-11-01 Kartik Srivastava , Akash Kumar Singh , Guruprasad M. Hegde

We present DiffuScene for indoor 3D scene synthesis based on a novel scene configuration denoising diffusion model. It generates 3D instance properties stored in an unordered object set and retrieves the most similar geometry for each…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Jiapeng Tang , Yinyu Nie , Lev Markhasin , Angela Dai , Justus Thies , Matthias Nießner