English
Related papers

Related papers: SceneFormer: Indoor Scene Generation with Transfor…

200 papers

We present a new, fast and flexible pipeline for indoor scene synthesis that is based on deep convolutional generative models. Our method operates on a top-down image-based representation, and inserts objects iteratively into the scene by…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Daniel Ritchie , Kai Wang , Yu-an Lin

The creation of complex 3D scenes tailored to user specifications has been a tedious and challenging task with traditional 3D modeling tools. Although some pioneering methods have achieved automatic text-to-3D generation, they are generally…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xiuyu Yang , Yunze Man , Jun-Kun Chen , Yu-Xiong Wang

We present a fast framework for indoor scene synthesis, given a room geometry and a list of objects with learnt priors. Unlike existing data-driven solutions, which often extract priors by co-occurrence analysis and statistical model…

Graphics · Computer Science 2020-02-06 Song-Hai Zhang , Shao-Kui Zhang , Wei-Yu Xie , Cheng-Yang Luo , Hong-Bo Fu

Identifying objects in an image and their mutual relationships as a scene graph leads to a deep understanding of image content. Despite the recent advancement in deep learning, the detection and labeling of visual object relationships…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Rajat Koner , Poulami Sinhamahapatra , Volker Tresp

Designing high-quality indoor 3D scenes is important in many practical applications, such as room planning or game development. Conventionally, this has been a time-consuming process which requires both artistic skill and familiarity with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Başak Melis Öcal , Maxim Tatarchenko , Sezer Karaoglu , Theo Gevers

Text-driven 3D indoor scene generation holds broad applications, ranging from gaming and smart homes to AR/VR applications. Fast and high-fidelity scene generation is paramount for ensuring user-friendly experiences. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yikun Ma , Dandan Zhan , Zhi Jin

We present a system for generating indoor scenes in response to text prompts. The prompts are not limited to a fixed vocabulary of scene descriptions, and the objects in generated scenes are not restricted to a fixed set of object…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Rio Aguina-Kang , Maxim Gumin , Do Heon Han , Stewart Morris , Seung Jean Yoo , Aditya Ganeshan , R. Kenny Jones , Qiuhong Anna Wei , Kailiang Fu , Daniel Ritchie

Simulation has become a key tool for training and evaluating home robots at scale, yet existing environments fail to capture the diversity and physical complexity of real indoor spaces. Current scene synthesis methods produce sparsely…

Robotics · Computer Science 2026-02-12 Nicholas Pfaff , Thomas Cohn , Sergey Zakharov , Rick Cory , Russ Tedrake

We present a method for creating 3D indoor scenes with a generative model learned from a collection of semantic-segmented depth images captured from different unknown scenes. Given a room with a specified size, our method automatically…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Ming-Jia Yang , Yu-Xiao Guo , Bin Zhou , Xin Tong

Scene graphs provide a rich, structured representation of a scene by encoding the entities (objects) and their spatial relationships in a graphical format. This representation has proven useful in several tasks, such as question answering,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Sanjoy Kundu , Sathyanarayanan N. Aakur

Graph-structured scene descriptions can be efficiently used in generative models to control the composition of the generated image. Previous approaches are based on the combination of graph convolutional networks and adversarial methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Renato Sortino , Simone Palazzo , Concetto Spampinato

Synthesizing realistic and diverse indoor 3D scene layouts in a controllable fashion opens up applications in simulated navigation and virtual reality. As concise and robust representations of a scene, scene graphs have proven to be…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Pietro Bonazzi , Mengqi Wang , Diego Martin Arroyo , Fabian Manhardt , Nico Messikomer , Federico Tombari , Davide Scaramuzza

Indoor scene generation aims at creating shape-compatible, style-consistent furniture arrangements within a spatially reasonable layout. However, most existing approaches primarily focus on generating plausible furniture layouts without…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yiqun Zhao , Zibo Zhao , Jing Li , Sixun Dong , Shenghua Gao

This paper presents a novel generative approach that outputs 3D indoor environments solely from a textual description of the scene. Current methods often treat scene synthesis as a mere layout prediction task, leading to rooms with…

Machine Learning · Computer Science 2025-02-12 Yao Wei , Matteo Toso , Pietro Morerio , Michael Ying Yang , Alessio Del Bue

Panoramic image enables deeper understanding and more holistic perception of $360^\circ$ surrounding environment, which can naturally encode enriched scene context information compared to standard perspective image. Previous work has made…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yuan Dong , Chuan Fang , Liefeng Bo , Zilong Dong , Ping Tan

Controllable scene synthesis aims to create interactive environments for various industrial use cases. Scene graphs provide a highly suitable interface to facilitate these applications by abstracting the scene context in a compact manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Guangyao Zhai , Evin Pınar Örnek , Shun-Cheng Wu , Yan Di , Federico Tombari , Nassir Navab , Benjamin Busam

We present a deep generative scene modeling technique for indoor environments. Our goal is to train a generative model using a feed-forward neural network that maps a prior distribution (e.g., a normal distribution) to the distribution of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Zaiwei Zhang , Zhenpei Yang , Chongyang Ma , Linjie Luo , Alexander Huth , Etienne Vouga , Qixing Huang

The visual world we sense, interpret and interact everyday is a complex composition of interleaved physical entities. Therefore, it is a very challenging task to generate vivid scenes of similar complexity using computers. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Mehmet Ozgur Turkoglu , William Thong , Luuk Spreeuwers , Berkay Kicanaoglu

Training robots in simulation requires diverse 3D scenes that reflect the specific challenges of downstream tasks. However, scenes that satisfy strict task requirements, such as high-clutter environments with plausible spatial arrangement,…

Robotics · Computer Science 2025-08-27 Nicholas Pfaff , Hongkai Dai , Sergey Zakharov , Shun Iwase , Russ Tedrake

3D indoor scene generation is an important problem for the design of digital and real-world environments. To automate this process, a scene generation model should be able to not only generate plausible scene layouts, but also take into…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Kelly O. Marshall , Omid Poursaeed , Sergiu Oprea , Amit Kumar , Anushrut Jignasu , Chinmay Hegde , Yilei Li , Rakesh Ranjan
‹ Prev 1 2 3 10 Next ›