English
Related papers

Related papers: Fast 3D Indoor Scene Synthesis with Discrete and E…

200 papers

Indoor scene synthesis involves automatically picking and placing furniture appropriately on a floor plan, so that the scene looks realistic and is functionally plausible. Such scenes can serve as homes for immersive 3D experiences, or be…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Jingyu Liu , Wenhan Xiong , Ian Jones , Yixin Nie , Anchit Gupta , Barlas Oğuz

We study the problem of synthesizing immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints, including viewpoints that extrapolate far beyond the input images while…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Jing Yu Koh , Harsh Agrawal , Dhruv Batra , Richard Tucker , Austin Waters , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson

We present SemLayoutDiff, a unified model for synthesizing diverse 3D indoor scenes across multiple room types. The model introduces a scene layout representation combining a top-down semantic map and attributes for each object. Unlike…

Graphics · Computer Science 2025-09-09 Xiaohao Sun , Divyam Goel , Angel X. Chang

This paper presents a novel generative approach that outputs 3D indoor environments solely from a textual description of the scene. Current methods often treat scene synthesis as a mere layout prediction task, leading to rooms with…

Machine Learning · Computer Science 2025-02-12 Yao Wei , Matteo Toso , Pietro Morerio , Michael Ying Yang , Alessio Del Bue

We present DiffuScene for indoor 3D scene synthesis based on a novel scene configuration denoising diffusion model. It generates 3D instance properties stored in an unordered object set and retrieves the most similar geometry for each…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Jiapeng Tang , Yinyu Nie , Lev Markhasin , Angela Dai , Justus Thies , Matthias Nießner

Many compelling video processing effects can be achieved if per-pixel depth information and 3D camera calibrations are known. However, the success of such methods is highly dependent on the accuracy of this "scene-space" information. We…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Felix Klose , Oliver Wang , Jean-Charles Bazin , Marcus Magnor , Alexander Sorkine-Hornung

The creation of complex 3D scenes tailored to user specifications has been a tedious and challenging task with traditional 3D modeling tools. Although some pioneering methods have achieved automatic text-to-3D generation, they are generally…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xiuyu Yang , Yunze Man , Jun-Kun Chen , Yu-Xiong Wang

Indoor image features extraction is a fundamental problem in multiple fields such as image processing, pattern recognition, robotics and so on. Nevertheless, most of the existing feature extraction methods, which extract features based on…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Chiranjibi Sitaula , Yong Xiang , Yushu Zhang , Xuequan Lu , Sunil Aryal

Deep learning has enabled remarkable advances in scene understanding, particularly in semantic segmentation tasks. Yet, current state of the art approaches are limited to a closed set of classes, and fail when facing novel elements, also…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Nicolas Marchal , Charlotte Moraldo , Roland Siegwart , Hermann Blum , Cesar Cadena , Abel Gawel

One major goal of vision is to infer physical models of objects, surfaces, and their layout from sensors. In this paper, we aim to interpret indoor scenes from one RGBD image. Our representation encodes the layout of walls, which must…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Ruiqi Guo , Chuhang Zou , Derek Hoiem

Spatial relationships between objects provide important information for text-based image retrieval. As users are more likely to describe a scene from a real world perspective, using 3D spatial relationships rather than 2D relationships that…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Ang Li , Jin Sun , Joe Yue-Hei Ng , Ruichi Yu , Vlad I. Morariu , Larry S. Davis

Efficient authoring of vast virtual environments hinges on algorithms that are able to automatically generate content while also being controllable. We propose a method to automatically generate furniture layouts for indoor environments.…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Paul Henderson , Kartic Subr , Vittorio Ferrari

Image generation models trained on large datasets can synthesize high-quality images but often produce spatially inconsistent and distorted images due to limited information about the underlying structures and spatial layouts. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Hyundo Lee , Suhyung Choi , Inwoo Hwang , Byoung-Tak Zhang

In this paper we propose an end-to-end swift 3D feature reductionist framework (3DFR) for scene independent change detection. The 3DFR framework consists of three feature streams: a swift 3D feature reductionist stream (AvFeat), a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Murari Mandal , Vansh Dhar , Abhishek Mishra , Santosh Kumar Vipparthi

Indoor scene understanding remains a fundamental challenge in robotics, with direct implications for downstream tasks such as navigation and manipulation. Traditional approaches often rely on closed-set recognition or loop closure, limiting…

Robotics · Computer Science 2025-06-10 Hongming Chen , Yiyang Lin , Ziliang Li , Biyu Ye , Yuying Zhang , Ximin Lyu

Despite advances in indoor 3D scene layout generation, synthesizing scenes with dense object arrangements remains challenging. Existing methods focus on large furniture while neglecting smaller objects, resulting in unrealistically empty…

Graphics · Computer Science 2025-12-08 Hou In Derek Pun , Hou In Ivan Tam , Austin T. Wang , Xiaoliang Huo , Angel X. Chang , Manolis Savva

The reconstruction of indoor scenes from multi-view RGB images is challenging due to the coexistence of flat and texture-less regions alongside delicate and fine-grained regions. Recent methods leverage neural radiance fields aided by…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Sheng Ye , Yubin Hu , Matthieu Lin , Yu-Hui Wen , Wang Zhao , Yong-Jin Liu , Wenping Wang

Large language and vision models have been leading a revolution in visual computing. By greatly scaling up sizes of data and model parameters, the large models learn deep priors which lead to remarkable performance in various tasks. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Junsheng Zhou , Yu-Shen Liu , Zhizhong Han

In this paper, we propose a novel method to jointly solve scene layout estimation and global registration problems for accurate indoor 3D reconstruction. Given a sequence of range data, we first build a set of scene fragments using…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Jeong-Kyun Lee , Jae-Won Yea , Min-Gyu Park , Kuk-Jin Yoon

In recent years, 3D generation has made great strides in both academia and industry. However, generating 3D scenes from a single RGB image remains a significant challenge, as current approaches often struggle to ensure both object…

Graphics · Computer Science 2026-02-18 Xiang Tang , Ruotong Li , Xiaopeng Fan