English
Related papers

Related papers: Disentangled 3D Scene Generation with Layout Learn…

200 papers

Recent breakthroughs in text-guided image generation have led to remarkable progress in the field of 3D synthesis from text. By optimizing neural radiance fields (NeRF) directly from text, recent methods are able to produce remarkable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Dana Cohen-Bar , Elad Richardson , Gal Metzer , Raja Giryes , Daniel Cohen-Or

Graph representation of objects and their relations in a scene, known as a scene graph, provides a precise and discernible interface to manipulate a scene by modifying the nodes or the edges in the graph. Although existing works have shown…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Azade Farshad , Yousef Yeganeh , Helisa Dhamo , Federico Tombari , Nassir Navab

Visual scenes are extremely rich in diversity, not only because there are infinite combinations of objects and background, but also because the observations of the same scene may vary greatly with the change of viewpoints. When observing a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Jinyang Yuan , Bin Li , Xiangyang Xue

We explore different design choices for injecting noise into generative adversarial networks (GANs) with the goal of disentangling the latent space. Instead of traditional approaches, we propose feeding multiple noise codes through separate…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Yazeed Alharbi , Peter Wonka

We propose a novel approach to disentangle the generative factors of variation underlying a given set of observations. Our method builds upon the idea that the (unknown) low-dimensional manifold underlying the data space can be explicitly…

Machine Learning · Computer Science 2021-10-05 Marco Fumero , Luca Cosmo , Simone Melzi , Emanuele Rodolà

CodeNeRF is an implicit 3D neural representation that learns the variation of object shapes and textures across a category and can be trained, from a set of posed images, to synthesize novel views of unseen objects. Unlike the original…

Graphics · Computer Science 2021-09-07 Wonbong Jang , Lourdes Agapito

Scene image editing is crucial for entertainment, photography, and advertising design. Existing methods solely focus on either 2D individual object or 3D global scene editing. This results in a lack of a unified approach to effectively…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Qihang Zhang , Yinghao Xu , Chaoyang Wang , Hsin-Ying Lee , Gordon Wetzstein , Bolei Zhou , Ceyuan Yang

We present a simple and efficient method based on deep learning to automatically decompose sketched objects into semantically valid parts. We train a deep neural network to transfer existing segmentations and labelings from 3D models to…

Graphics · Computer Science 2018-08-01 Lei Li , Hongbo Fu , Chiew-Lan Tai

Generative models have shown great promise in synthesizing photorealistic 3D objects, but they require large amounts of training data. We introduce SinGRAF, a 3D-aware generative model that is trained with a few input images of a single…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Minjung Son , Jeong Joon Park , Leonidas Guibas , Gordon Wetzstein

Scene-graph generation involves creating a structural representation of the relationships between objects in a scene by predicting subject-object-relation triplets from input data. Existing methods show poor performance in detecting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 A S M Iftekhar , Raphael Ruschel , Satish Kumar , Suya You , B. S. Manjunath

Image generating neural networks are mostly viewed as black boxes, where any change in the input can have a number of globally effective changes on the output. In this work, we propose a method for learning disentangled representations to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Maren Awiszus , Hanno Ackermann , Bodo Rosenhahn

We cast multiview reconstruction from unknown pose as a generative modeling problem. From a collection of unannotated 2D images of a scene, our approach simultaneously learns both a network to predict camera pose from 2D image input, as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xin Yuan , Rana Hanocka , Michael Maire

Modern machine learning models for scene understanding, such as depth estimation and object tracking, rely on large, high-quality datasets that mimic real-world deployment scenarios. To address data scarcity, we propose an end-to-end system…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Sonia Laguna , Alberto Garcia-Garcia , Marie-Julie Rakotosaona , Stylianos Moschoglou , Leonhard Helminger , Sergio Orts-Escolano

By estimating 3D shape and instances from a single view, we can capture information about an environment quickly, without the need for comprehensive scanning and multi-view fusion. Solving this task for composite scenes (such as object…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Zoe Landgraf , Raluca Scona , Tristan Laidlow , Stephen James , Stefan Leutenegger , Andrew J. Davison

3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Bo Li , Yi-ke Li , Zhi-fen He , Bin Liu , Yun-Kun Lai

TL;DR Perform 3D object editing selectively by disentangling it from the background scene. Instruct-NeRF2NeRF (in2n) is a promising method that enables editing of 3D scenes composed of Neural Radiance Field (NeRF) using text prompts.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiseung Hong , Changmin Lee , Gyusang Yu

We present ONeRF, a method that automatically segments and reconstructs object instances in 3D from multi-view RGB images without any additional manual annotations. The segmented 3D objects are represented using separate Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Shengnan Liang , Yichen Liu , Shangzhe Wu , Yu-Wing Tai , Chi-Keung Tang

Representing scenes at the granularity of objects is a prerequisite for scene understanding and decision making. We propose PriSMONet, a novel approach based on Prior Shape knowledge for learning Multi-Object 3D scene decomposition and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Cathrin Elich , Martin R. Oswald , Marc Pollefeys , Joerg Stueckler

Deep generative models have been used in recent years to learn coherent latent representations in order to synthesize high-quality images. In this work, we propose a neural network to learn a generative model for sampling consistent indoor…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Pulak Purkait , Christopher Zach , Ian Reid

Scalable 6D pose estimation for rigid objects from RGB images aims at handling multiple objects and generalizing to novel objects. Building on a well-known auto-encoding framework to cope with object symmetry and the lack of labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Yilin Wen , Xiangyu Li , Hao Pan , Lei Yang , Zheng Wang , Taku Komura , Wenping Wang