中文
相关论文

相关论文: NeRF-VAE: A Geometry Aware 3D Scene Generative Mod…

200 篇论文

We present a method for estimating neural scenes representations of objects given only a single image. The core of our method is the estimation of a geometric scaffold for the object and its use as a guide for the reconstruction of the…

计算机视觉与模式识别 · 计算机科学 2021-06-24 Konstantinos Rematas , Ricardo Martin-Brualla , Vittorio Ferrari

We present a generative neural network which enables us to generate plausible 3D indoor scenes in large quantities and varieties, easily and highly efficiently. Our key observation is that indoor scene structures are inherently…

We present a method to map 2D image observations of a scene to a persistent 3D scene representation, enabling novel view synthesis and disentangled representation of the movable and immovable components of the scene. Motivated by the…

Reconstructing from multi-view images is a longstanding problem in 3D vision, where neural radiance fields (NeRFs) have shown great potential and get realistic rendered images of novel views. Currently, most NeRF methods either require…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Xin Wen , Xuening Zhu , Renjiao Yi , Zhifeng Wang , Chenyang Zhu , Kai Xu

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Dor Verbin , Peter Hedman , Ben Mildenhall , Todd Zickler , Jonathan T. Barron , Pratul P. Srinivasan

We present a method to learn compositional multi-object dynamics models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks. NeRFs have become a popular choice for…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Danny Driess , Zhiao Huang , Yunzhu Li , Russ Tedrake , Marc Toussaint

Previous portrait image generation methods roughly fall into two categories: 2D GANs and 3D-aware GANs. 2D GANs can generate high fidelity portraits but with low view consistency. 3D-aware GAN methods can maintain view consistency but their…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Jingxiang Sun , Xuan Wang , Yong Zhang , Xiaoyu Li , Qi Zhang , Yebin Liu , Jue Wang

Current performance-driven building design methods are not widely adopted outside the research field for several reasons that make them difficult to integrate into a typical design process. In the early design phase, in particular, the…

机器学习 · 计算机科学 2022-04-19 Spyridon Ampanavos , Ali Malkawi

Neural Radiance Fields (NeRF) have demonstrated impressive performance in novel view synthesis. However, NeRF and most of its variants still rely on traditional complex pipelines to provide extrinsic and intrinsic camera parameters, such as…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

Deep generative models have been used in recent years to learn coherent latent representations in order to synthesize high-quality images. In this work, we propose a neural network to learn a generative model for sampling consistent indoor…

计算机视觉与模式识别 · 计算机科学 2020-08-24 Pulak Purkait , Christopher Zach , Ian Reid

Neural Radiance Fields (NeRF) have transformed novel view synthesis by modeling scene-specific volumetric representations directly from images. While generalizable NeRF models can generate novel views across unknown scenes by learning…

计算机视觉与模式识别 · 计算机科学 2025-05-27 You Wang , Li Fang , Hao Zhu , Fei Hu , Long Ye , Zhan Ma

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

Generalizable NeRF aims to synthesize novel views for unseen scenes. Common practices involve constructing variance-based cost volumes for geometry reconstruction and encoding 3D descriptors for decoding novel views. However, existing…

计算机视觉与模式识别 · 计算机科学 2024-04-29 Tianqi Liu , Xinyi Ye , Min Shi , Zihao Huang , Zhiyu Pan , Zhan Peng , Zhiguo Cao

We present a new method for estimating the Neural Reflectance Field (NReF) of an object from a set of posed multi-view images under unknown lighting. NReF represents 3D geometry and appearance of objects in a disentangled manner, and are…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Xiu Li , Xiao Li , Yan Lu

We tackle the task of scalable unsupervised object-centric representation learning on 3D scenes. Existing approaches to object-centric representation learning show limitations in generalizing to larger scenes as their learning processes…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Tianyu Wang , Kee Siong Ng , Miaomiao Liu

Generalizable NeRF can directly synthesize novel views across new scenes, eliminating the need for scene-specific retraining in vanilla NeRF. A critical enabling factor in these approaches is the extraction of a generalizable 3D…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Zhiyuan Min , Yawei Luo , Wei Yang , Yuesong Wang , Yi Yang

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been…

计算机视觉与模式识别 · 计算机科学 2023-03-10 Dogyoon Lee , Minhyeok Lee , Chajin Shin , Sangyoun Lee

Traditional 3D face models are based on mesh representations with texture. One of the most important models is FLAME (Faces Learned with an Articulated Model and Expressions), which produces meshes of human faces that are fully…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Wojciech Zając , Joanna Waczyńska , Piotr Borycki , Jacek Tabor , Maciej Zięba , Przemysław Spurek

We represent the ResNeRF, a novel geometry-guided two-stage framework for indoor scene novel view synthesis. Be aware of that a good geometry would greatly boost the performance of novel view synthesis, and to avoid the geometry ambiguity…

计算机视觉与模式识别 · 计算机科学 2023-07-12 Yuting Xiao , Yiqun Zhao , Yanyu Xu , Shenghua Gao

While NeRF-based 3D-aware image generation methods enable viewpoint control, limitations still remain to be adopted to various 3D applications. Due to their view-dependent and light-entangled volume representation, the 3D geometry presents…

计算机视觉与模式识别 · 计算机科学 2022-03-15 Minsoo Lee , Chaeyeon Chung , Hojun Cho , Minjung Kim , Sanghun Jung , Jaegul Choo , Minhyuk Sung