中文
相关论文

相关论文: Learning Generalizable Light Field Networks from F…

200 篇论文

Existing view synthesis methods mainly focus on the perspective images and have shown promising results. However, due to the limited field-of-view of the pinhole camera, the performance quickly degrades when large camera movements are…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Jiale Xu , Jia Zheng , Yanyu Xu , Rui Tang , Shenghua Gao

Neural Radiance Field (NeRF) has shown impressive results in novel view synthesis, particularly in Virtual Reality (VR) and Augmented Reality (AR), thanks to its ability to represent scenes continuously. However, when just a few input view…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Hanxin Zhu , Tianyu He , Zhibo Chen

Neural Radiance Fields (NeRF) have transformed novel view synthesis by modeling scene-specific volumetric representations directly from images. While generalizable NeRF models can generate novel views across unknown scenes by learning…

计算机视觉与模式识别 · 计算机科学 2025-05-27 You Wang , Li Fang , Hao Zhu , Fei Hu , Long Ye , Zhan Ma

We present a method that synthesizes novel views of complex scenes by interpolating a sparse set of nearby views. The core of our method is a network architecture that includes a multilayer perceptron and a ray transformer that estimates…

This paper tackles the problem of novel view synthesis from a single image. In particular, we target real-world scenes with rich geometric structure, a challenging task due to the large appearance variations of such scenes and the lack of…

计算机视觉与模式识别 · 计算机科学 2018-04-18 Miaomiao Liu , Xuming He , Mathieu Salzmann

A recent trend among generalizable novel view synthesis methods is to learn a rendering operator acting over single camera rays. This approach is promising because it removes the need for explicit volumetric rendering, but it effectively…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Thomas Tanay , Matteo Maggioni

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

计算机视觉与模式识别 · 计算机科学 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

Novel view synthesis aims to synthesize new images from different viewpoints of given images. Most of previous works focus on generating novel views of certain objects with a fixed background. However, for some applications, such as virtual…

计算机视觉与模式识别 · 计算机科学 2018-02-21 Xiaochuan Yin , Henglai Wei , Penghong lin , Xiangwei Wang , Qijun Chen

This paper presents a Progressively-connected Light Field network (ProLiF), for the novel view synthesis of complex forward-facing scenes. ProLiF encodes a 4D light field, which allows rendering a large batch of rays in one training step…

计算机视觉与模式识别 · 计算机科学 2022-07-12 Peng Wang , Yuan Liu , Guying Lin , Jiatao Gu , Lingjie Liu , Taku Komura , Wenping Wang

Classical light field rendering for novel view synthesis can accurately reproduce view-dependent effects such as reflection, refraction, and translucency, but requires a dense view sampling of the scene. Methods based on geometric…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

In this paper, we propose an approach for synthesizing novel view images from a single RGBD (Red Green Blue-Depth) input. Novel view synthesis (NVS) is an interesting computer vision task with extensive applications. Methods using multiple…

计算机视觉与模式识别 · 计算机科学 2023-11-03 Congrui Hetang , Yuping Wang

We present an information-theoretic regularization technique for few-shot novel view synthesis based on neural implicit representation. The proposed approach minimizes potential reconstruction inconsistency that happens due to insufficient…

计算机视觉与模式识别 · 计算机科学 2022-04-12 Mijeong Kim , Seonguk Seo , Bohyung Han

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

We present a large-scale synthetic dataset for novel view synthesis consisting of ~300k images rendered from nearly 2000 complex scenes using high-quality ray tracing at high resolution (1600 x 1600 pixels). The dataset is orders of…

We present a new neural representation, called Neural Ray (NeuRay), for the novel view synthesis task. Recent works construct radiance fields from image features of input views to render novel view images, which enables the generalization…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Yuan Liu , Sida Peng , Lingjie Liu , Qianqian Wang , Peng Wang , Christian Theobalt , Xiaowei Zhou , Wenping Wang

We present a method that takes as input a set of images of a scene illuminated by unconstrained known lighting, and produces as output a 3D representation that can be rendered from novel viewpoints under arbitrary lighting conditions. Our…

计算机视觉与模式识别 · 计算机科学 2020-12-08 Pratul P. Srinivasan , Boyang Deng , Xiuming Zhang , Matthew Tancik , Ben Mildenhall , Jonathan T. Barron

There has been rapid progress recently on 3D human rendering, including novel view synthesis and pose animation, based on the advances of neural radiance fields (NeRF). However, most existing methods focus on person-specific training and…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Xiangjun Gao , Jiaolong Yang , Jongyoo Kim , Sida Peng , Zicheng Liu , Xin Tong

Asynchronously operating event cameras find many applications due to their high dynamic range, vanishingly low motion blur, low latency and low data bandwidth. The field saw remarkable progress during the last few years, and existing…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Viktor Rudnev , Mohamed Elgharib , Christian Theobalt , Vladislav Golyanik

In this work, we focus on synthesizing high-fidelity novel view images for arbitrary human performers, given a set of sparse multi-view images. It is a challenging task due to the large variation among articulated body poses and heavy…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Jianchuan Chen , Wentao Yi , Liqian Ma , Xu Jia , Huchuan Lu