中文
相关论文

相关论文: Enhancement of Novel View Synthesis Using Omnidire…

200 篇论文

The neural radiance field (NeRF) for realistic novel view synthesis requires camera poses to be pre-acquired by a structure-from-motion (SfM) approach. This two-stage strategy is not convenient to use and degrades the performance because…

计算机视觉与模式识别 · 计算机科学 2022-10-04 Shu Chen , Yang Zhang , Yaxin Xu , Beiji Zou

Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene…

计算机视觉与模式识别 · 计算机科学 2022-06-10 Mingtong Zhang , Shuhong Zheng , Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

This paper proposes a neural radiance field (NeRF) approach for novel view synthesis of dynamic scenes using forward warping. Existing methods often adopt a static NeRF to represent the canonical space, and render dynamic images at other…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Xiang Guo , Jiadai Sun , Yuchao Dai , Guanying Chen , Xiaoqing Ye , Xiao Tan , Errui Ding , Yumeng Zhang , Jingdong Wang

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

Neural Radiance Fields (NeRF) have transformed novel view synthesis by modeling scene-specific volumetric representations directly from images. While generalizable NeRF models can generate novel views across unknown scenes by learning…

计算机视觉与模式识别 · 计算机科学 2025-05-27 You Wang , Li Fang , Hao Zhu , Fei Hu , Long Ye , Zhan Ma

Simultaneously achieving 3D reconstruction and new view synthesis for indoor environments has widespread applications but is technically very challenging. State-of-the-art methods based on implicit neural functions can achieve excellent 3D…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Zhenyu Bao , Guibiao Liao , Zhongyuan Zhao , Kanglin Liu , Qing Li , Guoping Qiu

Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth sensor measurements…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Anagh Malik , Parsa Mirdehghan , Sotiris Nousias , Kiriakos N. Kutulakos , David B. Lindell

We propose a method for reconstructing a continuous light field of a target scene from a single observed image. Our method takes the best of two worlds: joint aperture-exposure coding for compressive light-field acquisition, and a neural…

计算机视觉与模式识别 · 计算机科学 2023-11-17 Yuya Ishikawa , Keita Takahashi , Chihiro Tsutake , Toshiaki Fujii

Dynamic novel view synthesis aims to capture the temporal evolution of visual content within videos. Existing methods struggle to distinguishing between motion and structure, particularly in scenarios where camera poses are either unknown…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Chaoyang Wang , Peiye Zhuang , Aliaksandr Siarohin , Junli Cao , Guocheng Qian , Hsin-Ying Lee , Sergey Tulyakov

In view synthesis, a neural radiance field approximates underlying density and radiance fields based on a sparse set of scene pictures. To generate a pixel of a novel view, it marches a ray through the pixel and computes a weighted sum of…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Nikita Morozov , Denis Rakitin , Oleg Desheulin , Dmitry Vetrov , Kirill Struminsky

In this paper, we focus on the problem of rendering novel views from a Neural Radiance Field (NeRF) under unobserved light conditions. To this end, we introduce a novel dataset, dubbed ReNe (Relighting NeRF), framing real world objects…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Marco Toschi , Riccardo De Matteo , Riccardo Spezialetti , Daniele De Gregorio , Luigi Di Stefano , Samuele Salti

We present a transformation-grounded image generation network for novel 3D view synthesis from a single image. Instead of taking a 'blank slate' approach, we first explicitly infer the parts of the geometry visible both in the input and…

计算机视觉与模式识别 · 计算机科学 2017-03-09 Eunbyung Park , Jimei Yang , Ersin Yumer , Duygu Ceylan , Alexander C. Berg

We aim to improve the Inverted Neural Radiance Fields (iNeRF) algorithm which defines the image pose estimation problem as a NeRF based iterative linear optimization. NeRFs are novel neural space representation models that can synthesize…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Ágoston István Csehi , Csaba Máté Józsa

View synthesis is a process for generating novel views from a scene which has been recorded with a 3-D camera setup. It has important applications in 3-D post-production and 2-D to 3-D conversion. However, a central problem in the…

计算机视觉与模式识别 · 计算机科学 2014-06-25 Julian Habigt , Klaus Diepold

The neural radiance field (NeRF) achieved remarkable success in modeling 3D scenes and synthesizing high-fidelity novel views. However, existing NeRF-based methods focus more on the make full use of the image resolution to generate novel…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Yuqi Han , Tao Yu , Xiaohang Yu , Yuwang Wang , Qionghai Dai

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

计算机视觉与模式识别 · 计算机科学 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park

We leverage repetitive elements in 3D scenes to improve novel view synthesis. Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have greatly improved novel view synthesis but renderings of unseen and occluded parts remain…

Visualizing surgical scenes is crucial for revealing internal anatomical structures during minimally invasive procedures. Novel View Synthesis is a vital technique that offers geometry and appearance reconstruction, enhancing understanding,…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Jiaxin Guo , Jiangliu Wang , Ruofeng Wei , Di Kang , Qi Dou , Yun-hui Liu

Neural Radiance Fields (NeRF) has demonstrated its superior capability to represent 3D geometry but require accurately precomputed camera poses during training. To mitigate this requirement, existing methods jointly optimize camera poses…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Hoang Chuong Nguyen , Wei Mao , Jose M. Alvarez , Miaomiao Liu

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Kang Han , Wei Xiang , Lu Yu