中文
相关论文

相关论文: MMPI: a Flexible Radiance Field Representation by …

200 篇论文

In the last few years, several works have tackled the problem of novel view synthesis from stereo images or even from a single picture. However, previous methods are computationally expensive, specially for high-resolution images. In this…

The emerging Neural Radiance Field (NeRF) shows great potential in representing 3D scenes, which can render photo-realistic images from novel view with only sparse views given. However, utilizing NeRF to reconstruct real-world scenes…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Chenbin Li , Yu Xin , Gaoyi Liu , Xiang Zeng , Ligang Liu

Single-image novel view synthesis is a challenging and ongoing problem that aims to generate an infinite number of consistent views from a single input image. Although significant efforts have been made to advance the quality of generated…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Guo Pu , Peng-Shuai Wang , Zhouhui Lian

Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale to large scenes. We…

计算机视觉与模式识别 · 计算机科学 2023-02-24 Christian Reiser , Richard Szeliski , Dor Verbin , Pratul P. Srinivasan , Ben Mildenhall , Andreas Geiger , Jonathan T. Barron , Peter Hedman

We present NeX, a new approach to novel view synthesis based on enhancements of multiplane image (MPI) that can reproduce next-level view-dependent effects -- in real time. Unlike traditional MPI that uses a set of simple RGB$\alpha$…

计算机视觉与模式识别 · 计算机科学 2021-04-13 Suttisak Wizadwongsa , Pakkapon Phongthawee , Jiraphon Yenphraphai , Supasorn Suwajanakorn

Purely MLP-based neural radiance fields (NeRF-based methods) often suffer from underfitting with blurred renderings on large-scale scenes due to limited model capacity. Recent approaches propose to geographically divide the scene and adopt…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Linning Xu , Yuanbo Xiangli , Sida Peng , Xingang Pan , Nanxuan Zhao , Christian Theobalt , Bo Dai , Dahua Lin

Current methods for extracting intrinsic image components, such as reflectance and shading, primarily rely on statistical priors. These methods focus mainly on simple synthetic scenes and isolated objects and struggle to perform well on…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Yixiong Yang , Shilin Hu , Haoyu Wu , Ramon Baldrich , Dimitris Samaras , Maria Vanrell

Neural Radiance Fields (NeRF) have been successfully applied in various aerial scenes, yet they face challenges with sparse views due to limited supervision. The acquisition of dense aerial views is often prohibitive, as unmanned aerial…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Zihan Gao , Licheng Jiao , Lingling Li , Xu Liu , Fang Liu , Puhua Chen , Yuwei Guo

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Neural radiance fields (NeRFs) have shown impressive results for novel view synthesis. However, they depend on the repetitive use of a single-input single-output multilayer perceptron (SISO MLP) that maps 3D coordinates and view direction…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Takuhiro Kaneko

Neural Radiance Fields (NeRF) have demonstrated very impressive performance in novel view synthesis via implicitly modelling 3D representations from multi-view 2D images. However, most existing studies train NeRF models with either…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Jiahui Zhang , Fangneng Zhan , Rongliang Wu , Yingchen Yu , Wenqing Zhang , Bai Song , Xiaoqin Zhang , Shijian Lu

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

Neural Radiance Fields (NeRF) recently emerged as a new paradigm for object representation from multi-view (MV) images. Yet, it cannot handle multi-scale (MS) images and camera pose estimation errors, which generally is the case with…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Nishant Jain , Suryansh Kumar , Luc Van Gool

Existing Neural Radiance Fields (NeRF) methods suffer from the existence of reflective objects, often resulting in blurry or distorted rendering. Instead of calculating a single radiance field, we propose a multi-space neural radiance field…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Ze-Xin Yin , Peng-Yi Jiao , Jiaxiong Qiu , Ming-Ming Cheng , Bo Ren

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Kang Han , Wei Xiang , Lu Yu

Panoramic observation using fisheye cameras is significant in virtual reality (VR) and robot perception. However, panoramic images synthesized by traditional methods lack depth information and can only provide three degrees-of-freedom…

机器人学 · 计算机科学 2024-11-05 Dongyu Yan , Guanyu Huang , Fengyu Quan , Haoyao Chen

In this paper, we propose MINE to perform novel view synthesis and depth estimation via dense 3D reconstruction from a single image. Our approach is a continuous depth generalization of the Multiplane Images (MPI) by introducing the NEural…

计算机视觉与模式识别 · 计算机科学 2021-08-02 Jiaxin Li , Zijian Feng , Qi She , Henghui Ding , Changhu Wang , Gim Hee Lee

In recent years, novel view synthesis has gained popularity in generating high-fidelity images. While demonstrating superior performance in the task of synthesizing novel views, the majority of these methods are still based on the…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Xiaoyan Yang , Dingbo Lu , Yang Li , Chenhui Li , Changbo Wang

Neural Radiance Fields (NeRF) is a revolutionary approach for rendering scenes by sampling a single ray per pixel and it has demonstrated impressive capabilities in novel-view synthesis from static scene images. However, in practice, we…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Yifan Yang , Shuhai Zhang , Zixiong Huang , Yubing Zhang , Mingkui Tan

We introduce an improved solution to the neural image-based rendering problem in computer vision. Given a set of images taken from a freely moving camera at train time, the proposed approach could synthesize a realistic image of the scene…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Nishant Jain , Suryansh Kumar , Luc Van Gool