中文
相关论文

相关论文: Exploring Multi-modal Neural Scene Representations…

200 篇论文

With dense inputs, Neural Radiance Fields (NeRF) is able to render photo-realistic novel views under static conditions. Although the synthesis quality is excellent, existing NeRF-based methods fail to obtain moderate three-dimensional (3D)…

计算机视觉与模式识别 · 计算机科学 2024-02-21 Shu Chen , Junyao Li , Yang Zhang , Beiji Zou

Neural Radiance Fields (NeRF) has emerged as a compelling framework for scene representation and 3D recovery. To improve its performance on real-world data, depth regularizations have proven to be the most effective ones. However, depth…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Aoxiang Fan , Corentin Dumery , Nicolas Talabot , Pascal Fua

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the…

图形学 · 计算机科学 2022-05-11 Yu-Jie Yuan , Yang-Tian Sun , Yu-Kun Lai , Yuewen Ma , Rongfei Jia , Lin Gao

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

Neural Radiance Field (NeRF) has emerged as a leading technique for novel view synthesis, owing to its impressive photorealistic reconstruction and rendering capability. Nevertheless, achieving real-time NeRF rendering in large-scale scenes…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Chaojian Li , Bichen Wu , Peter Vajda , Yingyan Celine Lin

Rendering novel views from captured multi-view images has made considerable progress since the emergence of the neural radiance field. This paper aims to further advance the quality of view synthesis by proposing a novel approach dubbed the…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Kang Han , Wei Xiang

Neural Radiance Fields (NeRF) achieves photo-realistic image rendering from novel views, and the Neural Scene Graphs (NSG) \cite{ost2021neural} extends it to dynamic scenes (video) with multiple objects. Nevertheless, computationally heavy…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Yeji Song , Chaerin Kong , Seoyoung Lee , Nojun Kwak , Joonseok Lee

Neural Radiance Fields (NeRF) have garnered remarkable success in novel view synthesis. Nonetheless, the task of generating high-quality images for novel views persists as a critical challenge. While the existing efforts have exhibited…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Linsheng Chen , Guangrun Wang , Liuchun Yuan , Keze Wang , Ken Deng , Philip H. S. Torr

Neural Radiance Fields (NeRF) have demonstrated impressive performance in novel view synthesis. However, NeRF and most of its variants still rely on traditional complex pipelines to provide extrinsic and intrinsic camera parameters, such as…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

Most Neural Radiance Fields (NeRFs) exhibit limited generalization capabilities, which restrict their applicability in representing multiple scenes using a single model. To address this problem, existing generalizable NeRF methods simply…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Ganlin Yang , Guoqiang Wei , Zhizheng Zhang , Yan Lu , Dong Liu

Neural Radiation Field (NeRF) technology can learn a 3D implicit model of a scene from 2D images and synthesize realistic novel view images. This technology has received widespread attention from the industry and has good application…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Shun Fang , Ming Cui , Xing Feng , Yanna Lv

Recently, Neural Radiance Fields (NeRF) have emerged as a potent method for synthesizing novel views from a dense set of images. Despite its impressive performance, NeRF is plagued by its necessity for numerous calibrated views and its…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Jiayang Bai , Letian Huang , Wen Gong , Jie Guo , Yanwen Guo

Neural Radiance Fields (NeRF) recently emerged as a new paradigm for object representation from multi-view (MV) images. Yet, it cannot handle multi-scale (MS) images and camera pose estimation errors, which generally is the case with…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Nishant Jain , Suryansh Kumar , Luc Van Gool

In this paper, we propose SpectralNeRF, an end-to-end Neural Radiance Field (NeRF)-based architecture for high-quality physically based rendering from a novel spectral perspective. We modify the classical spectral rendering into two main…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Ru Li , Jia Liu , Guanghui Liu , Shengping Zhang , Bing Zeng , Shuaicheng Liu

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

计算机视觉与模式识别 · 计算机科学 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

The emergence of Neural Radiance Fields (NeRF) has promoted the development of synthesized high-fidelity views of the intricate real world. However, it is still a very demanding task to repaint the content in NeRF. In this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Xingchen Zhou , Ying He , F. Richard Yu , Jianqiang Li , You Li

Neural Radiance Fields (NeRF), as a pioneering technique in computer vision, offer great potential to revolutionize medical imaging by synthesizing three-dimensional representations from the projected two-dimensional image data. However,…

图像与视频处理 · 电气工程与系统科学 2025-02-27 Xin Wang , Yineng Chen , Shu Hu , Heng Fan , Hongtu Zhu , Xin Li

Neural radiance fields (NeRFs) have emerged as a prominent pre-training paradigm for vision-centric autonomous driving, which enhances 3D geometry and appearance understanding in a fully self-supervised manner. To apply NeRF-based…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Hyeonjun Jeong , Juyeb Shin , Dongsuk Kum

We propose Multi-spectral Neural Radiance Fields(Spec-NeRF) for jointly reconstructing a multispectral radiance field and spectral sensitivity functions(SSFs) of the camera from a set of color images filtered by different filters. The…

图像与视频处理 · 电气工程与系统科学 2023-10-23 Jiabao Li , Yuqi Li , Ciliang Sun , Chong Wang , Jinhui Xiang