中文
相关论文

相关论文: NeRFPlayer: A Streamable Dynamic Scene Representat…

200 篇论文

We present an efficient neural 3D scene representation for novel-view synthesis (NVS) in large-scale, dynamic urban areas. Existing works are not well suited for applications like mixed-reality or closed-loop simulation due to their limited…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Tobias Fischer , Jonas Kulhanek , Samuel Rota Bulò , Lorenzo Porzi , Marc Pollefeys , Peter Kontschieder

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

计算机视觉与模式识别 · 计算机科学 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

We present a novel semantic model for human head defined with neural radiance field. The 3D-consistent head model consist of a set of disentangled and interpretable bases, and can be driven by low-dimensional expression coefficients. Thanks…

图形学 · 计算机科学 2022-10-13 Xuan Gao , Chenglai Zhong , Jun Xiang , Yang Hong , Yudong Guo , Juyong Zhang

While existing Neural Radiance Fields (NeRFs) for dynamic scenes are offline methods with an emphasis on visual fidelity, our paper addresses the online use case that prioritises real-time adaptability. We present ParticleNeRF, a new…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Jad Abou-Chakra , Feras Dayoub , Niko Sünderhauf

Recent progress in large-scale scene rendering has yielded Neural Radiance Fields (NeRF)-based models with an impressive ability to synthesize scenes across small objects and indoor scenes. Nevertheless, extending this idea to large-scale…

计算机视觉与模式识别 · 计算机科学 2024-05-13 Xiaohan Zhang , Yukui Qiu , Zhenyu Sun , Qi Liu

This paper proposes a neural radiance field (NeRF) approach for novel view synthesis of dynamic scenes using forward warping. Existing methods often adopt a static NeRF to represent the canonical space, and render dynamic images at other…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Xiang Guo , Jiadai Sun , Yuchao Dai , Guanying Chen , Xiaoqing Ye , Xiao Tan , Errui Ding , Yumeng Zhang , Jingdong Wang

Reconstructing dynamic 3D scenes from 2D images and generating diverse views over time is challenging due to scene complexity and temporal dynamics. Despite advancements in neural implicit models, limitations persist: (i) Inadequate Scene…

计算机视觉与模式识别 · 计算机科学 2024-02-23 Zeyu Yang , Hongye Yang , Zijie Pan , Li Zhang

Neural Radiance Fields (NeRF) is a cutting-edge neural network-based technique for novel view synthesis in 3D reconstruction. However, its significant computational demands pose challenges for deployment on mobile devices. While mesh-based…

图形学 · 计算机科学 2025-04-07 Zhe Wang , Yifei Zhu

Dynamic neural radiance fields (dynamic NeRFs) have demonstrated impressive results in novel view synthesis on 3D dynamic scenes. However, they often require complete video sequences for training followed by novel view synthesis, which is…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Zhiwen Yan , Chen Li , Gim Hee Lee

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

计算机视觉与模式识别 · 计算机科学 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

Creating high-quality and interactive virtual environments, such as games and simulators, often involves complex and costly manual modeling processes. In this paper, we present Video2Game, a novel approach that automatically converts videos…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Hongchi Xia , Zhi-Hao Lin , Wei-Chiu Ma , Shenlong Wang

Neural Radiance Fields or NeRFs have become the representation of choice for problems in view synthesis or image-based rendering, as well as in many other applications across computer graphics and vision, and beyond. At their core, NeRFs…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Ravi Ramamoorthi

We present neural radiance fields for rendering and temporal (4D) reconstruction of humans in motion (H-NeRF), as captured by a sparse set of cameras or even from a monocular video. Our approach combines ideas from neural scene…

计算机视觉与模式识别 · 计算机科学 2021-11-03 Hongyi Xu , Thiemo Alldieck , Cristian Sminchisescu

Convenient 4D modeling of human-object interactions is essential for numerous applications. However, monocular tracking and rendering of complex interaction scenarios remain challenging. In this paper, we propose Instant-NVR, a neural…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Yuheng Jiang , Kaixin Yao , Zhuo Su , Zhehao Shen , Haimin Luo , Lan Xu

Virtual tour among sparse 360$^\circ$ images is widely used while hindering smooth and immersive roaming experiences. The emergence of Neural Radiance Field (NeRF) has showcased significant progress in synthesizing novel views, unlocking…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Huajian Huang , Yingshu Chen , Tianjia Zhang , Sai-Kit Yeung

Representing and rendering dynamic scenes from 2D images is a fundamental yet challenging problem in computer vision and graphics. This survey provides a comprehensive review of the evolution and advancements in dynamic scene representation…

图形学 · 计算机科学 2025-03-12 Jiaxuan Zhu , Hao Tang

Rendering novel views from captured multi-view images has made considerable progress since the emergence of the neural radiance field. This paper aims to further advance the quality of view synthesis by proposing a novel approach dubbed the…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Kang Han , Wei Xiang

This paper presents BioNeRF, a biologically plausible architecture that models scenes in a 3D representation and synthesizes new views through radiance fields. Since NeRF relies on the network weights to store the scene's 3-dimensional…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Leandro A. Passos , Douglas Rodrigues , Danilo Jodas , Kelton A. P. Costa , Ahsan Adeel , João Paulo Papa

We propose a novel Neural Radiance Field (NeRF) representation for non-opaque scenes that enables fast inference by utilizing textured polygons. Despite the high-quality novel view rendering that NeRF provides, a critical limitation is that…

图形学 · 计算机科学 2024-07-11 Gopal Sharma , Daniel Rebain , Kwang Moo Yi , Andrea Tagliasacchi