English
Related papers

Related papers: V4d: voxel for 4d novel view synthesis

200 papers

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

Neural radiance fields (NeRF) have shown great potentials in representing 3D scenes and synthesizing novel views, but the computational overhead of NeRF at the inference stage is still heavy. To alleviate the burden, we delve into the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Jiemin Fang , Lingxi Xie , Xinggang Wang , Xiaopeng Zhang , Wenyu Liu , Qi Tian

Wireless channel modeling in complex environments is crucial for wireless communication system design and deployment. Traditional channel modeling approaches face challenges in balancing accuracy, efficiency, and scalability, while recent…

Signal Processing · Electrical Eng. & Systems 2025-12-15 Zihang Zeng , Shu Sun , Meixia Tao , Yin Xu , Xianghao Yu

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

This paper presents a novel latent 3D diffusion model for the generation of neural voxel fields, aiming to achieve accurate part-aware structures. Compared to existing methods, there are two key designs to ensure high-quality and accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Yuhang Huang , SHilong Zou , Xinwang Liu , Kai Xu

We are witnessing an explosion of neural implicit representations in computer vision and graphics. Their applicability has recently expanded beyond tasks such as shape generation and image-based rendering to the fundamental problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Jiaming Sun , Xi Chen , Qianqian Wang , Zhengqi Li , Hadar Averbuch-Elor , Xiaowei Zhou , Noah Snavely

We propose a novel approach for 3D video synthesis that is able to represent multi-view video recordings of a dynamic real-world scene in a compact, yet expressive representation that enables high-quality view synthesis and motion…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Tianye Li , Mira Slavcheva , Michael Zollhoefer , Simon Green , Christoph Lassner , Changil Kim , Tanner Schmidt , Steven Lovegrove , Michael Goesele , Richard Newcombe , Zhaoyang Lv

Neural Radiance Fields (NeRF) have shown impressive capabilities for photorealistic novel view synthesis when trained on dense inputs. However, when trained on sparse inputs, NeRF typically encounters issues of incorrect density or color…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yingji Zhong , Lanqing Hong , Zhenguo Li , Dan Xu

We present a large-scale synthetic dataset for novel view synthesis consisting of ~300k images rendered from nearly 2000 complex scenes using high-quality ray tracing at high resolution (1600 x 1600 pixels). The dataset is orders of…

We propose an efficient radiance field rendering algorithm that incorporates a rasterization process on adaptive sparse voxels without neural networks or 3D Gaussians. There are two key contributions coupled with the proposed system. The…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Cheng Sun , Jaesung Choe , Charles Loop , Wei-Chiu Ma , Yu-Chiang Frank Wang

We present a super-fast convergence approach to reconstructing the per-scene radiance field from a set of images that capture the scene with known poses. This task, which is often applied to novel view synthesis, is recently revolutionized…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Cheng Sun , Min Sun , Hwann-Tzong Chen

Neural radiance fields (NeRF) have shown great success in modeling 3D scenes and synthesizing novel-view images. However, most previous NeRF methods take much time to optimize one single scene. Explicit data structures, e.g. voxel features,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Jiemin Fang , Taoran Yi , Xinggang Wang , Lingxi Xie , Xiaopeng Zhang , Wenyu Liu , Matthias Nießner , Qi Tian

Modeling dynamic scenes is important for many applications such as virtual reality and telepresence. Despite achieving unprecedented fidelity for novel view synthesis in dynamic scenes, existing methods based on Neural Radiance Fields…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jia-Wei Liu , Yan-Pei Cao , Weijia Mao , Wenqiao Zhang , David Junhao Zhang , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

This paper targets high-fidelity and real-time view synthesis of dynamic 3D scenes at 4K resolution. Recently, some methods on dynamic view synthesis have shown impressive rendering quality. However, their speed is still limited when…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhen Xu , Sida Peng , Haotong Lin , Guangzhao He , Jiaming Sun , Yujun Shen , Hujun Bao , Xiaowei Zhou

Capturing and rendering novel views of complex real-world scenes is a long-standing problem in computer graphics and vision, with applications in augmented and virtual reality, immersive experiences and 3D photography. The advent of deep…

Graphics · Computer Science 2024-08-09 Ravi Ramamoorthi

Domain scientists often face I/O and storage challenges when keeping raw data from large-scale simulations. Saving visualization images, albeit practical, is limited to preselected viewpoints, transfer functions, and simulation parameters.…

Graphics · Computer Science 2025-02-25 Siyuan Yao , Yunfei Lu , Chaoli Wang

This paper proposes a method to reconstruct the neural radiance field with equirectangular omnidirectional images. Implicit neural scene representation with a radiance field can reconstruct the 3D shape of a scene continuously within a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Qiaoge Li , Itsuki Ueda , Chun Xie , Hidehiko Shishido , Itaru Kitahara

We introduce an approach for selecting objects in neural volumetric 3D representations, such as multi-plane images (MPI) and neural radiance fields (NeRF). Our approach takes a set of foreground and background 2D user scribbles in one view…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Zhongzheng Ren , Aseem Agarwala , Bryan Russell , Alexander G. Schwing , Oliver Wang

Neural Radiance Field (NeRF) is a popular method in data-driven 3D reconstruction. Given its simplicity and high quality rendering, many NeRF applications are being developed. However, NeRF's big limitation is its slow speed. Many attempts…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Naruya Kondo , Yuya Ikeda , Andrea Tagliasacchi , Yutaka Matsuo , Yoichi Ochiai , Shixiang Shane Gu

Recent breakthroughs in Visual Language Models (VLMs) and Multimodal Large Language Models (MLLMs) have significantly advanced 3D scene perception towards language-driven cognition. However, existing 3D language models struggle with sparse,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Shiyu Liu , Lianlei Shan