English
Related papers

Related papers: VQ-NeRF: Vector Quantization Enhances Implicit Neu…

200 papers

We present a novel neural surface reconstruction method, called NeuS, for reconstructing objects and scenes with high fidelity from 2D image inputs. Existing neural surface reconstruction approaches, such as DVR and IDR, require foreground…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Peng Wang , Lingjie Liu , Yuan Liu , Christian Theobalt , Taku Komura , Wenping Wang

The quality of three-dimensional reconstruction is a key factor affecting the effectiveness of its application in areas such as virtual reality (VR) and augmented reality (AR) technologies. Neural Radiance Fields (NeRF) can generate…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Qianqiu Tan , Tao Liu , Yinling Xie , Shuwan Yu , Baohua Zhang

The neural radiance fields (NeRF) have advanced the development of 3D volumetric video technology, but the large data volumes they involve pose significant challenges for storage and transmission. To address these problems, the existing…

Multimedia · Computer Science 2024-11-11 Zhiyu Zhang , Guo Lu , Huanxiong Liang , Zhengxue Cheng , Anni Tang , Li Song

Quantization has been proven to be an effective method for reducing the computing and/or storage cost of DNNs. However, the trade-off between the quantization bitwidth and final accuracy is complex and non-convex, which makes it difficult…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Cheng Gong , Yao Chen , Ye Lu , Tao Li , Cong Hao , Deming Chen

Neural Radiance Fields (NeRF) enable 3D scene reconstruction from 2D images and camera poses for Novel View Synthesis (NVS). Although NeRF can produce photorealistic results, it often suffers from overfitting to training views, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Fusang Wang , Arnaud Louys , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou

In recent years, Neural Radiance Fields (NeRF) have demonstrated significant advantages in representing and synthesizing 3D scenes. Explicit NeRF models facilitate the practical NeRF applications with faster rendering speed, and also…

Image and Video Processing · Electrical Eng. & Systems 2024-09-23 Yuke Xing , Qi Yang , Kaifa Yang , Yilin Xu , Zhu Li

Industrial 3D face assets creation typically reconstructs topology-consistent face meshes from multi-view images for downstream production. However, high-quality reconstruction usually requires manual processing or specific capture…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Yating Wang , Ran Yi , Xiaoning Lei , Ke Fan , Jinkun Hao , Lizhuang Ma

With the advent of Neural Radiance Fields (NeRF), neural networks can now render novel views of a 3D scene with quality that fools the human eye. Yet, generating these images is very computationally intensive, limiting their applicability…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Daniel Rebain , Wei Jiang , Soroosh Yazdani , Ke Li , Kwang Moo Yi , Andrea Tagliasacchi

Current 3D representations like meshes, voxels, point clouds, and NeRF-based neural implicit fields exhibit significant limitations: they are often task-specific, lacking universal applicability across reconstruction, generation, editing,…

Graphics · Computer Science 2025-07-17 Tielong Wang , Yuxuan Xiong , Jinfan Liu , Zhifan Zhang , Ye Chen , Yue Shi , Bingbing Ni

Neural Radiance Fields (NeRF) have demonstrated remarkable performance in novel view synthesis. However, there is much improvement room on restoring 3D scenes based on NeRF from corrupted images, which are common in natural scene captures…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Xianliang Huang , Zhizhou Zhong , Shuhang Chen , Yi Xu , Juhong Guan , Shuigeng Zhou

In recent years, the field of implicit neural representation has progressed significantly. Models such as neural radiance fields (NeRF), which uses relatively small neural networks, can represent high-quality scenes and achieve…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 David Dadon , Ohad Fried , Yacov Hel-Or

We aim to improve the Inverted Neural Radiance Fields (iNeRF) algorithm which defines the image pose estimation problem as a NeRF based iterative linear optimization. NeRFs are novel neural space representation models that can synthesize…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Ágoston István Csehi , Csaba Máté Józsa

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem

Photo-realistic rendering and novel view synthesis play a crucial role in human-computer interaction tasks, from gaming to path planning. Neural Radiance Fields (NeRFs) model scenes as continuous volumetric functions and achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Iryna Repinetska , Anna Hilsmann , Peter Eisert

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu

The recent progress in implicit 3D representation, i.e., Neural Radiance Fields (NeRFs), has made accurate and photorealistic 3D reconstruction possible in a differentiable manner. This new representation can effectively convey the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yoonwoo Jeong , Seungjoo Shin , Junha Lee , Christopher Choy , Animashree Anandkumar , Minsu Cho , Jaesik Park

Vector Quantization (VQ) is an appealing model compression method to obtain a tiny model with less accuracy loss. While methods to obtain better codebooks and codes under fixed clustering dimensionality have been extensively studied,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Zezhou Zhu , Yucong Zhou , Zhao Zhong

Recent work on Neural Radiance Fields (NeRF) showed how neural networks can be used to encode complex 3D environments that can be rendered photorealistically from novel viewpoints. Rendering these images is very computationally demanding…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Stephan J. Garbin , Marek Kowalski , Matthew Johnson , Jamie Shotton , Julien Valentin

We propose a method to compress full-resolution video sequences with implicit neural representations. Each frame is represented as a neural network that maps coordinate positions to pixel values. We use a separate implicit network to…

Machine Learning · Computer Science 2021-12-22 Yunfan Zhang , Ties van Rozendaal , Johann Brehmer , Markus Nagel , Taco Cohen

Neural implicit representation of visual scenes has attracted a lot of attention in recent research of computer vision and graphics. Most prior methods focus on how to reconstruct 3D scene representation from a set of images. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Wenpu Li , Pian Wan , Peng Wang , Jinghang Li , Yi Zhou , Peidong Liu