English
Related papers

Related papers: SpNeRF: Memory Efficient Sparse Volumetric Neural …

200 papers

Neural radiance fields (NeRF) have demonstrated the potential of coordinate-based neural representation (neural fields or implicit neural representation) in neural rendering. However, using a multi-layer perceptron (MLP) to represent a 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Daniel Rho , Byeonghyeon Lee , Seungtae Nam , Joo Chan Lee , Jong Hwan Ko , Eunbyung Park

Neural Radiance Field (NeRF) based rendering has attracted growing attention thanks to its state-of-the-art (SOTA) rendering quality and wide applications in Augmented and Virtual Reality (AR/VR). However, immersive real-time (> 30 FPS)…

Hardware Architecture · Computer Science 2025-03-31 Chaojian Li , Sixu Li , Yang Zhao , Wenbo Zhu , Yingyan Celine Lin

Spiking Neural Networks (SNNs) have become popular for their more bio-realistic behavior than Artificial Neural Networks (ANNs). However, effectively leveraging the intrinsic, unstructured sparsity of SNNs in hardware is challenging,…

Hardware Architecture · Computer Science 2024-02-12 Ilkin Aliyev , Tosiron Adegbija

Neural radiance field (NeRF) has shown remarkable performance in generating photo-realistic novel views. Among recent NeRF related research, the approaches that involve the utilization of explicit structures like grids to manage features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Yongjae Lee , Li Yang , Deliang Fan

Parameter-efficient fine-tuning (PEFT) is an effective method for adapting pre-trained vision models to downstream tasks by tuning a small subset of parameters. Among PEFT methods, sparse tuning achieves superior performance by only…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shufan Shen , Junshu Sun , Xiangyang Ji , Qingming Huang , Shuhui Wang

Deploying high-quality automatic speech recognition (ASR) on edge devices requires models that jointly optimize accuracy, latency, and memory footprint while operating entirely on CPU without GPU acceleration. We conduct a systematic…

Artificial Intelligence · Computer Science 2026-04-21 Nenad Banfic , David Fan , Kunal Vaishnavi , Sam Kemp , Sunghoon Choi , Rui Ren , Sayan Shaw , Meng Tang

Recent advances in neural rendering have shown that, albeit slow, implicit compact models can learn a scene's geometries and view-dependent appearances from multiple views. To maintain such a small memory footprint but achieve faster…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Juan Luis Gonzalez Bello , Minh-Quan Viet Bui , Munchurl Kim

Neural surface reconstruction aims to reconstruct accurate 3D surfaces based on multi-view images. Previous methods based on neural volume rendering mostly train a fully implicit model with MLPs, which typically require hours of training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Tong Wu , Jiaqi Wang , Xingang Pan , Xudong Xu , Christian Theobalt , Ziwei Liu , Dahua Lin

Neural Radiance Fields (NeRF) has shown great success in novel view synthesis due to its state-of-the-art quality and flexibility. However, NeRF requires dense input views (tens to hundreds) and a long training time (hours to days) for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Jiakai Sun , Zhanjie Zhang , Jiafu Chen , Guangyuan Li , Boyan Ji , Lei Zhao , Wei Xing , Huaizhong Lin

Neural Radiance Fields (NeRF) has emerged as the state-of-the-art method for novel view generation of complex scenes, but is very slow during inference. Recently, there have been multiple works on speeding up NeRF inference, but the state…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Krishna Wadhwani , Tamaki Kojima

Deep learning has driven significant technological advancements, but its high energy consumption limits its use on battery-operated edge devices. Spiking Neural Networks (SNNs) offer promising reductions in inference-time energy…

Hardware Architecture · Computer Science 2026-04-21 Zhanglu Yan , Zhenyu Bai , Tulika Mitra , Weng-Fai Wong

Neural radiance fields (NeRF) have transformed 3D reconstruction and rendering, facilitating photorealistic image synthesis from sparse viewpoints. This work introduces an explicit data reuse neural rendering (EDR-NR) architecture, which…

Neural radiance fields (NeRFs) enable high-quality novel view synthesis, but their high computational complexity limits deployability. While existing neural-based solutions strive for efficiency, they use one-size-fits-all architectures…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Saeejith Nair , Yuhao Chen , Mohammad Javad Shafiee , Alexander Wong

Neural Radiance Fields (NeRFs) can be dramatically accelerated by spatial grid representations. However, they do not explicitly reason about scale and so introduce aliasing artifacts when reconstructing scenes captured at different camera…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Haithem Turki , Michael Zollhöfer , Christian Richardt , Deva Ramanan

Recent work on Neural Radiance Fields (NeRF) showed how neural networks can be used to encode complex 3D environments that can be rendered photorealistically from novel viewpoints. Rendering these images is very computationally demanding…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Stephan J. Garbin , Marek Kowalski , Matthew Johnson , Jamie Shotton , Julien Valentin

Neural Radiance Field (NeRF) is widely seen as an alternative to traditional physically-based rendering. However, NeRF has not yet seen its adoption in resource-limited mobile systems such as Virtual and Augmented Reality (VR/AR), because…

Hardware Architecture · Computer Science 2024-04-19 Yu Feng , Zihan Liu , Jingwen Leng , Minyi Guo , Yuhao Zhu

Visual relocalization is a key technique to autonomous driving, robotics, and virtual/augmented reality. After decades of explorations, absolute pose regression (APR), scene coordinate regression (SCR), and hierarchical methods (HMs) have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Fei Xue , Ignas Budvytis , Daniel Olmeda Reino , Roberto Cipolla

Approximating radiance fields with volumetric grids is one of promising directions for improving NeRF, represented by methods like Plenoxels and DVGO, which achieve super-fast training convergence and real-time rendering. However, these…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Lingzhi Li , Zhen Shen , Zhongshu Wang , Li Shen , Liefeng Bo

This paper presents GPU performance optimization and scaling results for inference models of the Sparse Deep Neural Network Challenge 2020. Demands for network quality have increased rapidly, pushing the size and thus the memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-04 Mert Hidayetoglu , Carl Pearson , Vikram Sharma Mailthody , Eiman Ebrahimi , Jinjun Xiong , Rakesh Nagi , Wen-Mei Hwu

In this study, we introduce BirdNeRF, an adaptation of Neural Radiance Fields (NeRF) designed specifically for reconstructing large-scale scenes using aerial imagery. Unlike previous research focused on small-scale and object-centric NeRF…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Huiqing Zhang , Yifei Xue , Ming Liao , Yizhen Lao