English
Related papers

Related papers: SpNeRF: Memory Efficient Sparse Volumetric Neural …

200 papers

Deploying deep neural networks (DNNs) on power-sensitive edge devices presents a formidable challenge. While Dynamic Voltage and Frequency Scaling (DVFS) is widely employed for energy optimization, traditional model-level scaling is often…

Machine Learning · Computer Science 2026-03-24 Ziyang Zhang , Zheshun Wu , Jie Liu , Luca Mottola

To address the challenge of increasing network size, researchers have developed sparse models through network pruning. However, maintaining model accuracy while achieving significant speedups on general computing devices remains an open…

Artificial Intelligence · Computer Science 2023-10-31 Haitao Xu , Songwei Liu , Yuyang Xu , Shuai Wang , Jiashi Li , Chenqian Yan , Liangqiang Li , Lean Fu , Xin Pan , Fangmin Chen

Despite that convolution neural networks (CNN) have recently demonstrated high-quality reconstruction for video super-resolution (VSR), efficiently training competitive VSR models remains a challenging problem. It usually takes an order of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Lijian Lin , Xintao Wang , Zhongang Qi , Ying Shan

View synthesis methods using implicit continuous shape representations learned from a set of images, such as the Neural Radiance Field (NeRF) method, have gained increasing attention due to their high quality imagery and scalability to high…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Guo-Wei Yang , Wen-Yang Zhou , Hao-Yang Peng , Dun Liang , Tai-Jiang Mu , Shi-Min Hu

Spiking Neural Networks (SNNs) can offer ultra-low power/energy consumption for machine learning-based application tasks due to their sparse spike-based operations. Currently, most of the SNN architectures need a significantly larger model…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Sparse Matricized Tensor Times Khatri-Rao Product (spMTTKRP) is the bottleneck kernel of sparse tensor decomposition. In tensor decomposition, spMTTKRP is performed iteratively along all the modes of an input tensor. In this work, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-25 Sasindu Wijeratne , Rajgopal Kannan , Viktor Prasanna

Recent techniques for real-time view synthesis have rapidly advanced in fidelity and speed, and modern methods are capable of rendering near-photorealistic scenes at interactive frame rates. At the same time, a tension has arisen between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Daniel Duckworth , Peter Hedman , Christian Reiser , Peter Zhizhin , Jean-François Thibert , Mario Lučić , Richard Szeliski , Jonathan T. Barron

Deep learning-based super-resolution (SR) is challenging to implement in resource-constrained edge devices for resolutions beyond full HD due to its high computational complexity and memory bandwidth requirements. This paper introduces an…

Hardware Architecture · Computer Science 2026-05-01 Chih-Chia Hsu , Tian-Sheuan Chang

Neural representation for video (NeRV), which employs a neural network to parameterize video signals, introduces a novel methodology in video representations. However, existing NeRV-based methods have difficulty in capturing fine spatial…

Image and Video Processing · Electrical Eng. & Systems 2025-01-06 Jina Kim , Jihoo Lee , Je-Won Kang

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Reconstructing the high-fidelity surface from multi-view images, especially sparse images, is a critical and practical task that has attracted widespread attention in recent years. However, existing methods are impeded by the memory…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Rui Peng , Shihe Shen , Kaiqiang Xiong , Huachen Gao , Jianbo Jiao , Xiaodong Gu , Ronggang Wang

Neural Radiance Field (NeRF) significantly degrades when only a limited number of views are available. To complement the lack of 3D information, depth-based models, such as DSNeRF and MonoSDF, explicitly assume the availability of accurate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Guangcong Wang , Zhaoxi Chen , Chen Change Loy , Ziwei Liu

In recent studies, the generalization of neural radiance fields for novel view synthesis task has been widely explored. However, existing methods are limited to objects and indoor scenes. In this work, we extend the generalization task to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Liang Song , Guangming Wang , Jiuming Liu , Zhenyang Fu , Yanzi Miao , Hesheng

Spiking Neural Networks (SNNs), with their inherent recurrence, offer an efficient method for processing the asynchronous temporal data generated by Dynamic Vision Sensors (DVS), making them well-suited for event-based vision applications.…

Hardware Architecture · Computer Science 2024-11-06 Deepika Sharma , Shubham Negi , Trishit Dutta , Amogh Agrawal , Kaushik Roy

We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis. Unlike prior works on neural radiance fields that consider per-scene optimization on densely captured images,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Anpei Chen , Zexiang Xu , Fuqiang Zhao , Xiaoshuai Zhang , Fanbo Xiang , Jingyi Yu , Hao Su

Spiking Neural Networks (SNNs) have the potential for achieving low energy consumption due to their biologically sparse computation. Several studies have shown that the off-chip memory (DRAM) accesses are the most energy-consuming…

Hardware Architecture · Computer Science 2023-03-06 Rachmad Vidya Wicaksana Putra , Muhammad Abdullah Hanif , Muhammad Shafique

Recent advancements in implicit neural representations have contributed to high-fidelity surface reconstruction and photorealistic novel view synthesis. However, the computational complexity inherent in these methodologies presents a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Yiying Yang , Wen Liu , Fukun Yin , Xin Chen , Gang Yu , Jiayuan Fan , Tao Chen

Neural Radiance Fields (NeRF) have shown impressive capabilities for photorealistic novel view synthesis when trained on dense inputs. However, when trained on sparse inputs, NeRF typically encounters issues of incorrect density or color…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yingji Zhong , Lanqing Hong , Zhenguo Li , Dan Xu

We propose a reconfigurable hardware architecture for deep neural networks (DNNs) capable of online training and inference, which uses algorithmically pre-determined, structured sparsity to significantly lower memory and computational…

Neural and Evolutionary Computing · Computer Science 2017-11-07 Sourya Dey , Yinan Shao , Keith M. Chugg , Peter A. Beerel

Spiking Neural Networks (SNNs) compute in an event-based matter to achieve a more efficient computation than standard Neural Networks. In SNNs, neuronal outputs (i.e. activations) are not encoded with real-valued activations but with…

Hardware Architecture · Computer Science 2023-08-08 Jan Sommer , M. Akif Özkan , Oliver Keszocze , Jürgen Teich