English
Related papers

Related papers: Fast Neural Representations for Direct Volume Rend…

200 papers

We present Tensor4D, an efficient yet effective approach to dynamic scene modeling. The key of our solution is an efficient 4D tensor decomposition method so that the dynamic scene can be directly represented as a 4D spatio-temporal tensor.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Ruizhi Shao , Zerong Zheng , Hanzhang Tu , Boning Liu , Hongwen Zhang , Yebin Liu

Volume rendering using neural fields has shown great promise in capturing and synthesizing novel views of 3D scenes. However, this type of approach requires querying the volume network at multiple points along each viewing ray in order to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Martin Piala , Ronald Clark

Implicit Neural Representations (INRs) have garnered significant attention for their ability to model complex signals in various domains. Recently, INR-based frameworks have shown promise in neural video compression by embedding video…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Taiga Hayami , Kakeru Koizumi , Hiroshi Watanabe

Direct reconstruction of positron emission tomography (PET) data using deep neural networks is a growing field of research. Initial results are promising, but often the networks are complex, memory utilization inefficient, produce…

Image and Video Processing · Electrical Eng. & Systems 2020-06-16 William Whiteley , Vladimir Panin , Chuanyu Zhou , Jorge Cabello , Deepak Bharkhada , Jens Gregor

Generalizable neural surface reconstruction has become a compelling technique to reconstruct from few images without per-scene optimization, where dense 3D feature volume has proven effective as a global representation of scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Aoxiang Fan , Corentin Dumery , Nicolas Talabot , Hieu Le , Pascal Fua

Unsupervised learning with generative models has the potential of discovering rich representations of 3D scenes. While geometric deep learning has explored 3D-structure-aware representations of scene geometry, these models typically require…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Vincent Sitzmann , Michael Zollhöfer , Gordon Wetzstein

Solving image-to-3D from a single view is an ill-posed problem, and current neural reconstruction methods addressing it through diffusion models still rely on scene-specific optimization, constraining their generalization capability. To…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Christian Simon , Sen He , Juan-Manuel Perez-Rua , Mengmeng Xu , Amine Benhalloum , Tao Xiang

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

In this paper we address the problem of representing 3D visual data with parameterized volumetric shape primitives. Specifically, we present a (two-stage) approach built around convolutional neural networks (CNNs) capable of segmenting…

Computer Vision and Pattern Recognition · Computer Science 2020-01-29 Jaka Šircelj , Tim Oblak , Klemen Grm , Uroš Petković , Aleš Jaklič , Peter Peer , Vitomir Štruc , Franc Solina

Reconstructing neural radiance fields with explicit volumetric representations, demonstrated by Plenoxels, has shown remarkable advantages on training and rendering efficiency, while grid-based representations typically induce considerable…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lingzhi Li , Zhongshu Wang , Zhen Shen , Li Shen , Ping Tan

Neural radiance fields (NeRF) have demonstrated the potential of coordinate-based neural representation (neural fields or implicit neural representation) in neural rendering. However, using a multi-layer perceptron (MLP) to represent a 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Daniel Rho , Byeonghyeon Lee , Seungtae Nam , Joo Chan Lee , Jong Hwan Ko , Eunbyung Park

Neural networks have shown great potential in compressing volume data for visualization. However, due to the high cost of training and inference, such volumetric neural representations have thus far only been applied to offline data…

Graphics · Computer Science 2023-07-03 Qi Wu , David Bauer , Michael J. Doyle , Kwan-Liu Ma

With the advent of Neural Radiance Fields (NeRF), neural networks can now render novel views of a 3D scene with quality that fools the human eye. Yet, generating these images is very computationally intensive, limiting their applicability…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Daniel Rebain , Wei Jiang , Soroosh Yazdani , Ke Li , Kwang Moo Yi , Andrea Tagliasacchi

Neural Representations have recently been shown to effectively reconstruct a wide range of signals from 3D meshes and shapes to images and videos. We show that, when adapted correctly, neural representations can be used to directly…

Machine Learning · Computer Science 2023-04-24 Maor Ashkenazi , Zohar Rimon , Ron Vainshtein , Shir Levi , Elad Richardson , Pinchas Mintz , Eran Treister

Modern neural networks have revolutionized the fields of computer vision (CV) and Natural Language Processing (NLP). They are widely used for solving complex CV tasks and NLP tasks such as image classification, image generation, and machine…

Machine Learning · Computer Science 2023-07-25 Xingyi Liu , Keshab K. Parhi

Neural rendering has emerged as a powerful paradigm for synthesizing images, offering many benefits over classical rendering by using neural networks to reconstruct surfaces, represent shapes, and synthesize novel views, either for objects…

Artificial Intelligence · Computer Science 2023-01-30 Saulo Abraham Gante , Juan Irving Vasquez , Marco Antonio Valencia , Mauricio Olguín Carbajal

In this paper, we propose an efficient approach for the compression and representation of volumetric data utilizing coordinate-based networks and multi-resolution hash encoding. Efficient compression of volumetric data is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Sudarshan Devkota , Sumanta Pattanaik

Deep neural networks are powerful learning models that achieve state-of-the-art performance on many computer vision, speech, and language processing tasks. In this paper, we study a fundamental question that arises when designing deep…

Machine Learning · Statistics 2017-10-24 Shiva Prasad Kasiviswanathan , Nina Narodytska , Hongxia Jin

Neural rendering with implicit neural networks has recently emerged as an attractive proposition for scene reconstruction, achieving excellent quality albeit at high computational cost. While the most recent generation of such methods has…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Rui Li , Darius Rückert , Yuanhao Wang , Ramzi Idoughi , Wolfgang Heidrich

Inspired by the robustness and efficiency of sparse representation in sparse coding based image restoration models, we investigate the sparsity of neurons in deep networks. Our method structurally enforces sparsity constraints upon hidden…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Yuchen Fan , Jiahui Yu , Yiqun Mei , Yulun Zhang , Yun Fu , Ding Liu , Thomas S. Huang