English
Related papers

Related papers: Progressive Multi-scale Light Field Networks

200 papers

Neural Radiance Fields (NeRF) have demonstrated superior novel view synthesis performance but are slow at rendering. To speed up the volume rendering process, many acceleration methods have been proposed at the cost of large memory…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Sicheng Li , Hao Li , Yue Wang , Yiyi Liao , Lu Yu

Light field (LF) cameras record both intensity and directions of light rays, and encode 3D scenes into 4D LF images. Recently, many convolutional neural networks (CNNs) have been proposed for various LF image processing tasks. However, it…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Yingqian Wang , Longguang Wang , Gaochang Wu , Jungang Yang , Wei An , Jingyi Yu , Yulan Guo

Single image dehazing is a critical image pre-processing step for subsequent high-level computer vision tasks. However, it remains challenging due to its ill-posed nature. Existing dehazing models tend to suffer from model overcomplexity…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Jing Zhang , Dacheng Tao

We propose progressive radiance distillation, an inverse rendering method that combines physically-based rendering with Gaussian-based radiance field rendering using a distillation progress map. Taking multi-view images as input, our method…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Keyang Ye , Qiming Hou , Kun Zhou

Recent work on Neural Radiance Fields (NeRF) has demonstrated significant advances in high-quality view synthesis. A major limitation of NeRF is its low rendering efficiency due to the need for multiple network forwardings to render a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yushuang Wu , Xiao Li , Jinglu Wang , Xiaoguang Han , Shuguang Cui , Yan Lu

The recent research explosion around implicit neural representations, such as NeRF, shows that there is immense potential for implicitly storing high-quality scene and lighting information in compact neural networks. However, one major…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Thomas Neff , Pascal Stadlbauer , Mathias Parger , Andreas Kurz , Joerg H. Mueller , Chakravarty R. Alla Chaitanya , Anton Kaplanyan , Markus Steinberger

Achieving photorealistic rendering of real-world scenes poses a significant challenge with diverse applications, including mixed reality and virtual reality. Neural networks, extensively explored in solving differential equations, have…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 YuanFu Yang , Min Sun

Expansion and reduction of a neural network's width has well known properties in terms of the entropy of the propagating information. When carefully stacked on top of one another, an encoder network and a decoder network produce an…

Image and Video Processing · Electrical Eng. & Systems 2020-08-04 Svetozar Zarko Valtchev , Jianhong Wu

Neural Radiance Fields (NeRFs) typically struggle to reconstruct and render highly specular objects, whose appearance varies quickly with changes in viewpoint. Recent works have improved NeRF's ability to render detailed specular appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Dor Verbin , Pratul P. Srinivasan , Peter Hedman , Ben Mildenhall , Benjamin Attal , Richard Szeliski , Jonathan T. Barron

Most approaches for video frame interpolation require accurate dense correspondences to synthesize an in-between frame. Therefore, they do not perform well in challenging scenarios with e.g. lighting changes or motion blur. Recent deep…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Simone Meyer , Abdelaziz Djelouah , Brian McWilliams , Alexander Sorkine-Hornung , Markus Gross , Christopher Schroers

In recent years, encoder-decoder networks have focused on expanding receptive fields and incorporating multi-scale context to capture global features for objects of varying sizes. However, as networks deepen, they often discard fine spatial…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Xiaogang Du , Dongxin Gu , Tao Lei , Yipeng Jiao , Yibin Zou

Decomposing a scene into its shape, reflectance and illumination is a fundamental problem in computer vision and graphics. Neural approaches such as NeRF have achieved remarkable success in view synthesis, but do not explicitly perform…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Mark Boss , Varun Jampani , Raphael Braun , Ce Liu , Jonathan T. Barron , Hendrik P. A. Lensch

Human visual recognition is a sparse process, where only a few salient visual cues are attended to rather than traversing every detail uniformly. However, most current vision networks follow a dense paradigm, processing every single visual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Ziteng Gao , Zhan Tong , Limin Wang , Mike Zheng Shou

Image deblurring aims to restore the detailed texture information or structures from blurry images, which has become an indispensable step in many computer vision tasks. Although various methods have been proposed to deal with the image…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Yanni Zhang , Qiang Li , Miao Qi , Di Liu , Jun Kong , Jianzhong Wang

The multi-plane representation has been highlighted for its fast training and inference across static and dynamic neural radiance fields. This approach constructs relevant features via projection onto learnable grids and interpolating…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Mingyu Kim , Jun-Seong Kim , Se-Young Yun , Jin-Hwa Kim

Neural radiance fields (NeRFs) have become a ubiquitous tool for modeling scene appearance and geometry from multiview imagery. Recent work has also begun to explore how to use additional supervision from lidar or depth sensor measurements…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Anagh Malik , Parsa Mirdehghan , Sotiris Nousias , Kiriakos N. Kutulakos , David B. Lindell

Light Field Networks, the re-formulations of radiance fields to oriented rays, are magnitudes faster than their coordinate network counterparts, and provide higher fidelity with respect to representing 3D structures from 2D observations.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Heng Yu , Joel Julin , Zoltan A. Milacski , Koichiro Niinuma , Laszlo A. Jeni

Parametric feature grid encodings have gained significant attention as an encoding approach for neural fields since they allow for much smaller MLPs, which significantly decreases the inference time of the models. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Mihir Mahajan , Florian Hofherr , Daniel Cremers

Low-light image enhancement remains a challenging problem due to severe noise, color distortion, contrast degradation, and loss of structural details under insufficient illumination. Existing methods typically apply uniform enhancement…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Bibhabasu Debnath , Sahana Ray , Sanjay Ghosh

Light fields preserve angular information which can be retargeted to multi-panel depth displays. Due to limited aperture size and constrained spatial-angular sampling of many light field capture systems, the displayed light fields provide…

Image and Video Processing · Electrical Eng. & Systems 2017-10-09 Basel Salahieh , Seth Hunter , Yi Wu , Oscar Nestares