English
Related papers

Related papers: Light Field Synthesis by Training Deep Network in …

200 papers

This paper tackles high-dynamic-range (HDR) image reconstruction given only a single low-dynamic-range (LDR) image as input. While the existing methods focus on minimizing the mean-squared-error (MSE) between the target and reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Kenta Moriwaki , Ryota Yoshihashi , Rei Kawakami , Shaodi You , Takeshi Naemura

We present a new neural representation, called Neural Ray (NeuRay), for the novel view synthesis task. Recent works construct radiance fields from image features of input views to render novel view images, which enables the generalization…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yuan Liu , Sida Peng , Lingjie Liu , Qianqian Wang , Peng Wang , Christian Theobalt , Xiaowei Zhou , Wenping Wang

In recent years, the development of Neural Radiance Fields has enabled a previously unseen level of photo-realistic 3D reconstruction of scenes and objects from multi-view camera data. However, previous methods use an oversimplified pinhole…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yi Hua , Christoph Lassner , Carsten Stoll , Iain Matthews

Most existing super-resolution methods do not perform well in real scenarios due to lack of realistic training data and information loss of the model input. To solve the first problem, we propose a new pipeline to generate realistic…

Image and Video Processing · Electrical Eng. & Systems 2019-05-30 Xiangyu Xu , Yongrui Ma , Wenxiu Sun

Neural Radiance Fields (NeRFs) have become increasingly popular because of their impressive ability for novel view synthesis. However, their effectiveness is hindered by the Rolling Shutter (RS) effects commonly found in most camera…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Muyao Niu , Tong Chen , Yifan Zhan , Zhuoxiao Li , Xiang Ji , Yinqiang Zheng

We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs. Existing neural rendering (NR) does not explicitly model the physical rendering process and hence has limited…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Zhang Chen , Anpei Chen , Guli Zhang , Chengyuan Wang , Yu Ji , Kiriakos N. Kutulakos , Jingyi Yu

Light field (LF) imaging, which captures both spatial and angular information of a scene, is undoubtedly beneficial to numerous applications. Although various techniques have been proposed for LF acquisition, achieving both angularly and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Trung-Hieu Tran , Jan Berberich , Sven Simon

We propose a novel approach to synthesizing images that are effective for training object detectors. Starting from a small set of real images, our algorithm estimates the rendering parameters required to synthesize similar images given a…

Computer Vision and Pattern Recognition · Computer Science 2015-06-30 Artem Rozantsev , Vincent Lepetit , Pascal Fua

Currently, image generation and synthesis have remarkably progressed with generative models. Despite photo-realistic results, intrinsic discrepancies are still observed in the frequency domain. The spectral discrepancy appeared not only in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Seokjun Lee , Seung-Won Jung , Hyunseok Seo

Deep networks are increasingly being applied to problems involving image synthesis, e.g., generating images from textual descriptions and reconstructing an input image from a compact representation. Supervised training of image-synthesis…

Machine Learning · Computer Science 2017-01-25 Jake Snell , Karl Ridgeway , Renjie Liao , Brett D. Roads , Michael C. Mozer , Richard S. Zemel

The quality of images captured outdoors is often affected by the weather. One factor that interferes with sight is rain, which can obstruct the view of observers and computer vision applications that rely on those images. The work aims to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 He-Hao Liao , Yan-Tsung Peng , Wen-Tao Chu , Ping-Chun Hsieh , Chung-Chi Tsai

In this paper, we introduce a novel deep neural network suitable for multi-scale analysis and propose efficient model-agnostic methods that help the network extract information from high-frequency domains to reconstruct clearer images. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Hyungmin Roh , Myungjoo Kang

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis results. However, they are slow to render, requiring hundreds of network evaluations per pixel to approximate a volume rendering integral. Baking NeRFs into explicit…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Benjamin Attal , Jia-Bin Huang , Michael Zollhoefer , Johannes Kopf , Changil Kim

Compression is an important task for many practical applications of light fields. Although previous work has proposed numerous methods for efficient light field compression, the effect of view selection on this task is not well exploited.…

Image and Video Processing · Electrical Eng. & Systems 2022-12-26 Yang Chen , Martin Alain , Aljosa Smolic

Recovering 3D geometry of underwater scenes is challenging because of non-linear refraction of light at the water-air interface caused by the camera housing. We present a light field-based approach that leverages properties of angular…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Yuqi Ding , Zhang Chen , Yu Ji , Jingyi Yu , Jinwei Ye

The current existing deep image super-resolution methods usually assume that a Low Resolution (LR) image is bicubicly downscaled of a High Resolution (HR) image. However, such an ideal bicubic downsampling process is different from the real…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Rao Muhammad Umer , Christian Micheloni

Neural Radiance Fields, or NeRFs, have drastically improved novel view synthesis and 3D reconstruction for rendering. NeRFs achieve impressive results on object-centric reconstructions, but the quality of novel view synthesis with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Georgios Kopanas , George Drettakis

Since their introduction more than two decades ago, light fields have gained considerable interest in graphics and vision communities due to their ability to provide the user with interactive visual content. One of the earliest and most…

Graphics · Computer Science 2019-10-11 Martin Alain , Weston Aenchbacher , Aljosa Smolic

Unlike opaque object, novel view synthesis of transparent object is a challenging task, because transparent object refracts light of background causing visual distortions on the transparent object surface along the viewpoint change.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Heechan Yoon , Seungkyu Lee

With the availability of commercial Light Field (LF) cameras, LF imaging has emerged as an up and coming technology in computational photography. However, the spatial resolution is significantly constrained in commercial microlens based LF…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Aupendu Kar , Suresh Nehra , Jayanta Mukhopadhyay , Prabir Kumar Biswas