English
Related papers

Related papers: Deep Surface Light Fields

200 papers

We present a novel semantic light field (LF) refocusing technique that can achieve unprecedented see-through quality. Different from prior art, our semantic see-through (SST) differentiates rays in their semantic meaning and depth.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Huangjie Yu , Guli Zhang , Yuanxi Ma , Yingliang Zhang , Jingyi Yu

Light field (LF) image super-resolution (SR) is a challenging problem due to its inherent ill-posed nature, where a single low-resolution (LR) input LF image can correspond to multiple potential super-resolved outcomes. Despite this…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Wentao Chao , Fuqing Duan , Xuechun Wang , Yingqian Wang , Guanghui Wang

Defocus deblurring is a challenging task due to the spatially varying nature of defocus blur. While deep learning approach shows great promise in solving image restoration problems, defocus deblurring demands accurate training data that…

Image and Video Processing · Electrical Eng. & Systems 2022-04-04 Lingyan Ruan , Bin Chen , Jizhou Li , Miuling Lam

Neural radiance fields (NeRFs) have recently emerged as a promising approach for 3D reconstruction and novel view synthesis. However, NeRF-based methods encode shape, reflectance, and illumination implicitly and this makes it challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Ruofan Liang , Jiahao Zhang , Haoda Li , Chen Yang , Yushi Guan , Nandita Vijaykumar

We present Progressively Deblurring Radiance Field (PDRF), a novel approach to efficiently reconstruct high quality radiance fields from blurry images. While current State-of-The-Art (SoTA) scene reconstruction methods achieve…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Cheng Peng , Rama Chellappa

Custom and natural lighting conditions can be emulated in images of the scene during post-editing. Extraordinary capabilities of the deep learning framework can be utilized for such purpose. Deep image relighting allows automatic photo…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Sourya Dipta Das , Nisarg A. Shah , Saikat Dutta , Himanshu Kumar

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

Neural Radiance Fields (NeRFs) encode the radiance in a scene parameterized by the scene's plenoptic function. This is achieved by using an MLP together with a mapping to a higher-dimensional space, and has been proven to capture scenes…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Siddhant Ranade , Christoph Lassner , Kai Li , Christian Haene , Shen-Chi Chen , Jean-Charles Bazin , Sofien Bouaziz

3D surface reconstruction from images is essential for numerous applications. Recently, Neural Radiance Fields (NeRFs) have emerged as a promising framework for 3D modeling. However, NeRFs require accurate camera poses as input, and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yiyang Chen , Siyan Dong , Xulong Wang , Lulu Cai , Youyi Zheng , Yanchao Yang

Neural fields, a category of neural networks trained to represent high-frequency signals, have gained significant attention in recent years due to their impressive performance in modeling complex 3D data, such as signed distance (SDFs) or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Marko Mihajlovic , Sergey Prokudin , Marc Pollefeys , Siyu Tang

Signed distance fields (SDFs) are a form of surface representation widely used in computer graphics, having applications in rendering, collision detection and modelling. In interactive media such as games, high-resolution SDFs are commonly…

Graphics · Computer Science 2022-10-13 Yu Wei Tan , Nicholas Chua , Clarence Koh , Anand Bhojan

Neural Radiance Fields (NeRF) have constituted a remarkable breakthrough in image-based 3D reconstruction. However, their implicit volumetric representations differ significantly from the widely-adopted polygonal meshes and lack support…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jiaxiang Tang , Hang Zhou , Xiaokang Chen , Tianshu Hu , Errui Ding , Jingdong Wang , Gang Zeng

Recent years have witnessed the great advances of deep neural networks (DNNs) in light field (LF) image super-resolution (SR). However, existing DNN-based LF image SR methods are developed on a single fixed degradation (e.g., bicubic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yingqian Wang , Zhengyu Liang , Longguang Wang , Jungang Yang , Wei An , Yulan Guo

In view synthesis, a neural radiance field approximates underlying density and radiance fields based on a sparse set of scene pictures. To generate a pixel of a novel view, it marches a ray through the pixel and computes a weighted sum of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Nikita Morozov , Denis Rakitin , Oleg Desheulin , Dmitry Vetrov , Kirill Struminsky

Geometric Deep Learning has recently made striking progress with the advent of continuous Deep Implicit Fields. They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Euclidean grid,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Edoardo Remelli , Artem Lukoianov , Stephan R. Richter , Benoît Guillard , Timur Bagautdinov , Pierre Baque , Pascal Fua

Automated surface segmentation is important and challenging in many medical image analysis applications. Recent deep learning based methods have been developed for various object segmentation tasks. Most of them are a classification based…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Leixin Zhou , Zisha Zhong , Abhay Shah , Bensheng Qiu , John Buatti , Xiaodong Wu

Line segments are ubiquitous in our human-made world and are increasingly used in vision tasks. They are complementary to feature points thanks to their spatial extent and the structural information they provide. Traditional line detectors…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Rémi Pautrat , Daniel Barath , Viktor Larsson , Martin R. Oswald , Marc Pollefeys

Rendering an accurate image of an isosurface in a volumetric field typically requires large numbers of data samples. Reducing the number of required samples lies at the core of research in volume rendering. With the advent of deep learning…

Graphics · Computer Science 2022-05-31 Sebastian Weiss , Mengyu Chu , Nils Thuerey , Rüdiger Westermann

Inferring representations of 3D scenes from 2D observations is a fundamental problem of computer graphics, computer vision, and artificial intelligence. Emerging 3D-structured neural scene representations are a promising approach to 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Vincent Sitzmann , Semon Rezchikov , William T. Freeman , Joshua B. Tenenbaum , Fredo Durand

We present a fast and simple technique to convert images into a radiance surface-based scene representation. Building on existing radiance volume reconstruction algorithms, we introduce a subtle yet impactful modification of the loss…