English
Related papers

Related papers: Beyond Reconstruction: A Physics Based Neural Defe…

200 papers

Custom and natural lighting conditions can be emulated in images of the scene during post-editing. Extraordinary capabilities of the deep learning framework can be utilized for such purpose. Deep image relighting allows automatic photo…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Sourya Dipta Das , Nisarg A. Shah , Saikat Dutta , Himanshu Kumar

We propose a deep inverse rendering framework for indoor scenes. From a single RGB image of an arbitrary indoor scene, we create a complete scene reconstruction, estimating shape, spatially-varying lighting, and spatially-varying,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Zhengqin Li , Mohammad Shafiei , Ravi Ramamoorthi , Kalyan Sunkavalli , Manmohan Chandraker

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

We present RenderFormer, a neural rendering pipeline that directly renders an image from a triangle-based representation of a scene with full global illumination effects and that does not require per-scene training or fine-tuning. Instead…

Graphics · Computer Science 2025-05-29 Chong Zeng , Yue Dong , Pieter Peers , Hongzhi Wu , Xin Tong

In the field of fusing multi-spectral and panchromatic images (Pan-sharpening), the impressive effectiveness of deep neural networks has been recently employed to overcome the drawbacks of traditional linear models and boost the fusing…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Yancong Wei , Qiangqiang Yuan , Huanfeng Shen , Liangpei Zhang

Benefited from the deep learning, image Super-Resolution has been one of the most developing research fields in computer vision. Depending upon whether using a discriminator or not, a deep convolutional neural network can provide an image…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Zhi-Song Liu , Wan-Chi Siu , Li-Wen Wang , Chu-Tak Li , Marie-Paule Cani , Yui-Lam Chan

By circumventing the resolution limitations of optics, coherent diffractive imaging (CDI) and ptychography are making their way into scientific fields ranging from X-ray imaging to astronomy. Yet, the need for time consuming iterative phase…

Computational Physics · Physics 2023-10-13 Oliver Hoidn , Aashwin Ananda Mishra , Apurva Mehta

Nonlinear photonic delay systems present interesting implementation platforms for machine learning models. They can be extremely fast, offer great degrees of parallelism and potentially consume far less power than digital processors. So far…

Neural and Evolutionary Computing · Computer Science 2016-03-24 Michiel Hermans , Miguel Soriano , Joni Dambre , Peter Bienstman , Ingo Fischer

Deep learning techniques have been successfully applied in many areas of computer vision, including low-level image restoration problems. For image super-resolution, several models based on deep neural networks have been recently proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-10-16 Zhaowen Wang , Ding Liu , Jianchao Yang , Wei Han , Thomas Huang

This paper proposes a new way of regularizing an inverse problem in imaging (e.g., deblurring or inpainting) by means of a deep generative neural network. Compared to end-to-end models, such approaches seem particularly interesting since…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Thomas Oberlin , Mathieu Verm

Recent advances in deep learning have significantly improved performance of video prediction. However, state-of-the-art methods still suffer from blurriness and distortions in their future predictions, especially when there are large…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Osamu Shouno

Deep learning applied to the reconstruction of 3D shapes has seen growing interest. A popular approach to 3D reconstruction and generation in recent years has been the CNN encoder-decoder model usually applied in voxel space. However, this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Mateusz Michalkiewicz , Eugene Belilovsky , Mahsa Baktashmotlagh , Anders Eriksson

Neural rendering has received tremendous attention since the advent of Neural Radiance Fields (NeRF), and has pushed the state-of-the-art on novel-view synthesis considerably. The recent focus has been on models that overfit to a single…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Mohammed Suhail , Carlos Esteves , Leonid Sigal , Ameesh Makadia

Automatic document content processing is affected by artifacts caused by the shape of the paper, non-uniform and diverse color of lighting conditions. Fully-supervised methods on real data are impossible due to the large amount of data…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Sagnik Das , Hassan Ahmed Sial , Ke Ma , Ramon Baldrich , Maria Vanrell , Dimitris Samaras

Although there has been significant progress in neural radiance fields, an issue on dynamic illumination changes still remains unsolved. Different from relevant works that parameterize time-variant/-invariant components in scenes, subjects'…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Changyeon Won , Hyunjun Jung , Jungu Cho , Seonmi Park , Chi-Hoon Lee , Hae-Gon Jeon

We propose a novel biophysical and dichromatic reflectance model that efficiently characterises spectral skin reflectance. We show how to fit the model to multispectral face images enabling high quality estimation of diffuse and specular…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Sarah Alotaibi , William A. P. Smith

Reconstructing an object's geometry and appearance from multiple images, also known as inverse rendering, is a fundamental problem in computer graphics and vision. Inverse rendering is inherently ill-posed because the captured image is an…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Akshat Dave , Yongyi Zhao , Ashok Veeraraghavan

Illumination effects in images, specifically cast shadows and shading, have been shown to decrease the performance of deep neural networks on a large number of vision-based detection, recognition and segmentation tasks in urban driving…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Alexandra Carlson , Ram Vasudevan , Matthew Johnson-Roberson

Dense 3D reconstruction has many applications in automated driving including automated annotation validation, multimodal data augmentation, providing ground truth annotations for systems lacking LiDAR, as well as enhancing auto-labeling…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Shihao Shen , Louis Kerofsky , Varun Ravi Kumar , Senthil Yogamani

Deep neural network based methods are the state of the art in various image restoration problems. Standard supervised learning frameworks require a set of noisy measurement and clean image pairs for which a distance between the output of…

Image and Video Processing · Electrical Eng. & Systems 2021-03-31 Rihuan Ke , Carola-Bibiane Schönlieb