English
Related papers

Related papers: Self-calibrating Deep Photometric Stereo Networks

200 papers

We propose a novel study of generating unseen arbitrary viewpoints for infrared imagery in the non-linear feature subspace . Current methods use synthetic images and often result in blurry and distorted outputs. Our approach on the contrary…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Maliha Arif , Abhijit Mahalanobis

Most digital camera pipelines use color constancy methods to reduce the influence of illumination and camera sensor on the colors of scene objects. The highest accuracy of color correction is obtained with learning-based color constancy…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Nikola Banić , Karlo Koščević , Sven Lončarić

We present a neural network based approach to the determination of photometric redshift. The method was tested on the Sloan Digital Sky Survey Early Data Release (SDSS-EDR) reaching an accuracy comparable and, in some cases, better than SED…

We propose a novel image sampling method for differentiable image transformation in deep neural networks. The sampling schemes currently used in deep learning, such as Spatial Transformer Networks, rely on bilinear interpolation, which…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Wei Jiang , Weiwei Sun , Andrea Tagliasacchi , Eduard Trulls , Kwang Moo Yi

In this paper, we propose a unified method to jointly learn optical flow and stereo matching. Our first intuition is stereo matching can be modeled as a special case of optical flow, and we can leverage 3D geometry behind stereoscopic…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Pengpeng Liu , Irwin King , Michael Lyu , Jia Xu

Stereo video retargeting aims to resize an image to a desired aspect ratio. The quality of retargeted videos can be significantly impacted by the stereo videos spatial, temporal, and disparity coherence, all of which can be impacted by the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Hassan Imani , Md Baharul Islam , Lai-Kuan Wong

Manipulating the light source of given images is an interesting task and useful in various applications, including photography and cinematography. Existing methods usually require additional information like the geometric structure of the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Li-Wen Wang , Wan-Chi Siu , Zhi-Song Liu , Chu-Tak Li , Daniel P. K. Lun

The recent years have given rise to a large number of techniques for "looking around corners", i.e., for reconstructing occluded objects from time-resolved measurements of indirect light reflections off a wall. While the direct view of…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Jonathan Klein , Martin Laurenzis , Matthias B. Hullin , Julian Iseringhausen

We propose a learning-based network for depth map estimation from multi-view stereo (MVS) images. Our proposed network consists of three sub-networks: 1) a base network for initial depth map estimation from an unstructured stereo image…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Sizhang Dai , Weibing Huang

Dense matching is crucial for 3D scene reconstruction since it enables the recovery of scene 3D geometry from image acquisition. Deep Learning (DL)-based methods have shown effectiveness in the special case of epipolar stereo disparity…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Teng Wu , Bruno Vallet , Marc Pierrot-Deseilligny , Ewelina Rupnik

In recent years, deep neural networks have emerged as a solution for inverse imaging problems. These networks are generally trained using pairs of images: one degraded and the other of high quality, the latter being called 'ground truth'.…

Information Retrieval · Computer Science 2025-10-01 Victor Sechaud , Patrice Abry , Laurent Jacques , Julián Tachella

We introduce a novel depth estimation technique for multi-frame structured light setups using neural implicit representations of 3D space. Our approach employs a neural signed distance field (SDF), trained through self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Rukun Qiao , Hiroshi Kawasaki , Hongbin Zha

A novel approach towards depth map super-resolution using multi-view uncalibrated photometric stereo is presented. Practically, an LED light source is attached to a commodity RGB-D sensor and is used to capture objects from multiple…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Lu Sang , Bjoern Haefner , Daniel Cremers

Camera calibration is integral to robotics and computer vision algorithms that seek to infer geometric properties of the scene from visual input streams. In practice, calibration is a laborious procedure requiring specialized data…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Jiading Fang , Igor Vasiljevic , Vitor Guizilini , Rares Ambrus , Greg Shakhnarovich , Adrien Gaidon , Matthew R. Walter

Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 David Novotny , Samuel Albanie , Diane Larlus , Andrea Vedaldi

In this study, we propose a high-performance disparity (depth) estimation method using dual-pixel (DP) images with few parameters. Conventional end-to-end deep-learning methods have many parameters but do not fully exploit disparity…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Teppei Kurita , Yuhi Kondo , Legong Sun , Takayuki Sasaki , Sho Nitta , Yasuhiro Hashimoto , Yoshinori Muramatsu , Yusuke Moriuchi

We present a method to edit complex indoor lighting from a single image with its predicted depth and light source segmentation masks. This is an extremely challenging problem that requires modeling complex light transport, and disentangling…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zhengqin Li , Jia Shi , Sai Bi , Rui Zhu , Kalyan Sunkavalli , Miloš Hašan , Zexiang Xu , Ravi Ramamoorthi , Manmohan Chandraker

The reconstruction of a scene via a stereo-camera system is a two-steps process, where at first images from different cameras are matched to identify the set of point-to-point correspondences that then will actually be reconstructed in the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-15 Riccardo Beschi , Xiao Feng , Stefania Melillo , Leonardo Parisi , Lorena Postiglione

Traditional reflection removal algorithms either use a single image as input, which suffers from intrinsic ambiguities, or use multiple images from a moving camera, which is inconvenient for users. We instead propose a learning-based…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Simon Niklaus , Xuaner Cecilia Zhang , Jonathan T. Barron , Neal Wadhwa , Rahul Garg , Feng Liu , Tianfan Xue

Depth estimation from a stereo image pair has become one of the most explored applications in computer vision, with most of the previous methods relying on fully supervised learning settings. However, due to the difficulty in acquiring…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Baoru Huang , Jian-Qing Zheng , Stamatia Giannarou , Daniel S. Elson