English
Related papers

Related papers: DeepShadow: Neural Shape from Shadow

200 papers

This paper presents an uncalibrated deep neural network framework for the photometric stereo problem. For training models to solve the problem, existing neural network-based methods either require exact light directions or ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

Depth estimation is of critical interest for scene understanding and accurate 3D reconstruction. Most recent approaches in depth estimation with deep learning exploit geometrical structures of standard sharp images to predict corresponding…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Marcela Carvalho , Bertrand Le Saux , Pauline Trouvé-Peloux , Andrés Almansa , Frédéric Champagnat

One challenge that remains open in 3D deep learning is how to efficiently represent 3D data to feed deep networks. Recent works have relied on volumetric or point cloud representations, but such approaches suffer from a number of issues…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Sridha Sridharan , Simon Lucey , Anders Eriksson , Clinton Fookes

3D face reconstruction from a single image is a classical and challenging problem, with wide applications in many areas. Inspired by recent works in face animation from RGB-D or monocular video inputs, we develop a novel method for…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Luo Jiang , Juyong Zhang , Bailin Deng , Hao Li , Ligang Liu

Reconstruction of the soft tissues in robotic surgery from endoscopic stereo videos is important for many applications such as intra-operative navigation and image-guided robotic surgery automation. Previous works on this task mainly rely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Yuehao Wang , Yonghao Long , Siu Hin Fan , Qi Dou

We present deep neural network methodology to reconstruct the 3d pose and shape of people, given an input RGB image. We rely on a recently introduced, expressivefull body statistical 3d human model, GHUM, trained end-to-end, and learn to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Andrei Zanfir , Eduard Gabriel Bazavan , Mihai Zanfir , William T. Freeman , Rahul Sukthankar , Cristian Sminchisescu

3D image reconstruction from a limited number of 2D images has been a long-standing challenge in computer vision and image analysis. While deep learning-based approaches have achieved impressive performance in this area, existing deep…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Nivetha Jayakumar , Tonmoy Hossain , Miaomiao Zhang

Photometric stereo, a problem of recovering 3D surface normals using images of an object captured under different lightings, has been of great interest and importance in computer vision research. Despite the success of existing traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Ashish Tiwari , Shanmuganathan Raman

In this paper, a low parameter deep learning framework utilizing the Non-metric Multi-Dimensional scaling (NMDS) method, is proposed to recover the 3D shape of 2D landmarks on a human face, in a single input image. Hence, NMDS approach is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Shima Kamyab , Zohreh Azimifar

Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues, i.e., modeling the relationship between surface orientation and intensity at each pixel. Photometric stereo prevails in superior…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yakun Ju , Kin-Man Lam , Wuyuan Xie , Huiyu Zhou , Junyu Dong , Boxin Shi

Despite significant progress made in the past few years, challenges remain for depth estimation using a single monocular image. First, it is nontrivial to train a metric-depth prediction model that can generalize well to diverse scenes…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Wei Yin , Jianming Zhang , Oliver Wang , Simon Niklaus , Simon Chen , Yifan Liu , Chunhua Shen

Existing deep learning-based shadow removal methods still produce images with shadow remnants. These shadow remnants typically exist in homogeneous regions with low-intensity values, making them untraceable in the existing image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yuhao Liu , Qing Guo , Lan Fu , Zhanghan Ke , Ke Xu , Wei Feng , Ivor W. Tsang , Rynson W. H. Lau

3D reconstruction from a single view image is a long-standing prob-lem in computer vision. Various methods based on different shape representations(such as point cloud or volumetric representations) have been proposed. However,the 3D shape…

Graphics · Computer Science 2020-03-10 Aihua Mao , Canglan Dai , Lin Gao , Ying He , Yong-jin Liu

The accurate characterisation of the 3D deformations of slender fibres and thin sheets in flow, is a key experimental challenge in the study of particle-laden flows. We propose a high-resolution, single-camera method to visualise…

Fluid Dynamics · Physics 2026-03-18 Tymoteusz Miara , Draga Pihler-Puzović , Matthias Heil , Anne Juel

We present a novel deep learning-based approach to the 3D reconstruction of clothed humans using weak supervision via 2D normal maps. Given a single RGB image or multiview images, our network infers a signed distance function (SDF)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Jane Wu , Diego Thomas , Ronald Fedkiw

Reconstructing the 3D shape of an object using several images under different light sources is a very challenging task, especially when realistic assumptions such as light propagation and attenuation, perspective viewing geometry and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Fotios Logothetis , Ignas Budvytis , Roberto Mecca , Roberto Cipolla

Scene and object reconstruction is an important problem in robotics, in particular in planning collision-free trajectories or in object manipulation. This paper compares two strategies for the reconstruction of nonvisible parts of the…

Robotics · Computer Science 2025-01-28 Rafał Staszak , Piotr Michałek , Jakub Chudziński , Marek Kopicki , Dominik Belter

Recent deep learning methods have achieved promising results in image shadow removal. However, their restored images still suffer from unsatisfactory boundary artifacts, due to the lack of degradation prior embedding and the deficiency in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Lanqing Guo , Chong Wang , Wenhan Yang , Siyu Huang , Yufei Wang , Hanspeter Pfister , Bihan Wen

Recent advancements in deep learning have yielded promising results for the image shadow removal task. However, most existing methods rely on binary pre-generated shadow masks. The binary nature of such masks could potentially lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Xinrui Wang , Lanqing Guo , Xiyu Wang , Siyu Huang , Bihan Wen