English
Related papers

Related papers: S2F2: Self-Supervised High Fidelity Face Reconstru…

200 papers

We present Deep Shape-from-Template (DeepSfT), a novel Deep Neural Network (DNN) method for solving real-time automatic registration and 3D reconstruction of a deformable object viewed in a single monocular image.DeepSfT advances the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 David Fuentes-Jimenez , David Casillas-Perez , Daniel Pizarro , Toby Collins , Adrien Bartoli

In this paper, we proposed a new deep learning based dense monocular SLAM method. Compared to existing methods, the proposed framework constructs a dense 3D model via a sparse to dense mapping using learned surface normals. With single view…

Robotics · Computer Science 2019-03-25 Jiexiong Tang , John Folkesson , Patric Jensfelt

Indoor scene reconstruction from monocular images has long been sought after by augmented reality and robotics developers. Recent advances in neural field representations and monocular priors have led to remarkable results in scene-level…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Wei Dong , Chris Choy , Charles Loop , Or Litany , Yuke Zhu , Anima Anandkumar

Supervised learning with a convolutional neural network is recognized as a powerful means of image restoration. However, most such methods have been designed for application to grayscale and/or color images; therefore, they have limited…

Image and Video Processing · Electrical Eng. & Systems 2019-07-02 Ryuji Imamura , Tatsuki Itasaka , Masahiro Okuda

Visual SLAM (Simultaneous Localization and Mapping) methods typically rely on handcrafted visual features or raw RGB values for establishing correspondences between images. These features, while suitable for sparse mapping, often lead to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Chamara Saroj Weerasekera , Ravi Garg , Yasir Latif , Ian Reid

Undoubtedly, high-fidelity 3D hair is crucial for achieving realism, artistic expression, and immersion in computer graphics. While existing 3D hair modeling methods have achieved impressive performance, the challenge of achieving…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Keyu Wu , Lingchen Yang , Zhiyi Kuang , Yao Feng , Xutao Han , Yuefan Shen , Hongbo Fu , Kun Zhou , Youyi Zheng

Reflections often degrade the quality of the image by obstructing the background scene. This is not desirable for everyday users, and it negatively impacts the performance of multimedia applications that process images with reflections.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Suhong Kim , Hamed RahmaniKhezri , Seyed Mohammad Nourbakhsh , Mohamed Hefeeda

Deep neural networks (DNNs) trained on large-scale datasets have recently achieved impressive improvements in face recognition. But a persistent challenge remains to develop methods capable of handling large pose variations that are…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Xi Peng , Xiang Yu , Kihyuk Sohn , Dimitris Metaxas , Manmohan Chandraker

We develop a new algorithm to perform facial reconstruction from a given skull. This technique has forensic application in helping the identification of skeletal remains when other information is unavailable. Unlike most existing strategies…

Graphics · Computer Science 2018-10-02 Celong Liu , Xin Li

Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Clément Godard , Oisin Mac Aodha , Michael Firman , Gabriel Brostow

This paper proposes a deep neural network structure that exploits edge information in addressing representative low-level vision tasks such as layer separation and image filtering. Unlike most other deep learning strategies applied in this…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Qingnan Fan , Jiaolong Yang , Gang Hua , Baoquan Chen , David Wipf

Recently, building on the foundation of neural radiance field, various techniques have emerged to learn unsigned distance fields (UDF) to reconstruct 3D non-watertight models from multi-view images. Yet, a central challenge in UDF-based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Junkai Deng , Fei Hou , Xuhui Chen , Wencheng Wang , Ying He

We present a method for reconstructing accurate and consistent 3D hands from a monocular video. We observe that detected 2D hand keypoints and the image texture provide important cues about the geometry and texture of the 3D hand, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Zhigang Tu , Zhisheng Huang , Yujin Chen , Di Kang , Linchao Bao , Bisheng Yang , Junsong Yuan

Joint camera pose and dense geometry estimation from a set of images or a monocular video remains a challenging problem due to its computational complexity and inherent visual ambiguities. Most dense incremental reconstruction systems…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Kirill Mazur , Gwangbin Bae , Andrew J. Davison

Many methods have been proposed over the years to tackle the task of facial 3D geometry and texture recovery from a single image. Such methods often fail to provide high-fidelity texture without relying on 3D facial scans during training.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Ron Slossberg , Ibrahim Jubran , Ron Kimmel

Many modern online 3D applications and videogames rely on parametric models of human faces for creating believable avatars. However, manual reproduction of someone's facial likeness with a parametric model is difficult and time-consuming.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Igor Borovikov , Karine Levonyan , Jon Rein , Pawel Wrotek , Nitish Victor

We present an algorithm for reconstructing dense, geometrically consistent depth for all pixels in a monocular video. We leverage a conventional structure-from-motion reconstruction to establish geometric constraints on pixels in the video.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Xuan Luo , Jia-Bin Huang , Richard Szeliski , Kevin Matzen , Johannes Kopf

Recovering detailed facial geometry from a set of calibrated multi-view images is valuable for its wide range of applications. Traditional multi-view stereo (MVS) methods adopt an optimization-based scheme to regularize the matching cost.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yunze Xiao , Hao Zhu , Haotian Yang , Zhengyu Diao , Xiangju Lu , Xun Cao

Image-based depth estimation has gained significant attention in recent research on computer vision for autonomous vehicles in intelligent transportation systems. This focus stems from its cost-effectiveness and wide range of potential…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Elton F. de S. Soares , Carlos Alberto V. Campos

Removing reflection artefacts from a single image is a problem of both theoretical and practical interest, which still presents challenges because of the massively ill-posed nature of the problem. In this work, we propose a technique based…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Daniel Heydecker , Georg Maierhofer , Angelica I. Aviles-Rivero , Qingnan Fan , Dongdong Chen , Carola-Bibiane Schönlieb , Sabine Süsstrunk