English
Related papers

Related papers: Self-Supervised 3D Face Reconstruction via Conditi…

200 papers

Estimation of 3D human pose from monocular image has gained considerable attention, as a key step to several human-centric applications. However, generalizability of human pose estimation models developed using supervision on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Jogendra Nath Kundu , Siddharth Seth , Rahul M , Mugalodi Rakesh , R. Venkatesh Babu , Anirban Chakraborty

Purpose: To develop a model-based deep neural network for high-quality image reconstruction of undersampled multi-coil chemical exchange saturation transfer (CEST) data. Theory and Methods: Inspired by the variational network, the CEST…

Medical Physics · Physics 2023-05-26 Jianping Xu , Tao Zu , Yi-Cheng Hsu , Xiaoli Wang , Kannie W. Y. Chan , Yi Zhang

3D face reconstruction from a single 2D image is a challenging problem with broad applications. Recent methods typically aim to learn a CNN-based 3D face model that regresses coefficients of 3D Morphable Model (3DMM) from 2D images to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-05 Xiaoguang Tu , Jian Zhao , Zihang Jiang , Yao Luo , Mei Xie , Yang Zhao , Linxiao He , Zheng Ma , Jiashi Feng

Estimating 3D human texture from a single image is essential in graphics and vision. It requires learning a mapping function from input images of humans with diverse poses into the parametric (UV) space and reasonably hallucinating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Said Fahri Altindis , Adil Meric , Yusuf Dalva , Ugur Gudukbay , Aysegul Dundar

In this paper, a feature boosting network is proposed for estimating 3D hand pose and 3D body pose from a single RGB image. In this method, the features learned by the convolutional layers are boosted with a new long short-term…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Jun Liu , Henghui Ding , Amir Shahroudy , Ling-Yu Duan , Xudong Jiang , Gang Wang , Alex C. Kot

Recent learning-based approaches, in which models are trained by single-view images have shown promising results for monocular 3D face reconstruction, but they suffer from the ill-posed face pose and depth ambiguity issue. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Jiaxiang Shang , Tianwei Shen , Shiwei Li , Lei Zhou , Mingmin Zhen , Tian Fang , Long Quan

Purpose: To substantially shorten the acquisition time required for quantitative 3D chemical exchange saturation transfer (CEST) and semisolid magnetization transfer (MT) imaging and allow for rapid chemical exchange parameter map…

In this paper, we present an end-to-end learning framework for detailed 3D face reconstruction from a single image. Our approach uses a 3DMM-based coarse model and a displacement map in UV-space to represent a 3D face. Unlike previous work…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Yajing Chen , Fanzi Wu , Zeyu Wang , Yibing Song , Yonggen Ling , Linchao Bao

The goal of many computer vision systems is to transform image pixels into 3D representations. Recent popular models use neural networks to regress directly from pixels to 3D object parameters. Such an approach works well when supervision…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Nadine Rueegg , Christoph Lassner , Michael J. Black , Konrad Schindler

3D human pose and shape estimation from monocular images has been an active research area in computer vision. Existing deep learning methods for this task rely on high-resolution input, which however, is not always available in many…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Xiangyu Xu , Hao Chen , Francesc Moreno-Noguer , Laszlo A. Jeni , Fernando De la Torre

3D face reconstruction is a fundamental Computer Vision problem of extraordinary difficulty. Current systems often assume the availability of multiple facial images (sometimes from the same subject) as input, and must address a number of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Aaron S. Jackson , Adrian Bulat , Vasileios Argyriou , Georgios Tzimiropoulos

Facial expressions convey the bulk of emotional information in human communication, yet existing 3D face reconstruction methods often miss subtle affective details due to reliance on 2D supervision and lack of 3D ground truth. We propose…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Chen Ling , Henglin Shi , Hedvig Kjellström

3D face reconstruction from a single image is a challenging problem, especially under partial occlusions and extreme poses. This is because the uncertainty of the estimated 2D landmarks will affect the quality of face reconstruction. In…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Kun Li , Jing Yang , Nianhong Jiao , Jinsong Zhang , Yu-Kun Lai

Gaze behavior is an important non-verbal cue in social signal processing and human-computer interaction. In this paper, we tackle the problem of person- and head pose-independent 3D gaze estimation from remote cameras, using a multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Cristina Palmero , Javier Selva , Mohammad Ali Bagheri , Sergio Escalera

State-of-the-art methods for 3D reconstruction of faces from a single image require 2D-3D pairs of ground-truth data for supervision. Such data is costly to acquire, and most datasets available in the literature are restricted to pairs for…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Yifan Xing , Rahul Tewari , Paulo R. S. Mendonca

Depth and ego-motion estimations are essential for the localization and navigation of autonomous robots and autonomous driving. Recent studies make it possible to learn the per-pixel depth and ego-motion from the unlabeled monocular video.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Jiquan Zhong , Shijie Zhao , Wenhua Wu , Zhe Liu , Hesheng Wang

We learn a self-supervised, single-view 3D reconstruction model that predicts the 3D mesh shape, texture and camera pose of a target object with a collection of 2D images and silhouettes. The proposed method does not necessitate 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xueting Li , Sifei Liu , Kihwan Kim , Shalini De Mello , Varun Jampani , Ming-Hsuan Yang , Jan Kautz

Current state-of-the-art solutions for motion capture from a single camera are optimization driven: they optimize the parameters of a 3D human model so that its re-projection matches measurements in the video (e.g. person segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Hsiao-Yu Fish Tung , Hsiao-Wei Tung , Ersin Yumer , Katerina Fragkiadaki

This paper presents an algorithm to reconstruct temporally consistent 3D meshes of deformable object instances from videos in the wild. Without requiring annotations of 3D mesh, 2D keypoints, or camera pose for each video frame, we pose…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Xueting Li , Sifei Liu , Shalini De Mello , Kihwan Kim , Xiaolong Wang , Ming-Hsuan Yang , Jan Kautz

Monocular 3D face reconstruction plays a crucial role in avatar generation, with significant demand in web-related applications such as generating virtual financial advisors in FinTech. Current reconstruction methods predominantly rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Haoxin Xu , Zezheng Zhao , Yuxin Cao , Chunyu Chen , Hao Ge , Ziyao Liu