English
Related papers

Related papers: High-Quality 3D Head Reconstruction from Any Singl…

200 papers

Creating a 360{\deg} parametric model of a human head is a very challenging task. While recent advancements have demonstrated the efficacy of leveraging synthetic data for building such parametric head models, their performance remains…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yuxiao He , Yiyu Zhuang , Yanwen Wang , Yao Yao , Siyu Zhu , Xiaoyu Li , Qi Zhang , Xun Cao , Hao Zhu

Human head detection, keypoint estimation, and 3D head model fitting are essential tasks with many applications. However, traditional real-world datasets often suffer from bias, privacy, and ethical concerns, and they have been recorded in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Orest Kupyn , Eugene Khvedchenia , Christian Rupprecht

State-of-the-art methods for 3D reconstruction of faces from a single image require 2D-3D pairs of ground-truth data for supervision. Such data is costly to acquire, and most datasets available in the literature are restricted to pairs for…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Yifan Xing , Rahul Tewari , Paulo R. S. Mendonca

Recent diffusion-based Single-image 3D portrait generation methods typically employ 2D diffusion models to provide multi-view knowledge, which is then distilled into 3D representations. However, these methods usually struggle to produce…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Haoran Wei , Wencheng Han , Xingping Dong , Jianbing Shen

We propose ID-to-3D, a method to generate identity- and text-guided 3D human heads with disentangled expressions, starting from even a single casually captured in-the-wild image of a subject. The foundation of our approach is anchored in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Francesca Babiloni , Alexandros Lattas , Jiankang Deng , Stefanos Zafeiriou

Despite having tremendous progress in image-to-3D generation, existing methods still struggle to produce multi-view consistent images with high-resolution textures in detail, especially in the paradigm of 2D diffusion that lacks 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Haibo Yang , Yang Chen , Yingwei Pan , Ting Yao , Zhineng Chen , Chong-Wah Ngo , Tao Mei

We propose a novel framework to reconstruct super-resolution human shape from a single low-resolution input image. The approach overcomes limitations of existing approaches that reconstruct 3D human shape from a single image, which require…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Marco Pesavento , Marco Volino , Adrian Hilton

With the increasing demands of applications in virtual reality such as 3D films, virtual Human-Machine Interactions and virtual agents, the analysis of 3D human face analysis is considered to be more and more important as a fundamental step…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Shu Zhang , Hui Yu , Ting Wang , Junyu Dong , Honghai Liu

In this paper, we present a large-scale detailed 3D face dataset, FaceScape, and the corresponding benchmark to evaluate single-view facial 3D reconstruction. By training on FaceScape data, a novel algorithm is proposed to predict elaborate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Hao Zhu , Haotian Yang , Longwei Guo , Yidi Zhang , Yanru Wang , Mingkai Huang , Menghua Wu , Qiu Shen , Ruigang Yang , Xun Cao

Occlusions are a common occurrence in unconstrained face images. Single image 3D reconstruction from such face images often suffers from corruption due to the presence of occlusions. Furthermore, while a plurality of 3D reconstructions is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Rahul Dey , Vishnu Naresh Boddeti

Recent learning approaches that implicitly represent surface geometry using coordinate-based neural representations have shown impressive results in the problem of multi-view 3D reconstruction. The effectiveness of these techniques is,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Eduard Ramon , Gil Triginer , Janna Escur , Albert Pumarola , Jaime Garcia , Xavier Giro-i-Nieto , Francesc Moreno-Noguer

We present RodinHD, which can generate high-fidelity 3D avatars from a portrait image. Existing methods fail to capture intricate details such as hairstyles which we tackle in this paper. We first identify an overlooked problem of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Bowen Zhang , Yiji Cheng , Chunyu Wang , Ting Zhang , Jiaolong Yang , Yansong Tang , Feng Zhao , Dong Chen , Baining Guo

Single-view 3D hair reconstruction is challenging, due to the wide range of shape variations among diverse hairstyles. Current state-of-the-art methods are specialized in recovering un-braided 3D hairs and often take braided styles as their…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Yujian Zheng , Yuda Qiu , Leyang Jin , Chongyang Ma , Haibin Huang , Di Zhang , Pengfei Wan , Xiaoguang Han

Recently, deep learning based 3D face reconstruction methods have shown promising results in both quality and efficiency.However, training deep neural networks typically requires a large volume of data, whereas face images with ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Yu Deng , Jiaolong Yang , Sicheng Xu , Dong Chen , Yunde Jia , Xin Tong

We present an algorithm that takes a single frame of a person's face from a depth camera, e.g., Kinect, and produces a high-resolution 3D mesh of the input face. We leverage a dataset of 3D face meshes of 1204 distinct individuals ranging…

Computer Vision and Pattern Recognition · Computer Science 2018-09-14 Shu Liang , Ira Kemelmacher-Shlizerman , Linda G. Shapiro

Efficiently generating a freestyle 3D portrait with high quality and 3D-consistency is a promising yet challenging task. The portrait styles generated by most existing methods are usually restricted by their 3D generators, which are learned…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Tianxiang Ma , Kang Zhao , Jianxin Sun , Yingya Zhang , Jing Dong

Recent breakthroughs in single-image 3D portrait reconstruction have enabled telepresence systems to stream 3D portrait videos from a single camera in real-time, potentially democratizing telepresence. However, per-frame 3D reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Shengze Wang , Xueting Li , Chao Liu , Matthew Chan , Michael Stengel , Josef Spjut , Henry Fuchs , Shalini De Mello , Koki Nagano

What's the most accurate 3D model of your face you can obtain while sitting at your desk? We attempt to answer this question in our work. High fidelity face reconstructions have so far been limited to either studio settings or through…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Shubham Agrawal , Anuj Pahuja , Simon Lucey

Generating multi-view human images from a single view is a complex and significant challenge. Although recent advancements in multi-view object generation have shown impressive results with diffusion models, novel view synthesis for humans…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Yu Feng , Shunsi Zhang , Jian Shu , Hanfeng Zhao , Guoliang Pang , Chi Zhang , Hao Wang

We propose a compositional method for constructing a complete 3D head avatar from a single image. Prior one-shot holistic approaches frequently fail to produce realistic hair dynamics during animation, largely due to inadequate decoupling…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yuan Sun , Xuan Wang , WeiLi Zhang , Wenxuan Zhang , Yu Guo , Fei Wang