English
Related papers

Related papers: Prior-Guided Multi-View 3D Head Reconstruction

200 papers

Current popular backbones in computer vision, such as Vision Transformers (ViT) and ResNets are trained to perceive the world from 2D images. However, to more effectively understand 3D structural priors in 2D backbones, we propose Mask3D to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Ji Hou , Xiaoliang Dai , Zijian He , Angela Dai , Matthias Nießner

Neural implicit functions have emerged as a powerful representation for surfaces in 3D. Such a function can encode a high quality surface with intricate details into the parameters of a deep neural network. However, optimizing for the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Wang Yifan , Shihao Wu , Cengiz Oztireli , Olga Sorkine-Hornung

In this work, we aim to address the 3D scene stylization problem - generating stylized images of the scene at arbitrary novel view angles. A straightforward solution is to combine existing novel view synthesis and image/video style transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Pei-Ze Chiang , Meng-Shiun Tsai , Hung-Yu Tseng , Wei-sheng Lai , Wei-Chen Chiu

Recently, it has shown that priors are vital for neural implicit functions to reconstruct high-quality surfaces from multi-view RGB images. However, current priors require large-scale pre-training, and merely provide geometric clues without…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Wenyuan Zhang , Emily Yue-ting Jia , Junsheng Zhou , Baorui Ma , Kanle Shi , Yu-Shen Liu , Zhizhong Han

We introduce a method that can learn to predict scene-level implicit functions for 3D reconstruction from posed RGBD data. At test time, our system maps a previously unseen RGB image to a 3D reconstruction of a scene via implicit functions.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Nilesh Kulkarni , Linyi Jin , Justin Johnson , David F. Fouhey

3D biometric techniques on finger traits have become a new trend and have demonstrated a powerful ability for recognition and anti-counterfeiting. Existing methods follow an explicit 3D pipeline that reconstructs the models first and then…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Hongbin Xu , Junduan Huang , Yuer Ma , Zifeng Li , Wenxiong Kang

Deep image prior (DIP) is a recently proposed technique for solving imaging inverse problems by fitting the reconstructed images to the output of an untrained convolutional neural network. Unlike pretrained feedforward neural networks, the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Kevin Zhang , Mingyang Xie , Maharshi Gor , Yi-Ting Chen , Yvonne Zhou , Christopher A. Metzler

We present a self-supervised learning approach to learning monocular 3D face reconstruction with a pose guidance network (PGN). First, we unveil the bottleneck of pose estimation in prior parametric 3D face learning methods, and propose to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Pengpeng Liu , Xintong Han , Michael Lyu , Irwin King , Jia Xu

We present a novel approach for recovering 3D shape and view dependent appearance from a few colored images, enabling efficient 3D reconstruction and novel view synthesis. Our method learns an implicit neural representation in the form of a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Mae Younes , Amine Ouasfi , Adnane Boukhayma

Reconstruction of a 3D shape from a single 2D image is a classical computer vision problem, whose difficulty stems from the inherent ambiguity of recovering occluded or only partially observed surfaces. Recent methods address this challenge…

Computer Vision and Pattern Recognition · Computer Science 2020-02-04 Yuan Yao , Nico Schertler , Enrique Rosales , Helge Rhodin , Leonid Sigal , Alla Sheffer

The problem of modeling an animatable 3D human head avatar under light-weight setups is of significant importance but has not been well solved. Existing 3D representations either perform well in the realism of portrait images synthesis or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Xiaochen Zhao , Lizhen Wang , Jingxiang Sun , Hongwen Zhang , Jinli Suo , Yebin Liu

Recent advances in deep learning have led to a data-centric intelligence i.e. artificially intelligent models unlocking the potential to ingest a large amount of data and be really good at performing digital tasks such as text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Muhammad Zubair Irshad

Image restoration problems are typically ill-posed requiring the design of suitable priors. These priors are typically hand-designed and are fully instantiated throughout the process. In this paper, we introduce a novel framework for…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Raied Aljadaany , Dipan K. Pal , Marios Savvides

Unsupervised deep learning methods for solving audio restoration problems extensively rely on carefully tailored neural architectures that carry strong inductive biases for defining priors in the time or spectral domain. In this context,…

The ability of deep image prior (DIP) to recover high-quality images from incomplete or corrupted measurements has made it popular in inverse problems in image restoration and medical imaging including magnetic resonance imaging (MRI).…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Shijun Liang , Evan Bell , Qing Qu , Rongrong Wang , Saiprasad Ravishankar

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

We present Neural Kernel Fields: a novel method for reconstructing implicit 3D shapes based on a learned kernel ridge regression. Our technique achieves state-of-the-art results when reconstructing 3D objects and large scenes from sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Francis Williams , Zan Gojcic , Sameh Khamis , Denis Zorin , Joan Bruna , Sanja Fidler , Or Litany

Blind face restoration methods have shown remarkable performance, particularly when trained on large-scale synthetic datasets with supervised learning. These datasets are often generated by simulating low-quality face images with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tianshu Kuai , Sina Honari , Igor Gilitschenski , Alex Levinshtein

3D surface reconstruction from multi-view images is essential for scene understanding and interaction. However, complex indoor scenes pose challenges such as ambiguity due to limited observations. Recent implicit surface representations,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Xulong Wang , Siyan Dong , Youyi Zheng , Yanchao Yang

Existing methods for single-view 3D object reconstruction directly learn to transform image features into 3D representations. However, these methods are vulnerable to images containing noisy backgrounds and heavy occlusions because the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Shuo Yang , Min Xu , Haozhe Xie , Stuart Perry , Jiahao Xia