English
Related papers

Related papers: Single-Image 3D Human Digitization with Shape-Guid…

200 papers

Existing works in single-image human reconstruction suffer from weak generalizability due to insufficient training data or 3D inconsistencies for a lack of comprehensive multi-view knowledge. In this paper, we introduce MagicMan, a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xu He , Xiaoyu Li , Di Kang , Jiangnan Ye , Chaopeng Zhang , Liyang Chen , Xiangjun Gao , Han Zhang , Zhiyong Wu , Haolin Zhuang

Capturing and editing full head performances enables the creation of virtual characters with various applications such as extended reality and media production. The past few years witnessed a steep rise in the photorealism of human head…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Mohit Mendiratta , Xingang Pan , Mohamed Elgharib , Kartik Teotia , Mallikarjun B R , Ayush Tewari , Vladislav Golyanik , Adam Kortylewski , Christian Theobalt

We present DINAR, an approach for creating realistic rigged fullbody avatars from single RGB images. Similarly to previous works, our method uses neural textures combined with the SMPL-X body model to achieve photo-realistic quality of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 David Svitov , Dmitrii Gudkov , Renat Bashirov , Victor Lempitsky

In this work, we introduce Unique3D, a novel image-to-3D framework for efficiently generating high-quality 3D meshes from single-view images, featuring state-of-the-art generation fidelity and strong generalizability. Previous methods based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Kailu Wu , Fangfu Liu , Zhihan Cai , Runjie Yan , Hanyang Wang , Yating Hu , Yueqi Duan , Kaisheng Ma

Human video synthesis aims to create lifelike characters in various environments, with wide applications in VR, storytelling, and content creation. While 2D diffusion-based methods have made significant progress, they struggle to generalize…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Liyuan Cui , Xiaogang Xu , Wenqi Dong , Zesong Yang , Hujun Bao , Zhaopeng Cui

We propose a method for in-hand 3D scanning of an unknown object with a monocular camera. Our method relies on a neural implicit surface representation that captures both the geometry and the appearance of the object, however, by contrast…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Shreyas Hampali , Tomas Hodan , Luan Tran , Lingni Ma , Cem Keskin , Vincent Lepetit

Recent progress in single-image 3D generation highlights the importance of multi-view coherency, leveraging 3D priors from large-scale diffusion models pretrained on Internet-scale images. However, the aspect of novel-view diversity remains…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Sangmin Woo , Byeongjun Park , Hyojun Go , Jin-Young Kim , Changick Kim

Object-level manipulation, relocating or reorienting objects in images or videos while preserving scene realism, is central to film post-production, AR, and creative editing. Yet existing methods struggle to jointly achieve three core…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Penghui Ruan , Bojia Zi , Xianbiao Qi , Youze Huang , Rong Xiao , Pichao Wang , Jiannong Cao , Yuhui Shi

We present Boosting3D, a multi-stage single image-to-3D generation method that can robustly generate reasonable 3D objects in different data domains. The point of this work is to solve the view consistency problem in single image-guided 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Kai Yu , Jinlin Liu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

Novel view synthesis from a single image has been a cornerstone problem for many Virtual Reality applications that provide immersive experiences. However, most existing techniques can only synthesize novel views within a limited range of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hung-Yu Tseng , Qinbo Li , Changil Kim , Suhib Alsisan , Jia-Bin Huang , Johannes Kopf

We present FaceLift, a novel feed-forward approach for generalizable high-quality 360-degree 3D head reconstruction from a single image. Our pipeline first employs a multi-view latent diffusion model to generate consistent side and back…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Weijie Lyu , Yi Zhou , Ming-Hsuan Yang , Zhixin Shu

While 2D diffusion models have achieved remarkable success in identity-preserving personalization, extending this capability to 3D assets remains a significant challenge due to the complexities of multi-view consistency and spatial control.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jinxin Ai , Matthias Nießner , Ziya Erkoç

Single-image 3D human reconstruction aims to reconstruct the 3D textured surface of the human body given a single image. While implicit function-based methods recently achieved reasonable reconstruction performance, they still bear…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Gyumin Shim , Minsoo Lee , Jaegul Choo

In this work, we focus on synthesizing high-fidelity novel view images for arbitrary human performers, given a set of sparse multi-view images. It is a challenging task due to the large variation among articulated body poses and heavy…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jianchuan Chen , Wentao Yi , Liqian Ma , Xu Jia , Huchuan Lu

We present a method that enables synthesizing novel views and novel poses of arbitrary human performers from sparse multi-view images. A key ingredient of our method is a hybrid appearance blending module that combines the advantages of the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Youngjoong Kwon , Dahun Kim , Duygu Ceylan , Henry Fuchs

A unique challenge in creating high-quality animatable and relightable 3D avatars of people is modeling human eyes. The challenge of synthesizing eyes is multifold as it requires 1) appropriate representations for the various components of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Gengyan Li , Abhimitra Meka , Franziska Müller , Marcel C. Bühler , Otmar Hilliges , Thabo Beeler

Benefiting from the significant advancements in text-to-image diffusion models, research in personalized image generation, particularly customized portrait generation, has also made great strides recently. However, existing methods either…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Benxiang Zhai , Yifang Xu , Guofeng Zhang , Yang Li , Sidan Du

We propose a Transformer-based framework for 3D human texture estimation from a single image. The proposed Transformer is able to effectively exploit the global information of the input image, overcoming the limitations of existing methods…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Xiangyu Xu , Chen Change Loy

We present a new approach for synthesizing novel views of people in new poses. Our novel differentiable renderer enables the synthesis of highly realistic images from any viewpoint. Rather than operating over mesh-based structures, our…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Guillaume Rochette , Chris Russell , Richard Bowden

We present MVD-Fusion: a method for single-view 3D inference via generative modeling of multi-view-consistent RGB-D images. While recent methods pursuing 3D inference advocate learning novel-view generative models, these generations are not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Hanzhe Hu , Zhizhuo Zhou , Varun Jampani , Shubham Tulsiani