English
Related papers

Related papers: UnconFuse: Avatar Reconstruction from Unconstraine…

200 papers

We present a method to reconstruct time-consistent human body models from monocular videos, focusing on extremely loose clothing or handheld object interactions. Prior work in human reconstruction is either limited to tight clothing with no…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Jeff Tan , Donglai Xiang , Shubham Tulsiani , Deva Ramanan , Gengshan Yang

While high fidelity and efficiency are central to the creation of digital head avatars, recent methods relying on 2D or 3D generative models often experience limitations such as shape distortion, expression inaccuracy, and identity…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaochen Zhao , Jingxiang Sun , Lizhen Wang , Jinli Suo , Yebin Liu

Recently, implicit neural representation has been widely used to generate animatable human avatars. However, the materials and geometry of those representations are coupled in the neural network and hard to edit, which hinders their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Qifeng Chen , Rengan Xie , Kai Huang , Qi Wang , Wenting Zheng , Rong Li , Yuchi Huo

Traditionally, creating photo-realistic 3D head avatars requires a studio-level multi-view capture setup and expensive optimization during test-time, limiting the use of digital human doubles to the VFX industry or offline renderings. To…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Tobias Kirschstein , Javier Romero , Artem Sevastopolsky , Matthias Nießner , Shunsuke Saito

With the increasing demands of applications in virtual reality such as 3D films, virtual Human-Machine Interactions and virtual agents, the analysis of 3D human face analysis is considered to be more and more important as a fundamental step…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Shu Zhang , Hui Yu , Ting Wang , Junyu Dong , Honghai Liu

We present a novel framework for generating high-quality, animatable 4D avatar from a single image. While recent advances have shown promising results in 4D avatar creation, existing methods either require extensive multiview data or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fei Yin , Mallikarjun B R , Chun-Han Yao , Rafał Mantiuk , Varun Jampani

While weakly supervised multi-view face reconstruction (MVR) is garnering increased attention, one critical issue still remains open: how to effectively interact and fuse multiple image information to reconstruct high-precision 3D models.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Weiguang Zhao , Chaolong Yang , Jianan Ye , Rui Zhang , Yuyao Yan , Xi Yang , Bin Dong , Amir Hussain , Kaizhu Huang

Person re-identification (re-ID) aims to accurately re- trieve a person from a large-scale database of images cap- tured across multiple cameras. Existing works learn deep representations using a large training subset of unique per- sons.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Jubin Johnson , Shunsuke Yasugi , Yoichi Sugino , Sugiri Pranata , Shengmei Shen

Current unsupervised 2D-3D human pose estimation (HPE) methods do not work in multi-person scenarios due to perspective ambiguity in monocular images. Therefore, we present one of the first studies investigating the feasibility of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Peter Hardy , Hansung Kim

Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jie Mei , Jingxi Yu , Suzanne Romain , Craig Rose , Kelsey Magrane , Graeme LeeSon , Jenq-Neng Hwang

Creating realistic and simulation-ready 3D assets is crucial for autonomous driving research and virtual environment construction. However, existing 3D vehicle generation methods are often trained on synthetic data with significant domain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hongyuan Liu , Bochao Zou , Qiankun Liu , Haochen Yu , Qi Mei , Jianfei Jiang , Chen Liu , Cheng Bi , Zhao Wang , Xueyang Zhang , Yifei Zhan , Jiansheng Chen , Huimin Ma

In this paper, we present a method to reconstruct the world and multiple dynamic humans in 3D from a monocular video input. As a key idea, we represent both the world and multiple humans via the recently emerging 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Inhee Lee , Byungjun Kim , Hanbyul Joo

In this work, we address the problem of multi-person 3D pose estimation from a single image. A typical regression approach in the top-down setting of this problem would first detect all humans and then reconstruct each one of them…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Wen Jiang , Nikos Kolotouros , Georgios Pavlakos , Xiaowei Zhou , Kostas Daniilidis

3D human shape and pose estimation from monocular images has been an active area of research in computer vision, having a substantial impact on the development of new applications, from activity recognition to creating virtual avatars.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Xiangyu Xu , Hao Chen , Francesc Moreno-Noguer , Laszlo A. Jeni , Fernando De la Torre

In this paper, we introduce a method for reconstructing 3D humans from a single image using a biomechanically accurate skeleton model. To achieve this, we train a transformer that takes an image as input and estimates the parameters of the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yan Xia , Xiaowei Zhou , Etienne Vouga , Qixing Huang , Georgios Pavlakos

Reconstructing 3D objects from a single image remains challenging, especially under real-world occlusions. While recent diffusion-based view synthesis models can generate consistent novel views from a single RGB image, they typically assume…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yansong Qu , Shaohui Dai , Xinyang Li , Yuze Wang , You Shen , Liujuan Cao , Rongrong Ji

Large Reconstruction Models (LRMs) have recently become a popular method for creating 3D foundational models. Training 3D reconstruction models with 2D visual data traditionally requires prior knowledge of camera poses for the training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shiu-hong Kao , Xiao Li , Jinglu Wang , Yang Li , Chi-Keung Tang , Yu-Wing Tai , Yan Lu

Reconstructing non-rigid objects with physical plausibility remains a significant challenge. Existing approaches leverage differentiable rendering for per-scene optimization, recovering geometry and dynamics but requiring expensive tuning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Boyuan Wang , Xiaofeng Wang , Yongkang Li , Zheng Zhu , Yifan Chang , Angen Ye , Guosheng Zhao , Chaojun Ni , Guan Huang , Yijie Ren , Yueqi Duan , Xingang Wang

We present UP2You, the first tuning-free solution for reconstructing high-fidelity 3D clothed portraits from extremely unconstrained in-the-wild 2D photos. Unlike previous approaches that require "clean" inputs (e.g., full-body images with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zeyu Cai , Ziyang Li , Xiaoben Li , Boqian Li , Zeyu Wang , Zhenyu Zhang , Yuliang Xiu

Pixel-level Scene Understanding is one of the fundamental problems in computer vision, which aims at recognizing object classes, masks and semantics of each pixel in the given image. Since the real-world is actually video-based rather than…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Biao Wu , Shaoli Liu , Diankai Zhang , Chengjian Zheng , Si Gao , Xiaofeng Zhang , Ning Wang