English
Related papers

Related papers: Adapting Human Mesh Recovery with Vision-Language …

200 papers

There has been great progress in human 3D mesh recovery and great interest in learning about the world from consumer video data. Unfortunately current methods for 3D human mesh recovery work rather poorly on consumer video data, since on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Chris Rockwell , David F. Fouhey

Single-image human mesh recovery is a challenging task due to the ill-posed nature of simultaneous body shape, pose, and camera estimation. Existing estimators work well on images taken from afar, but they break down as the person moves…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Shengze Wang , Jiefeng Li , Tianye Li , Ye Yuan , Henry Fuchs , Koki Nagano , Shalini De Mello , Michael Stengel

We present a bundle-adjustment-based algorithm for recovering accurate 3D human pose and meshes from monocular videos. Unlike previous algorithms which operate on single frames, we show that reconstructing a person over an entire sequence…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Anurag Arnab , Carl Doersch , Andrew Zisserman

Recovering 3D human body shape and pose from 2D images is a challenging task due to high complexity and flexibility of human body, and relatively less 3D labeled data. Previous methods addressing these issues typically rely on predicting…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Pengfei Yao , Zheng Fang , Fan Wu , Yao Feng , Jiwei Li

Most of the recent deep learning-based 3D human pose and mesh estimation methods regress the pose and shape parameters of human mesh models, such as SMPL and MANO, from an input image. The first weakness of these methods is an appearance…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Hongsuk Choi , Gyeongsik Moon , Kyoung Mu Lee

We propose a novel optimization-based paradigm for 3D human model fitting on images and scans. In contrast to existing approaches that directly regress the parameters of a low-dimensional statistical body model (e.g. SMPL) from input…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Enric Corona , Gerard Pons-Moll , Guillem Alenyà , Francesc Moreno-Noguer

The best performing methods for 3D human pose estimation from monocular images require large amounts of in-the-wild 2D and controlled 3D pose annotated datasets which are costly and require sophisticated systems to acquire. To reduce this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Rahul Mitra , Nitesh B. Gundavarapu , Abhishek Sharma , Arjun Jain

Recovering a textured 3D mesh from a monocular image is highly challenging, particularly for in-the-wild objects that lack 3D ground truths. In this work, we present MeshInversion, a novel framework to improve the reconstruction by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Junzhe Zhang , Daxuan Ren , Zhongang Cai , Chai Kiat Yeo , Bo Dai , Chen Change Loy

3D human reconstruction and animation are long-standing topics in computer graphics and vision. However, existing methods typically rely on sophisticated dense-view capture and/or time-consuming per-subject optimization procedures. To…

Graphics · Computer Science 2025-06-04 Zhiyuan Yu , Zhe Li , Hujun Bao , Can Yang , Xiaowei Zhou

Existing 3D human pose estimation algorithms trained on distortion-free datasets suffer performance drop when applied to new scenarios with a specific camera distortion. In this paper, we propose a simple yet effective model for 3D human…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Hanbyel Cho , Yooshin Cho , Jaemyung Yu , Junmo Kim

In general, hand pose estimation aims to improve the robustness of model performance in the real-world scenes. However, it is difficult to enhance the robustness since existing datasets are obtained in restricted environments to annotate 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Bosang Kim , Jonghyun Kim , Hyotae Lee , Lanying Jin , Jeongwon Ha , Dowoo Kwon , Jungpyo Kim , Wonhyeok Im , KyungMin Jin , Jungho Lee

Recent approaches to jointly reconstruct 3D humans and objects from a single RGB image represent 3D shapes with template-based or coarse models, which fail to capture details of loose clothing on human bodies. In this paper, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ayushi Dutta , Marco Pesavento , Marco Volino , Adrian Hilton , Armin Mustafa

Accurately recovering human pose and appearance from video is an essential component of scene reconstruction, with applications to motion capture, motion prediction, virtual reality, and digital twinning. Despite significant interest in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yeheng Zong , Pou-Chun Kung , Yike Pan , Seth Isaacson , Yizhou Chen , Ram Vasudevan , Katherine A. Skinner

Driven by recent computer vision and robotic applications, recovering 3D human poses has become increasingly important and attracted growing interests. In fact, completing this task is quite challenging due to the diverse appearances,…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Keze Wang , Liang Lin , Chenhan Jiang , Chen Qian , Pengxu Wei

With 3D data rapidly emerging as an important form of multimedia information, 3D human mesh recovery technology has also advanced accordingly. However, current methods mainly focus on handling humans wearing tight clothing and perform…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yunqi Gao , Leyuan Liu , Yuhan Li , Changxin Gao , Yuanyuan Liu , Jingying Chen

Current 6D object pose methods consist of deep CNN models fully optimized for a single object but with its architecture standardized among objects with different shapes. In contrast to previous works, we explicitly exploit each object's…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Pedro Castro , Anil Armagan , Tae-Kyun Kim

How can we effectively utilise the 2D monocular image information for recovering the 6D pose (6-DoF) of the visual objects? Deep learning has shown to be effective for robust and real-time monocular pose estimation. Oftentimes, the network…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Di Wu , Yihao Chen , Xianbiao Qi , Yongjian Yu , Weixuan Chen , Rong Xiao

We address the problem of recovering the 3D geometry of a human face from a set of facial images in multiple views. While recent studies have shown impressive progress in 3D Morphable Model (3DMM) based facial reconstruction, the settings…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fanzi Wu , Linchao Bao , Yajing Chen , Yonggen Ling , Yibing Song , Songnan Li , King Ngi Ngan , Wei Liu

We propose a viewpoint invariant model for 3D human pose estimation from a single depth image. To achieve this, our discriminative model embeds local regions into a learned viewpoint invariant feature space. Formulated as a multi-task…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Albert Haque , Boya Peng , Zelun Luo , Alexandre Alahi , Serena Yeung , Li Fei-Fei

Human Mesh Recovery (HMR) is an important yet challenging problem with applications across various domains including motion capture, augmented reality, and biomechanics. Accurately predicting human pose parameters from a single image…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Jaewoo Heo , George Hu , Zeyu Wang , Serena Yeung-Levy