English
Related papers

Related papers: Generative Approach for Probabilistic Human Mesh R…

200 papers

Generating a 3D human model from a single reference image is challenging because it requires inferring textures and geometries in invisible views while maintaining consistency with the reference image. Previous methods utilizing 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Jingbo Zhang , Xiaoyu Li , Qi Zhang , Yanpei Cao , Ying Shan , Jing Liao

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

This paper focuses on the problem of 3D human reconstruction from 2D evidence. Although this is an inherently ambiguous problem, the majority of recent works avoid the uncertainty modeling and typically regress a single estimate for a given…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Nikos Kolotouros , Georgios Pavlakos , Dinesh Jayaraman , Kostas Daniilidis

Diffusion MRI (dMRI) is an advanced imaging technique characterizing tissue microstructure and white matter structural connectivity of the human brain. The demand for high-quality dMRI data is growing, driven by the need for better…

Image and Video Processing · Electrical Eng. & Systems 2024-08-26 Xi Zhu , Wei Zhang , Yijie Li , Lauren J. O'Donnell , Fan Zhang

Diverse human motion prediction (HMP) aims to predict multiple plausible future motions given an observed human motion sequence. It is a challenging task due to the diversity of potential human motions while ensuring an accurate description…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Hua Yu , Yaqing Hou , Wenbin Pei , Qiang Zhang

Blind face restoration (BFR) is important while challenging. Prior works prefer to exploit GAN-based frameworks to tackle this task due to the balance of quality and efficiency. However, these methods suffer from poor stability and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xinmin Qiu , Congying Han , Zicheng Zhang , Bonan Li , Tiande Guo , Xuecheng Nie

Diffusion Probabilistic Models (DPMs) have been recently utilized to deal with various blind image restoration (IR) tasks, where they have demonstrated outstanding performance in terms of perceptual quality. However, the task-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Magauiya Zhussip , Iaroslav Koshelev , Stamatis Lefkimmiatis

Natural and expressive human motion generation is the holy grail of computer animation. It is a challenging task, due to the diversity of possible motion, human perceptual sensitivity to it, and the difficulty of accurately describing it.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Guy Tevet , Sigal Raab , Brian Gordon , Yonatan Shafir , Daniel Cohen-Or , Amit H. Bermano

In-bed human mesh recovery can be crucial and enabling for several healthcare applications, including sleep pattern monitoring, rehabilitation support, and pressure ulcer prevention. However, it is difficult to collect large real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Jing Gao , Ce Zheng , Laszlo A. Jeni , Zackory Erickson

Diffusion-based generative models have had a high impact on the computer vision and speech processing communities these past years. Besides data generation tasks, they have also been employed for data restoration tasks like speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-17 Jean-Marie Lemercier , Julius Richter , Simon Welker , Timo Gerkmann

Detailed and photorealistic 3D human modeling is essential for various applications and has seen tremendous progress. However, full-body reconstruction from a monocular RGB image remains challenging due to the ill-posed nature of the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Peng Li , Wangguandong Zheng , Yuan Liu , Tao Yu , Yangguang Li , Xingqun Qi , Xiaowei Chi , Siyu Xia , Yan-Pei Cao , Wei Xue , Wenhan Luo , Yike Guo

We propose RoHM, an approach for robust 3D human motion reconstruction from monocular RGB(-D) videos in the presence of noise and occlusions. Most previous approaches either train neural networks to directly regress motion in 3D or learn…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Siwei Zhang , Bharat Lal Bhatnagar , Yuanlu Xu , Alexander Winkler , Petr Kadlecek , Siyu Tang , Federica Bogo

Hand mesh reconstruction from the monocular image is a challenging task due to its depth ambiguity and severe occlusion, there remains a non-unique mapping between the monocular image and hand mesh. To address this, we develop DiffHand, the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Lijun Li , Li'an Zhuo , Bang Zhang , Liefeng Bo , Chen Chen

Diffusion models are a special type of generative model, capable of synthesising new data from a learnt distribution. We introduce DISPR, a diffusion-based model for solving the inverse problem of three-dimensional (3D) cell shape…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Dominik J. E. Waibel , Ernst Röell , Bastian Rieck , Raja Giryes , Carsten Marr

We consider the problem of estimating a parametric model of 3D human mesh from a single image. While there has been substantial recent progress in this area with direct regression of model parameters, these methods only implicitly exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Georgios Georgakis , Ren Li , Srikrishna Karanam , Terrence Chen , Jana Kosecka , Ziyan Wu

3D human pose estimation from 2D images is a challenging problem due to depth ambiguity and occlusion. Because of these challenges the task is underdetermined, where there exists multiple -- possibly infinite -- poses that are plausible…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Francis Snelgar , Ming Xu , Stephen Gould , Liang Zheng , Akshay Asthana

This paper studies full-body 3D human motion recovery from head-mounted device signals. Existing diffusion-based methods often rely on global distribution matching, leading to local joint reconstruction errors. We propose MotionGRPO, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Nanjie Yao , Junlong Ren , Wenhao Shen , Hao Wang

This study investigates human-computer interface generation based on diffusion models to overcome the limitations of traditional template-based design and fixed rule-driven methods. It first analyzes the key challenges of interface…

Human-Computer Interaction · Computer Science 2026-01-13 Rui Liu , Liuqingqing Yang , Runsheng Zhang , Shixiao Wang

High dynamic range (HDR) video reconstruction aims to generate HDR videos from low dynamic range (LDR) frames captured with alternating exposures. Most existing works solely rely on the regression-based paradigm, leading to adverse effects…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Yuanshen Guan , Ruikang Xu , Mingde Yao , Ruisheng Gao , Lizhi Wang , Zhiwei Xiong

Previous probabilistic models for 3D Human Pose Estimation (3DHPE) aimed to enhance pose accuracy by generating multiple hypotheses. However, most of the hypotheses generated deviate substantially from the true pose. Compared to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Hongbo Kang , Yong Wang , Mengyuan Liu , Doudou Wu , Peng Liu , Xinlin Yuan , Wenming Yang