English
Related papers

Related papers: Towards Balanced Multi-Modal Learning in 3D Human …

200 papers

Human behavioral monitoring during sleep is essential for various medical applications. Majority of the contactless human pose estimation algorithms are based on RGB modality, causing ineffectiveness in in-bed pose estimation due to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Mohamed Afham , Udith Haputhanthri , Jathurshan Pradeepkumar , Mithunjha Anandakumar , Ashwin De Silva , Chamira Edussooriya

Vision-based monocular human pose estimation, as one of the most fundamental and challenging problems in computer vision, aims to obtain posture of the human body from input images or video sequences. The recent developments of deep…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Yucheng Chen , Yingli Tian , Mingyi He

Many approaches have been proposed for human pose estimation in single and multi-view RGB images. However, some environments, such as the operating room, are still very challenging for state-of-the-art RGB methods. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2017-01-26 Abdolrahim Kadkhodamohammadi , Afshin Gangi , Michel de Mathelin , Nicolas Padoy

3D Human body pose and shape estimation within a temporal sequence can be quite critical for understanding human behavior. Despite the significant progress in human pose estimation in the recent years, which are often based on single images…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Zhouping Wang , Sarah Ostadabbas

Comprehensive capturing of human motions requires both accurate captures of complex poses and precise localization of the human within scenes. Most of the HPE datasets and methods primarily rely on RGB, LiDAR, or IMU data. However, solely…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Ming Yan , Yan Zhang , Shuqiang Cai , Shuqi Fan , Xincheng Lin , Yudi Dai , Siqi Shen , Chenglu Wen , Lan Xu , Yuexin Ma , Cheng Wang

Remarkable progress has been made in 3D human pose estimation from a monocular RGB camera. However, only a few studies explored 3D multi-person cases. In this paper, we attempt to address the lack of a global perspective of the top-down…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Jiefeng Li , Can Wang , Wentao Liu , Chen Qian , Cewu Lu

3D human pose estimation (HPE) is crucial in many fields, such as human behavior analysis, augmented reality/virtual reality (AR/VR) applications, and self-driving industry. Videos that contain multiple potentially occluded people captured…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Renshu Gu , Gaoang Wang , Jenq-Neng Hwang

This study presents significant enhancements in human pose estimation using the MediaPipe framework. The research focuses on improving accuracy, computational efficiency, and real-time processing capabilities by comprehensively optimising…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sandeep Singh Sengar , Abhishek Kumar , Owen Singh

3D human pose estimation and mesh recovery have attracted widespread research interest in many areas, such as computer vision, autonomous driving, and robotics. Deep learning on 3D human pose estimation and mesh recovery has recently…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Yang Liu , Changzhen Qiu , Zhiyong Zhang

The best performing methods for 3D human pose estimation from monocular images require large amounts of in-the-wild 2D and controlled 3D pose annotated datasets which are costly and require sophisticated systems to acquire. To reduce this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Rahul Mitra , Nitesh B. Gundavarapu , Abhishek Sharma , Arjun Jain

In monocular 3D human pose estimation a common setup is to first detect 2D positions and then lift the detection into 3D coordinates. Many algorithms suffer from overfitting to camera positions in the training set. We propose a siamese…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Márton Véges , Viktor Varga , András Lőrincz

RGB-based 3D pose estimation methods have been successful with the development of deep learning and the emergence of high-quality 3D pose datasets. However, most existing methods do not operate well for testing images whose distribution is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Hansoo Park , Chanwoo Kim , Jihyeon Kim , Hoseong Cho , Nhat Nguyen Bao Truong , Taehwan Kim , Seungryul Baek

Multimodal deep learning systems which employ multiple modalities like text, image, audio, video, etc., are showing better performance in comparison with individual modalities (i.e., unimodal) systems. Multimodal machine learning involves…

Machine Learning · Computer Science 2022-01-19 Anil Rahate , Rahee Walambe , Sheela Ramanna , Ketan Kotecha

One major challenge for monocular 3D human pose estimation in-the-wild is the acquisition of training data that contains unconstrained images annotated with accurate 3D poses. In this paper, we address this challenge by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Umar Iqbal , Pavlo Molchanov , Jan Kautz

Recently, multi-modal masked autoencoders (MAE) has been introduced in 3D self-supervised learning, offering enhanced feature learning by leveraging both 2D and 3D data to capture richer cross-modal representations. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Zhimin Chen , Xuewei Chen , Xiao Guo , Yingwei Li , Longlong Jing , Liang Yang , Bing Li

Monocular 3D human pose estimation is quite challenging due to the inherent ambiguity and occlusion, which often lead to high uncertainty and indeterminacy. On the other hand, diffusion models have recently emerged as an effective tool for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jia Gong , Lin Geng Foo , Zhipeng Fan , Qiuhong Ke , Hossein Rahmani , Jun Liu

In general, human pose estimation methods are categorized into two approaches according to their architectures: regression (i.e., heatmap-free) and heatmap-based methods. The former one directly estimates precise coordinates of each…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Jonghyun Kim , Bosang Kim , Hyotae Lee , Jungpyo Kim , Wonhyeok Im , Lanying Jin , Dowoo Kwon , Jungho Lee

Monocular 3D human pose estimation (HPE) methods estimate the 3D positions of joints from individual images. Existing 3D HPE approaches often use the cropped image alone as input for their models. However, the relative depths of joints…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Xiaoyang Hao , Han Li

To understand how people look, interact, or perform tasks, we need to quickly and accurately capture their 3D body, face, and hands together from an RGB image. Most existing methods focus only on parts of the body. A few recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Vasileios Choutas , Georgios Pavlakos , Timo Bolkart , Dimitrios Tzionas , Michael J. Black

Estimating human pose from video is a task that receives considerable attention due to its applicability in numerous 3D fields. The complexity of prior knowledge of human body movements poses a challenge to neural network models in the task…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Wenshuo Chen , Xiang Zhou , Zhengdi Yu , Weixi Gu , Kai Zhang
‹ Prev 1 8 9 10 Next ›