English
Related papers

Related papers: HSTFormer: Hierarchical Spatial-Temporal Transform…

200 papers

3D human pose estimation captures the human joint points in three-dimensional space while keeping the depth information and physical structure. That is essential for applications that require precise pose information, such as human-computer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jianbin Jiao , Xina Cheng , Weijie Chen , Xiaoting Yin , Hao Shi , Kailun Yang

Recently, diffusion-based methods for monocular 3D human pose estimation have achieved state-of-the-art (SOTA) performance by directly regressing the 3D joint coordinates from the 2D pose sequence. Although some methods decompose the task…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Qingyuan Cai , Xuecai Hu , Saihui Hou , Li Yao , Yongzhen Huang

3D human pose estimation is a classic and important research direction in the field of computer vision. In recent years, Transformer-based methods have made significant progress in lifting 2D to 3D human pose estimation. However, these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiawen Duan , Jian Xiang , Zhiqiang Li , Linlin Xue , Wan Xiang

2D-to-3D human pose lifting is fundamental for 3D human pose estimation (HPE), for which graph convolutional networks (GCNs) have proven inherently suitable for modeling the human skeletal topology. However, the current GCN-based 3D HPE…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Kai Zhai , Qiang Nie , Bo Ouyang , Xiang Li , Shanlin Yang

Occlusion is an omnipresent challenge in 3D human pose estimation (HPE). In spite of the large amount of research dedicated to 3D HPE, only a limited number of studies address the problem of occlusion explicitly. To fill this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Soubarna Banik , Patricia Gschoßmann , Alejandro Mendoza Garcia , Alois Knoll

This paper introduces a novel Pre-trained Spatial Temporal Many-to-One (P-STMO) model for 2D-to-3D human pose estimation task. To reduce the difficulty of capturing spatial and temporal information, we divide this task into two stages:…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Wenkang Shan , Zhenhua Liu , Xinfeng Zhang , Shanshe Wang , Siwei Ma , Wen Gao

2D-to-3D human pose lifting is a fundamental challenge for 3D human pose estimation in monocular video, where graph convolutional networks (GCNs) and attention mechanisms have proven to be inherently suitable for encoding the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Kai Zhai , Ziyan Huang , Qiang Nie , Xiang Li , Bo Ouyang

The dominant paradigm in 3D human pose estimation that lifts a 2D pose sequence to 3D heavily relies on long-term temporal clues (i.e., using a daunting number of video frames) for improved accuracy, which incurs performance saturation,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Qitao Zhao , Ce Zheng , Mengyuan Liu , Chen Chen

The goal of 2D human pose estimation (HPE) is to localize anatomical landmarks, given an image of a person in a pose. SOTA techniques make use of thousands of labeled figures (finetuning transformers or training deep CNNs), acquired using…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Nobline Yoo , Olga Russakovsky

Traditional methods for human localization and pose estimation (HPE), which mainly rely on RGB images as an input modality, confront substantial limitations in real-world applications due to privacy concerns. In contrast, radar-based HPE…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yuan-Hao Ho , Jen-Hao Cheng , Sheng Yao Kuan , Zhongyu Jiang , Wenhao Chai , Hsiang-Wei Huang , Chih-Lung Lin , Jenq-Neng Hwang

For the current 3D human pose estimation task, a group of methods mainly learn the rules of 2D-3D projection from spatial and temporal correlation. However, earlier methods model the global features of the entire body joint in the time…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Xinwei Yu , Xiaohua Zhang

Existing state-of-the-art methods for surgical phase recognition either rely on the extraction of spatial-temporal features at a short-range temporal resolution or adopt the sequential extraction of the spatial and temporal features across…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Shu Yang , Luyang Luo , Qiong Wang , Hao Chen

Handwritten Mathematical Expression Recognition (HMER) has wide applications in human-machine interaction scenarios, such as digitized education and automated offices. Recently, sequence-based models with encoder-decoder architectures have…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Tongkun Guan , Chengyu Lin , Wei Shen , Xiaokang Yang

Transformers have been successfully applied in the field of video-based 3D human pose estimation. However, the high computational costs of these video pose transformers (VPTs) make them impractical on resource-constrained devices. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Wenhao Li , Mengyuan Liu , Hong Liu , Pichao Wang , Shijian Lu , Nicu Sebe

Human pose estimation in complicated situations has always been a challenging task. Many Transformer-based pose networks have been proposed recently, achieving encouraging progress in improving performance. However, the remarkable…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Chengpeng Wu , Guangxing Tan , Chunyu Li

We present EgoPoseFormer, a simple yet effective transformer-based model for stereo egocentric human pose estimation. The main challenge in egocentric pose estimation is overcoming joint invisibility, which is caused by self-occlusion or a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chenhongyi Yang , Anastasia Tkach , Shreyas Hampali , Linguang Zhang , Elliot J. Crowley , Cem Keskin

Existing methods of multi-person video 3D human Pose and Shape Estimation (PSE) typically adopt a two-stage strategy, which first detects human instances in each frame and then performs single-person PSE with temporal model. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Zhongwei Qiu , Yang Qiansheng , Jian Wang , Haocheng Feng , Junyu Han , Errui Ding , Chang Xu , Dongmei Fu , Jingdong Wang

Recent transformer based approaches have demonstrated impressive performance in solving real-world 3D human pose estimation problems. Albeit these approaches achieve fruitful results on benchmark datasets, they tend to fall short of sports…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Zhuoer Yin , Calvin Yeung , Tomohiro Suzuki , Ryota Tanaka , Keisuke Fujii

This paper proposes a unified framework dubbed Multi-view and Temporal Fusing Transformer (MTF-Transformer) to adaptively handle varying view numbers and video length without camera calibration in 3D Human Pose Estimation (HPE). It consists…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Hui Shuai , Lele Wu , Qingshan Liu

3D human shape and pose estimation is the essential task for human motion analysis, which is widely used in many 3D applications. However, existing methods cannot simultaneously capture the relations at multiple levels, including…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Ziniu Wan , Zhengjia Li , Maoqing Tian , Jianbo Liu , Shuai Yi , Hongsheng Li