English
Related papers

Related papers: A Spatial-Temporal Transformer based Framework For…

200 papers

Reconstructing spatially and temporally coherent videos from time-varying measurements is a fundamental challenge in many scientific domains. A major difficulty arises from the sparsity of measurements, which hinders accurate recovery of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Bingliang Zhang , Zihui Wu , Berthy T. Feng , Yang Song , Yisong Yue , Katherine L. Bouman

Several individualization methods have recently been proposed to estimate a subject's Head-Related Transfer Function (HRTF) using convenient input modalities such as anthropometric measurements or pinnae photographs. There exists a need for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-23 Etienne Thuillier , Craig Jin , Vesa Välimäki

For a given video-based Human-Object Interaction scene, modeling the spatio-temporal relationship between humans and objects are the important cue to understand the contextual information presented in the video. With the effective…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Ning Wang , Guangming Zhu , Liang Zhang , Peiyi Shen , Hongsheng Li , Cong Hua

We propose a technique for learning single-view 3D object pose estimation models by utilizing a new source of data -- in-the-wild videos where objects turn. Such videos are prevalent in practice (e.g., cars in roundabouts, airplanes near…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Zezhou Cheng , Matheus Gadelha , Subhransu Maji

Drone-camera based human activity recognition (HAR) has received significant attention from the computer vision research community in the past few years. A robust and efficient HAR system has a pivotal role in fields like video…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Santosh Kumar Yadav , Esha Pahwa , Achleshwar Luthra , Kamlesh Tiwari , Hari Mohan Pandey , Peter Corcoran

Human pose forecasting predicts future poses based on past observations, and has many significant applications in areas such as action recognition, autonomous driving or human-robot interaction. This paper evaluates a wide range of pose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Daniel Bermuth , Alexander Poeppel , Wolfgang Reif

Event camera, as an asynchronous vision sensor capturing scene dynamics, presents new opportunities for highly efficient 3D human pose tracking. Existing approaches typically adopt modern-day Artificial Neural Networks (ANNs), such as CNNs…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Shihao Zou , Yuxuan Mu , Wei Ji , Zi-An Wang , Xinxin Zuo , Sen Wang , Weixin Si , Li Cheng

Transformer-based methods have recently achieved great advancement on 2D image-based vision tasks. For 3D video-based tasks such as action recognition, however, directly applying spatiotemporal transformers on video data will bring heavy…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Wangmeng Xiang , Chao Li , Biao Wang , Xihan Wei , Xian-Sheng Hua , Lei Zhang

For the current 3D human pose estimation task, a group of methods mainly learn the rules of 2D-3D projection from spatial and temporal correlation. However, earlier methods model the global features of the entire body joint in the time…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Xinwei Yu , Xiaohua Zhang

WiFi-based human pose estimation has emerged as a promising non-visual alternative approaches due to its pene-trability and privacy advantages. This paper presents VST-Pose, a novel deep learning framework for accurate and continuous pose…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Xinyu Zhang , Zhonghao Ye , Jingwei Zhang , Xiang Tian , Zhisheng Liang , Shipeng Yu

This paper presents a novel 3DOF pedestrian trajectory prediction approach for autonomous mobile service robots. While most previously reported methods are based on learning of 2D positions in monocular camera images, our approach uses…

Computer Vision and Pattern Recognition · Computer Science 2017-10-03 Li Sun , Zhi Yan , Sergi Molina Mellado , Marc Hanheide , Tom Duckett

This study presents significant enhancements in human pose estimation using the MediaPipe framework. The research focuses on improving accuracy, computational efficiency, and real-time processing capabilities by comprehensively optimising…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sandeep Singh Sengar , Abhishek Kumar , Owen Singh

Traffic prediction is a challenging spatio-temporal forecasting problem that involves highly complex spatio-temporal correlations. This paper proposes a Multi-level Multi-view Augmented Spatio-temporal Transformer (LVSTformer) for traffic…

Machine Learning · Computer Science 2024-06-19 Jiaqi Lin , Qianqian Ren

Recovering temporally consistent 3D human body pose, shape and motion from a monocular video is a challenging task due to (self-)occlusions, poor lighting conditions, complex articulated body poses, depth ambiguity, and limited availability…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Sushovan Chanda , Amogh Tiwari , Lokender Tiwari , Brojeshwar Bhowmick , Avinash Sharma , Hrishav Barua

Existing works typically treat spatial-temporal prediction as the task of learning a function $F$ to transform historical observations to future observations. We further decompose this cross-time transformation into three processes: (1)…

Artificial Intelligence · Computer Science 2024-12-05 Silu He , Peng Shen , Pingzhen Xu , Qinyao Luo , Haifeng Li

In this paper, we aim at synthesizing a free-viewpoint video of an arbitrary human performance using sparse multi-view cameras. Recently, several works have addressed this problem by learning person-specific neural radiance fields (NeRF) to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Youngjoong Kwon , Dahun Kim , Duygu Ceylan , Henry Fuchs

The ability to detect learned objects regardless of their appearance is crucial for autonomous systems in real-world applications. Especially for detecting humans, which is often a fundamental task in safety-critical applications, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Franziska Schwaiger , Andrea Matic , Karsten Roscher , Stephan Günnemann

There exists a multitude of online video tutorials to teach physical movements such as exercises. Yet, users lack support to verify the accuracy of their movements when following such videos and have to rely on their own perception. To…

Human-Computer Interaction · Computer Science 2020-10-12 Atima Tharatipyakul , Kenny Choo , Simon T. Perrault

As a fundamental technique that concerns several vision tasks such as image parsing, action recognition and clothing retrieval, human pose estimation (HPE) has been extensively investigated in recent years. To achieve accurate and reliable…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Weipeng Zhang , Jie Shen , Guangcan Liu , Yong Yu

Like many computer vision problems, human pose estimation is a challenging problem in that recognizing a body part requires not only information from local area but also from areas with large spatial distance. In order to spatially pass…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Te Qi , Bayram Bayramli , Usman Ali , Qinchuan Zhang , Hongtao Lu