English
Related papers

Related papers: SoMoFormer: Multi-Person Pose Forecasting with Tra…

200 papers

We introduce HuMoR: a 3D Human Motion Model for Robust Estimation of temporal pose and shape. Though substantial progress has been made in estimating 3D human motion and shape from dynamic observations, recovering plausible pose sequences…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Davis Rempe , Tolga Birdal , Aaron Hertzmann , Jimei Yang , Srinath Sridhar , Leonidas J. Guibas

Accurate human trajectory prediction is one of the most crucial tasks for autonomous driving, ensuring its safety. Yet, existing models often fail to fully leverage the visual cues that humans subconsciously communicate when navigating the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Yang Gao , Saeed Saadatnejad , Alexandre Alahi

We propose to leverage Transformer architectures for non-autoregressive human motion prediction. Our approach decodes elements in parallel from a query sequence, instead of conditioning on previous predictions such as instate-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Angel Martínez-González , Michael Villamizar , Jean-Marc Odobez

Multi-person pose understanding from RGB videos involves three complex tasks: pose estimation, tracking and motion forecasting. Intuitively, accurate multi-person pose estimation facilitates robust tracking, and robust tracking builds…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Shihao Zou , Yuanlu Xu , Chao Li , Lingni Ma , Li Cheng , Minh Vo

The ability of intelligent systems to predict human behaviors is crucial, particularly in fields such as autonomous vehicle navigation and social robotics. However, the complexity of human motion have prevented the development of a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Yang Gao , Po-Chien Luan , Alexandre Alahi

The task of collaborative human pose forecasting stands for predicting the future poses of multiple interacting people, given those in previous frames. Predicting two people in interaction, instead of each separately, promises better…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Muhammad Rameez Ur Rahman , Luca Scofano , Edoardo De Matteis , Alessandro Flaborea , Alessio Sampieri , Fabio Galasso

Human motion prediction combines the tasks of trajectory forecasting and human pose prediction. For each of the two tasks, specialized models have been developed. Combining these models for holistic human motion prediction is non-trivial,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Aadya Agrawal , Alexander Schwing

We introduce an approach for detecting and tracking detailed 3D poses of multiple people from a single monocular camera stream. Our system maintains temporally coherent predictions in crowded scenes filled with difficult poses and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Alejandro Newell , Peiyun Hu , Lahav Lipson , Stephan R. Richter , Vladlen Koltun

A key step towards understanding human behavior is the prediction of 3D human motion. Successful solutions have many applications in human tracking, HCI, and graphics. Most previous work focuses on predicting a time series of future 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Yan Zhang , Michael J. Black , Siyu Tang

Human pose forecasting is an important problem in computer vision with applications to human-robot interaction, visual surveillance, and autonomous driving. Usually, forecasting algorithms use 3D skeleton sequences and are trained to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Sam Toyer , Anoop Cherian , Tengda Han , Stephen Gould

Complex scenes present significant challenges for predicting human behaviour due to the abundance of interaction information, such as human-human and humanenvironment interactions. These factors complicate the analysis and understanding of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Caiyi Sun , Yujing Sun , Xiao Han , Zemin Yang , Jiawei Liu , Xinge Zhu , Siu Ming Yiu , Yuexin Ma

Forecasting long-term 3D human motion is challenging: the stochasticity of human behavior makes it hard to generate realistic human motion from the input sequence alone. Information on the scene environment and the motion of nearby people…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Felix B Mueller , Julian Tanke , Juergen Gall

In this work, we aim to improve the 3D reasoning ability of Transformers in multi-view 3D human pose estimation. Recent works have focused on end-to-end learning-based transformer designs, which struggle to resolve geometric information…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Ziwei Liao , Jialiang Zhu , Chunyu Wang , Han Hu , Steven L. Waslander

We present EgoPoseFormer, a simple yet effective transformer-based model for stereo egocentric human pose estimation. The main challenge in egocentric pose estimation is overcoming joint invisibility, which is caused by self-occlusion or a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chenhongyi Yang , Anastasia Tkach , Shreyas Hampali , Linguang Zhang , Elliot J. Crowley , Cem Keskin

Predicting future human behavior from an input human video is a useful task for applications such as autonomous driving and robotics. While most previous works predict a single future, multiple futures with different behavior can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Naoya Fushishita , Antonio Tejero-de-Pablos , Yusuke Mukuta , Tatsuya Harada

Predicting human motion plays a crucial role in ensuring a safe and effective human-robot close collaboration in intelligent remanufacturing systems of the future. Existing works can be categorized into two groups: those focusing on…

Robotics · Computer Science 2023-08-01 Sibo Tian , Minghui Zheng , Xiao Liang

We present a method for human pose tracking that is based on learning spatiotemporal relationships among joints. Beyond generating the heatmap of a joint in a given frame, our system also learns to predict the offset of the joint from a…

Computer Vision and Pattern Recognition · Computer Science 2019-03-28 Xiao Sun , Chuankang Li , Stephen Lin

We present HOIMotion - a novel approach for human motion forecasting during human-object interactions that integrates information about past body poses and egocentric 3D object bounding boxes. Human motion forecasting is important in many…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zhiming Hu , Zheming Yin , Daniel Haeufle , Syn Schmitt , Andreas Bulling

Humanoid parkour requires locomotion policies to coordinate whole-body dynamics across rapidly changing terrains such as stairs, gaps, slopes, and obstacles. Existing reinforcement learning policies are largely reactive, mapping…

Robotics · Computer Science 2026-05-27 Yanheng Mai , Wenhao Xu , Zirui Huang , Yifei Fu , Shengwei Dong , Xinjue Wang , Kailun Huang , Yanzhe Xie , Renjing Xu

Human pose forecasting garners attention for its diverse applications. However, challenges in modeling the multi-modal nature of human motion and intricate interactions among agents persist, particularly with longer timescales and more…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jaewoo Jeong , Daehee Park , Kuk-Jin Yoon