English
Related papers

Related papers: SPOTR: Spatio-temporal Pose Transformers for Human…

200 papers

Predicting future human behavior from an input human video is a useful task for applications such as autonomous driving and robotics. While most previous works predict a single future, multiple futures with different behavior can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Naoya Fushishita , Antonio Tejero-de-Pablos , Yusuke Mukuta , Tatsuya Harada

With growing numbers of intelligent autonomous systems in human environments, the ability of such systems to perceive, understand and anticipate human behavior becomes increasingly important. Specifically, predicting future positions of…

Robotics · Computer Science 2020-07-27 Andrey Rudenko , Luigi Palmieri , Michael Herman , Kris M. Kitani , Dariu M. Gavrila , Kai O. Arras

Predicting high-fidelity future human poses, from a historically observed sequence, is decisive for intelligent robots to interact with humans. Deep end-to-end learning approaches, which typically train a generic pre-trained model on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Qiongjie Cui , Huaijiang Sun , Jianfeng Lu , Bin Li , Weiqing Li

Human pose assessment and correction play a crucial role in applications across various fields, including computer vision, robotics, sports analysis, healthcare, and entertainment. In this paper, we propose a Spatial-Temporal Transformer…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Wenyang Hu , Kai Liu , Libin Liu , Huiliang Shang

Accurate human motion prediction is crucial for safe human-robot collaboration but remains challenging due to the complexity of modeling intricate and variable human movements. This paper presents Parallel Multi-scale Incremental Prediction…

Robotics · Computer Science 2024-12-17 Juncheng Zou

Several applications such as autonomous driving, augmented reality and virtual reality require a precise prediction of the 3D human pose. Recently, a new problem was introduced in the field to predict the 3D human poses from observed 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Abduallah Mohamed , Huancheng Chen , Zhangyang Wang , Christian Claudel

Given a video of a person in action, we can easily guess the 3D future motion of the person. In this work, we present perhaps the first approach for predicting a future 3D mesh model sequence of a person from past video input. We do this…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Jason Y. Zhang , Panna Felsen , Angjoo Kanazawa , Jitendra Malik

Estimating 3D human poses from monocular videos is a challenging task due to depth ambiguity and self-occlusion. Most existing works attempt to solve both issues by exploiting spatial and temporal relationships. However, those works ignore…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Wenhao Li , Hong Liu , Hao Tang , Pichao Wang , Luc Van Gool

Human pose forecasting is an important problem in computer vision with applications to human-robot interaction, visual surveillance, and autonomous driving. Usually, forecasting algorithms use 3D skeleton sequences and are trained to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Sam Toyer , Anoop Cherian , Tengda Han , Stephen Gould

We present a new trainable system for physically plausible markerless 3D human motion capture, which achieves state-of-the-art results in a broad range of challenging scenarios. Unlike most neural methods for human motion capture, our…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Soshi Shimada , Vladislav Golyanik , Weipeng Xu , Patrick Pérez , Christian Theobalt

Human motion prediction is a challenging and important task in many computer vision application domains. Existing work only implicitly models the spatial structure of the human skeleton. In this paper, we propose a novel approach that…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Emre Aksan , Manuel Kaufmann , Otmar Hilliges

Motion prediction, recently popularized as world models, refers to the anticipation of future agent states or scene evolution, which is rooted in human cognition, bridging perception and decision-making. It enables intelligent systems, such…

We tackle the task of diverse 3D human motion prediction, that is, forecasting multiple plausible future 3D poses given a sequence of observed 3D poses. In this context, a popular approach consists of using a Conditional Variational…

Machine Learning · Computer Science 2020-12-08 Sadegh Aliakbarian , Fatemeh Sadat Saleh , Lars Petersson , Stephen Gould , Mathieu Salzmann

The modeling of human motion using machine learning methods has been widely studied. In essence it is a time-series modeling problem involving predicting how a person will move in the future given how they moved in the past. Existing…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Yan Zhang , Michael J. Black , Siyu Tang

Trajectory Prediction of dynamic objects is a widely studied topic in the field of artificial intelligence. Thanks to a large number of applications like predicting abnormal events, navigation system for the blind, etc. there have been many…

Machine Learning · Computer Science 2017-05-29 Daksh Varshneya , G. Srinivasaraghavan

Data-efficient training of robust robot policies is the key to unlocking automation in a wide array of novel tasks. Current systems require large volumes of demonstrations to achieve robustness, which is impractical in many applications.…

Robotics · Computer Science 2026-03-10 Adam Hung , Bardienus Pieter Duisterhof , Jeffrey Ichnowski

Multi-person pose understanding from RGB videos involves three complex tasks: pose estimation, tracking and motion forecasting. Intuitively, accurate multi-person pose estimation facilitates robust tracking, and robust tracking builds…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Shihao Zou , Yuanlu Xu , Chao Li , Lingni Ma , Li Cheng , Minh Vo

Data-driven modeling of human motions is ubiquitous in computer graphics and computer vision applications, such as synthesizing realistic motions or recognizing actions. Recent research has shown that such problems can be approached by…

Graphics · Computer Science 2019-08-21 He Wang , Edmond S. L. Ho , Hubert P. H. Shum , Zhanxing Zhu

We present a method for simultaneously estimating 3D human pose and body shape from a sparse set of wide-baseline camera views. We train a symmetric convolutional autoencoder with a dual loss that enforces learning of a latent…

Computer Vision and Pattern Recognition · Computer Science 2018-07-05 Matthew Trumble , Andrew Gilbert , Adrian Hilton , John Collomosse

Stochastic Human Motion Prediction (HMP) has received increasing attention due to its wide applications. Despite the rapid progress in generative fields, existing methods often face challenges in learning continuous temporal dynamics and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Hua Yu , Yaqing Hou , Xu Gui , Shanshan Feng , Dongsheng Zhou , Qiang Zhang