English
Related papers

Related papers: Action Anticipation By Predicting Future Dynamic I…

200 papers

Close human-robot cooperation is a key enabler for new developments in advanced manufacturing and assistive applications. Close cooperation require robots that can predict human actions and intent, and understand human non-verbal cues.…

Human-Computer Interaction · Computer Science 2019-02-19 Paul Schydlo , Mirko Rakovic , Lorenzo Jamone , José Santos-Victor

To interact with humans in collaborative environments, machines need to be able to predict (i.e., anticipate) future events, and execute actions in a timely manner. However, the observation of the human limb movements may not be sufficient…

Robotics · Computer Science 2020-06-19 Clebeson Canuto , Plinio Moreno , Jorge Samatelo , Raquel Vassallo , José Santos-Victor

Complex scenes present significant challenges for predicting human behaviour due to the abundance of interaction information, such as human-human and humanenvironment interactions. These factors complicate the analysis and understanding of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Caiyi Sun , Yujing Sun , Xiao Han , Zemin Yang , Jiawei Liu , Xinge Zhu , Siu Ming Yiu , Yuexin Ma

The anticipation of human behavior is a crucial capability for robots to interact with humans safely and efficiently. We employ a smart edge sensor network to provide global observations, future predictions, and goal information to…

Robotics · Computer Science 2025-09-16 Simon Bultmann , Raphael Memmesheimer , Jan Nogga , Julian Hau , Sven Behnke

We propose the task of forecasting characteristic 3d poses: from a short sequence observation of a person, predict a future 3d pose of that person in a likely action-defining, characteristic pose -- for instance, from observing a person…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Christian Diller , Thomas Funkhouser , Angela Dai

Human motion prediction and understanding is a challenging problem. Due to the complex dynamic of human motion and the non-deterministic aspect of future prediction. We propose a novel sequence-to-sequence model for human motion prediction…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Emad Barsoum , John Kender , Zicheng Liu

Predicting future human behavior from an input human video is a useful task for applications such as autonomous driving and robotics. While most previous works predict a single future, multiple futures with different behavior can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Naoya Fushishita , Antonio Tejero-de-Pablos , Yusuke Mukuta , Tatsuya Harada

Human motion prediction is consisting in forecasting future body poses from historically observed sequences. It is a longstanding challenge due to motion's complex dynamics and uncertainty. Existing methods focus on building up complicated…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Zhihao Wang , Yulin Zhou , Ningyu Zhang , Xiaosong Yang , Jun Xiao , Zhao Wang

Action anticipation, the task of predicting future actions from partially observed videos, is crucial for advancing intelligent systems. Unlike action recognition, which operates on fully observed videos, action anticipation must handle…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Seulgi Kim , Ghazal Kaviani , Mohit Prabhushankar , Ghassan AlRegib

This paper summarizes the recent progress in human motion analysis and its applications. In the beginning, we reviewed the motion capture systems and the representation model of human's motion data. Next, we sketched the advanced human…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Qifei Wang

Human motion prediction aims to forecast future human poses given a historical motion. Whether based on recurrent or feed-forward neural networks, existing learning based methods fail to model the observation that human motion tends to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Wei Mao , Miaomiao Liu , Mathieu Salzmann , Hongdong Li

Human behavior forecasting during human-human interactions is of utmost importance to provide robotic or virtual agents with social intelligence. This problem is especially challenging for scenarios that are highly driven by interpersonal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 German Barquero , Johnny Núñez , Zhen Xu , Sergio Escalera , Wei-Wei Tu , Isabelle Guyon , Cristina Palmero

We present a generative approach to forecast long-term future human behavior in 3D, requiring only weak supervision from readily available 2D human action data. This is a fundamental task enabling many downstream applications. The required…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Christian Diller , Thomas Funkhouser , Angela Dai

In this paper, we tackle the task of scene-aware 3D human motion forecasting, which consists of predicting future human poses given a 3D scene and a past human motion. A key challenge of this task is to ensure consistency between the human…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wei Mao , Miaomiao Liu , Richard Hartley , Mathieu Salzmann

Human motion prediction aims to forecast future human poses given a past motion. Whether based on recurrent or feed-forward neural networks, existing methods fail to model the observation that human motion tends to repeat itself, even for…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Wei Mao , Miaomiao Liu , Mathieu Salzmann

We present GazeMotion, a novel method for human motion forecasting that combines information on past human poses with human eye gaze. Inspired by evidence from behavioural sciences showing that human eye and body movements are closely…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Zhiming Hu , Syn Schmitt , Daniel Haeufle , Andreas Bulling

Anticipating future actions based on spatiotemporal observations is essential in video understanding and predictive computer vision. Moreover, a model capable of anticipating the future has important applications, it can benefit…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tsung-Ming Tai , Giuseppe Fiameni , Cheng-Kuang Lee , Simon See , Oswald Lanz

In autonomous driving (AD), accurately predicting changes in the environment can effectively improve safety and comfort. Due to complex interactions among traffic participants, however, it is very hard to achieve accurate prediction for a…

Machine Learning · Computer Science 2020-12-29 Ershad Banijamali , Mohsen Rohani , Elmira Amirloo , Jun Luo , Pascal Poupart

The task of action-driven human motion prediction aims to forecast future human motion based on the observed sequence while respecting the given action label. It requires modeling not only the stochasticity within human motion but the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Chunzhi Gu , Chao Zhang , Shigeru Kuriyama

Human pose forecasting is inherently multimodal since multiple futures exist for an observed pose sequence. However, evaluating multimodality is challenging since the task is ill-posed. Therefore, we first propose an alternative paradigm to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Reyhaneh Hosseininejad , Megh Shukla , Saeed Saadatnejad , Mathieu Salzmann , Alexandre Alahi