English
Related papers

Related papers: Multi-Person 3D Motion Prediction with Multi-Range…

200 papers

Multi-person motion prediction is a challenging problem due to the dependency of motion on both individual past movements and interactions with other people. Transformer-based methods have shown promising results on this task, but they miss…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Qingyao Xu , Weibo Mao , Jingze Gong , Chenxin Xu , Siheng Chen , Weidi Xie , Ya Zhang , Yanfeng Wang

Motion prediction is a classic problem in computer vision, which aims at forecasting future motion given the observed pose sequence. Various deep learning models have been proposed, achieving state-of-the-art performance on motion…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Pengxiang Su , Zhenguang Liu , Shuang Wu , Lei Zhu , Yifang Yin , Xuanjing Shen

In the robot follow-ahead task, a mobile robot is tasked to maintain its relative position in front of a moving human actor while keeping the actor in sight. To accomplish this task, it is important that the robot understand the full 3D…

Robotics · Computer Science 2024-03-21 Qingyuan Jiang , Burak Susam , Jun-Jee Chao , Volkan Isler

Multi-person pose understanding from RGB videos involves three complex tasks: pose estimation, tracking and motion forecasting. Intuitively, accurate multi-person pose estimation facilitates robust tracking, and robust tracking builds…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Shihao Zou , Yuanlu Xu , Chao Li , Lingni Ma , Li Cheng , Minh Vo

Human motion prediction is a fundamental part of many human-robot applications. Despite the recent progress in human motion prediction, most studies simplify the problem by predicting the human motion relative to a fixed joint and/or only…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Payam Nikdel , Mohammad Mahdavian , Mo Chen

Its numerous applications make multi-human 3D pose estimation a remarkably impactful area of research. Nevertheless, assuming a multiple-view system composed of several regular RGB cameras, 3D multi-pose estimation presents several…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Daniel Rodriguez-Criado , Pilar Bachiller , George Vogiatzis , Luis J. Manso

We propose to leverage Transformer architectures for non-autoregressive human motion prediction. Our approach decodes elements in parallel from a query sequence, instead of conditioning on previous predictions such as instate-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Angel Martínez-González , Michael Villamizar , Jean-Marc Odobez

Prediction of human motions is key for safe navigation of autonomous robots among humans. In cluttered environments, several motion hypotheses may exist for a pedestrian, due to its interactions with the environment and other pedestrians.…

Robotics · Computer Science 2020-11-17 Bruno Brito , Hai Zhu , Wei Pan , Javier Alonso-Mora

Anticipating the motion of all humans in dynamic environments such as homes and offices is critical to enable safe and effective robot navigation. Such spaces remain challenging as humans do not follow strict rules of motion and there are…

Robotics · Computer Science 2023-10-02 Tim Salzmann , Lewis Chiang , Markus Ryll , Dorsa Sadigh , Carolina Parada , Alex Bewley

Generative models of 3D human motion are often restricted to a small number of activities and can therefore not generalize well to novel movements or applications. In this work we propose a deep learning framework for human motion capture…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Judith Bütepage , Michael Black , Danica Kragic , Hedvig Kjellström

For a complete comprehension of multi-person scenes, it is essential to go beyond basic tasks like detection and tracking. Higher-level tasks, such as understanding the interactions and social activities among individuals, are also crucial.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Mahsa Ehsanpour , Ian Reid , Hamid Rezatofighi

Human motion prediction is consisting in forecasting future body poses from historically observed sequences. It is a longstanding challenge due to motion's complex dynamics and uncertainty. Existing methods focus on building up complicated…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Zhihao Wang , Yulin Zhou , Ningyu Zhang , Xiaosong Yang , Jun Xiao , Zhao Wang

Human motion prediction and understanding is a challenging problem. Due to the complex dynamic of human motion and the non-deterministic aspect of future prediction. We propose a novel sequence-to-sequence model for human motion prediction…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Emad Barsoum , John Kender , Zicheng Liu

3D human motion prediction, predicting future poses from a given sequence, is an issue of great significance and challenge in computer vision and machine intelligence, which can help machines in understanding human behaviors. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Kedi Lyu , Haipeng Chen , Zhenguang Liu , Beiqi Zhang , Ruili Wang

We propose an approach for forecasting video of complex human activity involving multiple people. Direct pixel-level prediction is too simple to handle the appearance variability in complex activities. Hence, we develop novel intermediate…

Computer Vision and Pattern Recognition · Computer Science 2017-12-07 Mengyao Zhai , Jiacheng Chen , Ruizhi Deng , Lei Chen , Ligeng Zhu , Greg Mori

We propose a novel solution for predicting future trajectories of pedestrians. Our method uses a multimodal encoder-decoder transformer architecture, which takes as input both pedestrian locations and ego-vehicle speeds. Notably, our…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Haleh Damirchi , Michael Greenspan , Ali Etemad

Predicting the next visited location of an individual is a key problem in human mobility analysis, as it is required for the personalization and optimization of sustainable transport options. Here, we propose a transformer decoder-based…

Machine Learning · Computer Science 2022-10-31 Ye Hong , Henry Martin , Martin Raubal

In this paper, we tackle the task of scene-aware 3D human motion forecasting, which consists of predicting future human poses given a 3D scene and a past human motion. A key challenge of this task is to ensure consistency between the human…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wei Mao , Miaomiao Liu , Richard Hartley , Mathieu Salzmann

The task of collaborative human pose forecasting stands for predicting the future poses of multiple interacting people, given those in previous frames. Predicting two people in interaction, instead of each separately, promises better…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Muhammad Rameez Ur Rahman , Luca Scofano , Edoardo De Matteis , Alessandro Flaborea , Alessio Sampieri , Fabio Galasso

This work presents a methodology for modeling and predicting human behavior in settings with N humans interacting in highly multimodal scenarios (i.e. where there are many possible highly-distinct futures). A motivating example includes…

Robotics · Computer Science 2018-07-27 Boris Ivanovic , Edward Schmerling , Karen Leung , Marco Pavone