English
Related papers

Related papers: MDMP: Multi-modal Diffusion for supervised Motion …

200 papers

Probabilistic human motion prediction aims to forecast multiple possible future movements from past observations. While current approaches report high diversity and realism, they often generate motions with undetected limb stretching and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Cecilia Curreli , Dominik Muhle , Abhishek Saroha , Zhenzhang Ye , Riccardo Marin , Daniel Cremers

Generating 3D human motion from text descriptions remains challenging due to the diverse and complex nature of human motion. While existing methods excel within the training distribution, they often struggle with out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Zongye Zhang , Bohan Kong , Qingjie Liu , Yunhong Wang

Human motion prediction is consisting in forecasting future body poses from historically observed sequences. It is a longstanding challenge due to motion's complex dynamics and uncertainty. Existing methods focus on building up complicated…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Zhihao Wang , Yulin Zhou , Ningyu Zhang , Xiaosong Yang , Jun Xiao , Zhao Wang

Multi-agent motion prediction is challenging because it aims to foresee the future trajectories of multiple agents (\textit{e.g.} pedestrians) simultaneously in a complicated scene. Existing work addressed this challenge by either learning…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Chaofan Tao , Qinhong Jiang , Lixin Duan , Ping Luo

We introduce the Multi-Motion Discrete Diffusion Models (M2D2M), a novel approach for human motion generation from textual descriptions of multiple actions, utilizing the strengths of discrete diffusion models. This approach adeptly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Seunggeun Chi , Hyung-gun Chi , Hengbo Ma , Nakul Agarwal , Faizan Siddiqui , Karthik Ramani , Kwonjoon Lee

Generating human motion from textual descriptions is a challenging task. Existing methods either struggle with physical credibility or are limited by the complexities of physics simulations. In this paper, we present \emph{ReinDiffuse} that…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Gaoge Han , Mingjiang Liang , Jinglei Tang , Yongkang Cheng , Wei Liu , Shaoli Huang

Context plays a significant role in the generation of motion for dynamic agents in interactive environments. This work proposes a modular method that utilises a learned model of the environment for motion prediction. This modularity…

Machine Learning · Computer Science 2021-01-05 Todor Davchev , Michael Burke , Subramanian Ramamoorthy

Human motion prediction is a cornerstone of human-robot collaboration (HRC), as robots need to infer the future movements of human workers based on past motion cues to proactively plan their motion, ensuring safety in close collaboration…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Sibo Tian , Minghui Zheng , Xiao Liang

Given a dataset of expert trajectories, standard imitation learning approaches typically learn a direct mapping from observations (e.g., RGB images) to actions. However, such methods often overlook the rich interplay between different…

Robotics · Computer Science 2026-04-14 Zixuan Huang , Huaidian Hou , Dmitry Berenson

Human motion prediction, which plays a key role in computer vision, generally requires a past motion sequence as input. However, in real applications, a complete and correct past motion sequence can be too expensive to achieve. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Chunzhi Gu , Yan Zhao , Chao Zhang

Predicting future human pose is a fundamental application for machine intelligence, which drives robots to plan their behavior and paths ahead of time to seamlessly accomplish human-robot collaboration in real-world 3D scenarios. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Zhenyu Lou , Qiongjie Cui , Haofan Wang , Xu Tang , Hong Zhou

Weather forecasting remains a crucial yet challenging domain, where recently developed models based on deep learning (DL) have approached the performance of traditional numerical weather prediction (NWP) models. However, these DL models,…

Atmospheric and Oceanic Physics · Physics 2024-02-13 Zhanxiang Hua , Yutong He , Chengqian Ma , Alexandra Anderson-Frey

Multi-Robot Motion Planning (MRMP) involves generating collision-free trajectories for multiple robots operating in a shared continuous workspace. While discrete multi-agent path finding (MAPF) methods are broadly adopted due to their…

Robotics · Computer Science 2025-08-28 Jinhao Liang , Sven Koenig , Ferdinando Fioretto

Long-range human movement generation remains a central challenge in computer vision and graphics. Generating coherent transitions across semantically distinct motion domains remains largely unexplored. This capability is particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haichao Wang , Alexander Okupnik , Yuxing Han , Gene Wen , Johannes Schneider , Kyriakos Flouris

Human pose forecasting is inherently multimodal since multiple futures exist for an observed pose sequence. However, evaluating multimodality is challenging since the task is ill-posed. Therefore, we first propose an alternative paradigm to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Reyhaneh Hosseininejad , Megh Shukla , Saeed Saadatnejad , Mathieu Salzmann , Alexandre Alahi

Existing Human Motion Prediction (HMP) methods based on RGB-D cameras are sensitive to lighting conditions and raise privacy concerns, limiting their real-world applications such as firefighting and healthcare. Motivated by the robustness…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Junqiao Fan , Haocong Rao , Jiarui Zhang , Jianfei Yang , Lihua Xie

This paper introduces TopoDiffuser, a diffusion-based framework for multimodal trajectory prediction that incorporates topometric maps to generate accurate, diverse, and road-compliant future motion forecasts. By embedding structural cues…

Robotics · Computer Science 2025-08-04 Zehui Xu , Junhui Wang , Yongliang Shi , Chao Gao , Guyue Zhou

Discontinuous motion which is a motion composed of multiple continuous motions with sudden change in direction or velocity in between, can be seen in state-aware robotic tasks. Such robotic tasks are often coordinated with sensor…

Robotics · Computer Science 2023-09-04 Edgar Anarossi , Hirotaka Tahara , Naoto Komeno , Takamitsu Matsubara

Human motion prediction is essential for tasks such as human motion analysis and human-robot interactions. Most existing approaches have been proposed to realize motion prediction. However, they ignore an important task, the evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Pengxiang Ding , Jianqin Yin

Modeling temporal characteristics and the non-stationary dynamics of body movement plays a significant role in predicting human future motions. However, it is challenging to capture these features due to the subtle transitions involved in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Yuming Feng , Zhiyang Dou , Ling-Hao Chen , Yuan Liu , Tianyu Li , Jingbo Wang , Zeyu Cao , Wenping Wang , Taku Komura , Lingjie Liu