English
Related papers

Related papers: BeLFusion: Latent Diffusion for Behavior-Driven Hu…

200 papers

Diffusion models are increasingly used for robot learning, but current designs face a clear trade-off. Action-chunking diffusion policies like ManiCM are fast to run, yet they only predict short segments of motion. This makes them reactive,…

Robotics · Computer Science 2026-03-27 Xirui Shi , Arya Ebrahimi , Yi Hu , Jun Jin

Existing Human Motion Prediction (HMP) methods based on RGB-D cameras are sensitive to lighting conditions and raise privacy concerns, limiting their real-world applications such as firefighting and healthcare. Motivated by the robustness…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Junqiao Fan , Haocong Rao , Jiarui Zhang , Jianfei Yang , Lihua Xie

This paper introduces HuLP, a Human-in-the-Loop for Prognosis model designed to enhance the reliability and interpretability of prognostic models in clinical contexts, especially when faced with the complexities of missing covariates and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Muhammad Ridzuan , Mai Kassem , Numan Saeed , Ikboljon Sobirov , Mohammad Yaqub

While modern diffusion models excel at generating diverse single images, extending this to sequential generation reveals a fundamental challenge: balancing narrative dynamism with multi-character coherence. Existing methods often falter at…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Qi Zhao , Jun Chen , Ivor Tsang , Guang Dai

Text-guided motion synthesis aims to generate 3D human motion that not only precisely reflects the textual description but reveals the motion details as much as possible. Pioneering methods explore the diffusion model for text-to-motion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhenyu Xie , Yang Wu , Xuehao Gao , Zhongqian Sun , Wei Yang , Xiaodan Liang

Predicting human behavior is a difficult and crucial task required for motion planning. It is challenging in large part due to the highly uncertain and multi-modal set of possible outcomes in real-world domains such as autonomous driving.…

Machine Learning · Computer Science 2019-10-15 Yuning Chai , Benjamin Sapp , Mayank Bansal , Dragomir Anguelov

Diffusion probabilistic models have achieved remarkable success in generative tasks across diverse data types. While recent studies have explored alternative degradation processes beyond Gaussian noise, this paper bridges two key diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Hao-Chien Hsueh , Chi-En Yen , Wen-Hsiao Peng , Ching-Chun Huang

Physics-informed deep learning has been developed as a novel paradigm for learning physical dynamics recently. While general physics-informed deep learning methods have shown early promise in learning fluid dynamics, they are difficult to…

Fluid Dynamics · Physics 2024-06-07 Jing Qiu , Jiancheng Huang , Xiangdong Zhang , Zeng Lin , Minglei Pan , Zengding Liu , Fen Miao

The target duration of a synthesized human motion is a critical attribute that requires modeling control over the motion dynamics and style. Speeding up an action performance is not merely fast-forwarding it. However, state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Alessio Sampieri , Alessio Palma , Indro Spinelli , Fabio Galasso

This paper tackles the problem of human motion prediction, consisting in forecasting future body poses from historically observed sequences. State-of-the-art approaches provide good results, however, they rely on deep learning architectures…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Wen Guo , Yuming Du , Xi Shen , Vincent Lepetit , Xavier Alameda-Pineda , Francesc Moreno-Noguer

Motion prediction is a classic problem in computer vision, which aims at forecasting future motion given the observed pose sequence. Various deep learning models have been proposed, achieving state-of-the-art performance on motion…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Pengxiang Su , Zhenguang Liu , Shuang Wu , Lei Zhu , Yifang Yin , Xuanjing Shen

Gestures play a key role in human communication. Recent methods for co-speech gesture generation, while managing to generate beat-aligned motions, struggle generating gestures that are semantically aligned with the utterance. Compared to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Muhammad Hamza Mughal , Rishabh Dabral , Ikhsanul Habibie , Lucia Donatelli , Marc Habermann , Christian Theobalt

Machine learning methods have been shown to be effective for weather forecasting, based on the speed and accuracy compared to traditional numerical models. While early efforts primarily concentrated on deterministic predictions, the field…

Machine Learning · Computer Science 2025-04-11 Erik Larsson , Joel Oskarsson , Tomas Landelius , Fredrik Lindsten

Long-term human motion prediction (LHMP) is important for the safe and efficient operation of autonomous robots and vehicles in environments shared with humans. Accurate predictions are important for applications including motion planning,…

Robotics · Computer Science 2025-10-06 Yufei Zhu , Andrey Rudenko , Tomasz P. Kucner , Achim J. Lilienthal , Martin Magnusson

Video generation models have achieved notable progress in static scenarios, yet their performance in motion video generation remains limited, with quality degrading under drastic dynamic changes. This is due to noise disrupting temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Meiqi Wu , Bingze Song , Ruimin Lin , Chen Zhu , Xiaokun Feng , Jiahong Wu , Xiangxiang Chu , Kaiqi Huang

Recent work has explored a range of model families for human motion generation, including Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and diffusion-based models. Despite their differences, many methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 David Björkstrand , Tiesheng Wang , Lars Bretzner , Josephine Sullivan

The modeling of human motion using machine learning methods has been widely studied. In essence it is a time-series modeling problem involving predicting how a person will move in the future given how they moved in the past. Existing…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Yan Zhang , Michael J. Black , Siyu Tang

Human mobility clustering is an important problem for understanding human mobility behaviors (e.g., work and school commutes). Existing methods typically contain two steps: choosing or learning a mobility representation and applying a…

Machine Learning · Computer Science 2023-01-23 Haoji Hu , Haowen Lin , Yao-Yi Chiang

Human-in-the-loop (HitL) robot deployment has gained significant attention in both academia and industry as a semi-autonomous paradigm that enables human operators to intervene and adjust robot behaviors at deployment time, improving…

Machine Learning · Computer Science 2025-10-10 Zhanpeng He , Yifeng Cao , Matei Ciocarlie

The ability to predict the future trajectories of traffic participants is crucial for the safe and efficient operation of autonomous vehicles. In this paper, a diffusion-based generative model for multi-agent trajectory prediction is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Theodor Westny , Björn Olofsson , Erik Frisk