English
Related papers

Related papers: Robust Human Motion Forecasting using Transformer-…

200 papers

Human motion modeling is a classic problem in computer vision and graphics. Challenges in modeling human motion include high dimensional prediction as well as extremely complicated dynamics.We present a novel approach to human motion…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Chen Li , Zhen Zhang , Wee Sun Lee , Gim Hee Lee

Accurate traffic flow prediction is essential for applications like transport logistics but remains challenging due to complex spatio-temporal correlations and non-linear traffic patterns. Existing methods often model spatial and temporal…

Machine Learning · Computer Science 2025-03-18 Jing Chen , Haocheng Ye , Zhian Ying , Yuntao Sun , Wenqiang Xu

3D human motion prediction aims to generate coherent future motions from observed sequences, yet existing end-to-end regression frameworks often fail to capture complex dynamics and tend to produce temporally inconsistent or static…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Junyu Shi , Haoting Wu , Zhiyuan Zhang , Lijiang Liu , Yong Sun , Qiang Nie

The ability to accurately predict feasible multimodal future trajectories of surrounding traffic participants is crucial for behavior planning in autonomous vehicles. The Motion Transformer (MTR), a state-of-the-art motion prediction…

Motivated by the vision of integrating mobile robots closer to humans in warehouses, hospitals, manufacturing plants, and the home, we focus on robot navigation in dynamic and spatially constrained environments. Ensuring human safety,…

The objective of this work is to improve the accuracy of building demand forecasting. This is a more challenging task than grid level forecasting. For the said purpose, we develop a new technique called recurrent transform learning (RTL).…

Machine Learning · Computer Science 2019-12-12 Megha Gupta , Angshul Majumdar

We propose RoHM, an approach for robust 3D human motion reconstruction from monocular RGB(-D) videos in the presence of noise and occlusions. Most previous approaches either train neural networks to directly regress motion in 3D or learn…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Siwei Zhang , Bharat Lal Bhatnagar , Yuanlu Xu , Alexander Winkler , Petr Kadlecek , Siyu Tang , Federica Bogo

Over the years, the separate fields of motion planning, mapping, and human trajectory prediction have advanced considerably. However, the literature is still sparse in providing practical frameworks that enable mobile manipulators to…

Robotics · Computer Science 2022-07-27 Mark Nicholas Finean , Luka Petrović , Wolfgang Merkt , Ivan Marković , Ioannis Havoutis

Autonomous systems and humans are increasingly sharing the same space. Robots work side by side or even hand in hand with humans to balance each other's limitations. Such cooperative interactions are ever more sophisticated. Thus, the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Tim Salzmann , Marco Pavone , Markus Ryll

Imitation learning for robotic manipulation faces a fundamental challenge: the scarcity of large-scale, high-quality robot demonstration data. Recent robotic foundation models often pre-train on cross-embodiment robot datasets to increase…

Robotics · Computer Science 2025-08-04 Hongzhe Bi , Lingxuan Wu , Tianwei Lin , Hengkai Tan , Zhizhong Su , Hang Su , Jun Zhu

Recent advances in deep learning have enabled the generation of videos from textual descriptions as well as the prediction of future sequences from input videos. Similarly, in human motion modeling, motions can be generated from text or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Masato Soga , Ryuki Takebayashi

3D human motion forecasting aims to enable autonomous applications. Estimating uncertainty for each prediction (i.e., confidence based on probability density or quantile) is essential for safety-critical contexts like human-robot…

Robotics · Computer Science 2025-07-22 Yue Ma , Kanglei Zhou , Fuyang Yu , Frederick W. B. Li , Xiaohui Liang

Monocular 3D human pose estimation technologies have the potential to greatly increase the availability of human movement data. The best-performing models for single-image 2D-3D lifting use graph convolutional networks (GCNs) that typically…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Sebastian Lutz , Richard Blythman , Koustav Ghosal , Matthew Moynihan , Ciaran Simms , Aljosa Smolic

The task of predicting future actions from a video is crucial for a real-world agent interacting with others. When anticipating actions in the distant future, we humans typically consider long-term relations over the whole sequence of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Dayoung Gong , Joonseok Lee , Manjin Kim , Seong Jong Ha , Minsu Cho

We present a learning-based model to infer the personalized 3D shape of people from a few frames (1-8) of a monocular video in which the person is moving, in less than 10 seconds with a reconstruction accuracy of 5mm. Our model learns to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Thiemo Alldieck , Marcus Magnor , Bharat Lal Bhatnagar , Christian Theobalt , Gerard Pons-Moll

Distilling knowledge from human demonstrations is a promising way for robots to learn and act. Existing methods, which often rely on coarsely-aligned video pairs, are typically constrained to learning global or task-level features. As a…

Robotics · Computer Science 2025-11-18 Sicheng Xie , Haidong Cao , Zejia Weng , Zhen Xing , Haoran Chen , Shiwei Shen , Jiaqi Leng , Zuxuan Wu , Yu-Gang Jiang

Motion prediction is crucial for autonomous driving systems to understand complex driving scenarios and make informed decisions. However, this task is challenging due to the diverse behaviors of traffic participants and complex…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shaoshuai Shi , Li Jiang , Dengxin Dai , Bernt Schiele

In physical Human-Robot Collaboration (pHRC), accurate human intent estimation and rational human-robot role allocation are crucial for safe and efficient assistance. Existing methods that rely on short-term motion data for intention…

Robotics · Computer Science 2025-05-27 Haotian Liu , Yuchuang Tong , Zhengtao Zhang

Classification and localization of driving actions over time is important for advanced driver-assistance systems and naturalistic driving studies. Temporal localization is challenging because it requires robustness, reliability, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Erkut Akdag , Zeqi Zhu , Egor Bondarev , Peter H. N. De With

3D human pose estimation captures the human joint points in three-dimensional space while keeping the depth information and physical structure. That is essential for applications that require precise pose information, such as human-computer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jianbin Jiao , Xina Cheng , Weijie Chen , Xiaoting Yin , Hao Shi , Kailun Yang