English
Related papers

Related papers: Nonisotropic Gaussian Diffusion for Realistic 3D H…

200 papers

Thanks to the powerful generative capacity of diffusion models, recent years have witnessed rapid progress in human motion generation. Existing diffusion-based methods employ disparate network architectures and training strategies. The…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yiheng Huang , Hui Yang , Chuanchen Luo , Yuxi Wang , Shibiao Xu , Zhaoxiang Zhang , Man Zhang , Junran Peng

4D generation has made remarkable progress in synthesizing dynamic 3D objects from input text, images, or videos. However, existing methods often represent motion as an implicit deformation field, which limits direct control and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Lifan Wu , Ruijie Zhu , Yubo Ai , Tianzhu Zhang

While diffusion models can successfully generate data and make predictions, they are predominantly designed for static images. We propose an approach for efficiently training diffusion models for probabilistic spatiotemporal forecasting,…

Machine Learning · Computer Science 2023-10-12 Salva Rühling Cachay , Bo Zhao , Hailey Joren , Rose Yu

Several applications such as autonomous driving, augmented reality and virtual reality require a precise prediction of the 3D human pose. Recently, a new problem was introduced in the field to predict the 3D human poses from observed 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Abduallah Mohamed , Huancheng Chen , Zhangyang Wang , Christian Claudel

We investigate a new task in human motion prediction, which is predicting motions under unexpected physical perturbation potentially involving multiple people. Compared with existing research, this task involves predicting less controlled,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jiangbei Yue , Baiyi Li , Julien Pettré , Armin Seyfried , He Wang

Tendon-driven continuum robot kinematic models are frequently computationally expensive, inaccurate due to unmodeled effects, or both. In particular, unmodeled effects produce uncertainties that arise during the robot's operation that lead…

Robotics · Computer Science 2024-04-08 Jordan Thompson , Brian Y. Cho , Daniel S. Brown , Alan Kuntz

Human motion understanding and prediction is an integral aspect in our pursuit of machine intelligence and human-machine interaction systems. Current methods typically pursue a kinematics modeling approach, relying heavily upon prior…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Kedi Lyu , Zhenguang Liu , Shuang Wu , Haipeng Chen , Xuhong Zhang , Yuyu Yin

Human motion modeling is important for many modern graphics applications, which typically require professional skills. In order to remove the skill barriers for laymen, recent motion generation methods can directly generate human motions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Mingyuan Zhang , Zhongang Cai , Liang Pan , Fangzhou Hong , Xinying Guo , Lei Yang , Ziwei Liu

After many researchers observed fruitfulness from the recent diffusion probabilistic model, its effectiveness in image generation is actively studied these days. In this paper, our objective is to evaluate the potential of diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Hyemin Ahn , Esteve Valls Mascaro , Dongheui Lee

In Multiple Object Tracking, objects often exhibit non-linear motion of acceleration and deceleration, with irregular direction changes. Tacking-by-detection (TBD) trackers with Kalman Filter motion prediction work well in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Weiyi Lv , Yuhang Huang , Ning Zhang , Ruei-Sung Lin , Mei Han , Dan Zeng

Trajectory prediction is confronted with the dilemma to capture the multi-modal nature of future dynamics with both diversity and accuracy. In this paper, we present a distribution discrimination (DisDis) method to predict personalized…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Guangyi Chen , Junlong Li , Nuoxing Zhou , Liangliang Ren , Jiwen Lu

We propose a novel Transformer-based architecture for the task of generative modelling of 3D human motion. Previous work commonly relies on RNN-based models considering shorter forecast horizons reaching a stationary and often implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Emre Aksan , Manuel Kaufmann , Peng Cao , Otmar Hilliges

To model the indeterminacy of human behaviors, stochastic trajectory prediction requires a sophisticated multi-modal distribution of future trajectories. Emerging diffusion models have revealed their tremendous representation capacities in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Weibo Mao , Chenxin Xu , Qi Zhu , Siheng Chen , Yanfeng Wang

Animation of 2D hand-drawn sketches provides an effective medium for visual communication. However, these sketches pose challenges, particularly in handling occlusions and accurately mapping motion. While 3D animation naturally addresses…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Gaurav Rai , Ojaswa Sharma

In recent years, there has been rapid development in 3D generation models, opening up new possibilities for applications such as simulating the dynamic movements of 3D objects and customizing their behaviors. However, current 3D generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Fangfu Liu , Hanyang Wang , Shunyu Yao , Shengjun Zhang , Jie Zhou , Yueqi Duan

Denoising diffusion models have shown great promise in human motion synthesis conditioned on natural language descriptions. However, integrating spatial constraints, such as pre-defined motion trajectories and obstacles, remains a challenge…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Korrawe Karunratanakul , Konpat Preechakul , Supasorn Suwajanakorn , Siyu Tang

We propose a simple and novel method for generating 3D human motion from complex natural language sentences, which describe different velocity, direction and composition of all kinds of actions. Different from existing methods that use…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zhiyuan Ren , Zhihong Pan , Xin Zhou , Le Kang

Human motion prediction is a challenging and important task in many computer vision application domains. Existing work only implicitly models the spatial structure of the human skeleton. In this paper, we propose a novel approach that…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Emre Aksan , Manuel Kaufmann , Otmar Hilliges

Accurate 3D human pose estimation remains a critical yet unresolved challenge, requiring both temporal coherence across frames and fine-grained modeling of joint relationships. However, most existing methods rely solely on geometric cues…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Jerrin Bright , Yuhao Chen , John S. Zelek

Self-supervised learning has proved effective for skeleton-based human action understanding. However, previous works either rely on contrastive learning that suffers false negative problems or are based on reconstruction that learns too…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Lehong Wu , Lilang Lin , Jiahang Zhang , Yiyang Ma , Jiaying Liu