English
Related papers

Related papers: Dynamical Deep Generative Latent Modeling of 3D Sk…

200 papers

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee

This paper aims to deal with the ignored real-world complexities in prior work on human motion forecasting, emphasizing the social properties of multi-person motion, the diversity of motion and social interactions, and the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Sirui Xu , Yu-Xiong Wang , Liang-Yan Gui

We put forward a new Bayesian modeling strategy for spatiotemporal count data that enables efficient posterior sampling. Most previous models for such data decompose logarithms of the response Poisson rates into fixed effects and spatial…

Methodology · Statistics 2025-07-29 Yifan Cheng , Cheng Li

Motion prediction is a classic problem in computer vision, which aims at forecasting future motion given the observed pose sequence. Various deep learning models have been proposed, achieving state-of-the-art performance on motion…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Pengxiang Su , Zhenguang Liu , Shuang Wu , Lei Zhu , Yifang Yin , Xuanjing Shen

Skeleton-based human action recognition aims to classify human skeletal sequences, which are spatiotemporal representations of actions, into predefined categories. To reduce the reliance on costly annotations of skeletal sequences while…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Zhigang Tu , Zhengbo Zhang , Jia Gong , Junsong Yuan , Bo Du

A new dynamic latent space eigenmodel (LSM) is proposed for weighted temporal networks. The model accommodates integer-valued weights, excess of zeros, time-varying node positions (features), and time-varying network sparsity. The latent…

Methodology · Statistics 2026-04-15 Roberto Casarin , Matteo Iacopini , Antonio Peruzzi

We propose a generative model for single-channel EEG that incorporates the constraints experts actively enforce during visual scoring. The framework takes the form of a dynamic Bayesian network with depth in both the latent variables and…

Machine Learning · Computer Science 2021-03-04 Carlos A. Loza , Laura L. Colgin

Deep learning research has made many biometric recognition solution viable, but it requires vast training data to achieve real-world generalization. Unlike other biometric traits, such as face and ear, gait samples cannot be easily crawled…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Cole Hill , Mauricio Pamplona Segundo , Sudeep Sarkar

Given (small amounts of) time-series' data from a high-dimensional, fine-grained, multiscale dynamical system, we propose a generative framework for learning an effective, lower-dimensional, coarse-grained dynamical model that is predictive…

Machine Learning · Statistics 2021-01-18 Sebastian Kaltenbach , Phaedon-Stelios Koutsourelakis

Videos of robots interacting with objects encode rich information about the objects' dynamics. However, existing video prediction approaches typically do not explicitly account for the 3D information from videos, such as robot actions and…

Robotics · Computer Science 2024-10-25 Mingtong Zhang , Kaifeng Zhang , Yunzhu Li

Various deep learning techniques have been proposed to solve the single-view 2D-to-3D pose estimation problem. While the average prediction accuracy has been improved significantly over the years, the performance on hard poses with depth…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Ailing Zeng , Xiao Sun , Lei Yang , Nanxuan Zhao , Minhao Liu , Qiang Xu

Studies on the automatic processing of 3D human pose data have flourished in the recent past. In this paper, we are interested in the generation of plausible and diverse future human poses following an observed 3D pose sequence. Current…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Xiaoyu Bie , Wen Guo , Simon Leglaive , Lauren Girin , Francesc Moreno-Noguer , Xavier Alameda-Pineda

The ability to generate complex and realistic human body animations at scale, while following specific artistic constraints, has been a fundamental goal for the game and animation industry for decades. Popular techniques include…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Yi Zhou , Jingwan Lu , Connelly Barnes , Jimei Yang , Sitao Xiang , Hao li

Skeleton data, which consists of only the 2D/3D coordinates of the human joints, has been widely studied for human action recognition. Existing methods take the semantics as prior knowledge to group human joints and draw correlations…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Lei Shi , Yifan Zhang , Jian Cheng , Hanqing Lu

A core problem in machine learning is to learn expressive latent variables for model prediction on complex data that involves multiple sub-components in a flexible and interpretable fashion. Here, we develop an approach that improves…

Machine Learning · Computer Science 2024-02-13 Yi-Lin Tuan , Zih-Yun Chiu , William Yang Wang

Recent advances in dance generation have enabled the automatic synthesis of 3D dance motions. However, existing methods still face significant challenges in simultaneously achieving high realism, precise dance-music synchronization, diverse…

Deep neural networks have become increasingly of interest in dynamical system prediction, but out-of-distribution generalization and long-term stability still remains challenging. In this work, we treat the domain parameters of dynamical…

Machine Learning · Computer Science 2023-06-02 Stathi Fotiadis , Mario Lino , Shunlong Hu , Stef Garasto , Chris D Cantwell , Anil Anthony Bharath

Probabilistic human motion prediction aims to forecast multiple possible future movements from past observations. While current approaches report high diversity and realism, they often generate motions with undetected limb stretching and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Cecilia Curreli , Dominik Muhle , Abhishek Saroha , Zhenzhang Ye , Riccardo Marin , Daniel Cremers

The ability to identify and temporally segment fine-grained actions in motion capture sequences is crucial for applications in human movement analysis. Motion capture is typically performed with optical or inertial measurement systems,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Benjamin Filtjens , Bart Vanrumste , Peter Slaets

The paper describes a program which computes the best possible Bayesian model of 3D space from vision (in bees) or echo location (in bats), at Marrs [1982] Level 2. The model exploits the strong Bayesian prior probability that most other…

Neurons and Cognition · Quantitative Biology 2024-05-16 Robert Worden