English
Related papers

Related papers: Taxonomy-aware Dynamic Motion Generation on Hyperb…

200 papers

Geometric representation learning has recently shown great promise in several machine learning settings, ranging from relational learning to language processing and generative models. In this work, we consider the problem of performing…

Machine Learning · Statistics 2020-05-29 Gian Maria Marconi , Lorenzo Rosasco , Carlo Ciliberto

With potential applications in fields including intelligent surveillance and human-robot interaction, the human motion prediction task has become a hot research topic and also has achieved high success, especially using the recent Graph…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Wanying Zhang , Shen Zhao , Fanyang Meng , Songtao Wu , Mengyuan Liu

Human-motion generation is a long-standing challenging task due to the requirement of accurately modeling complex and diverse dynamic patterns. Most existing methods adopt sequence models such as RNN to directly model transitions in the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Zhenyi Wang , Ping Yu , Yang Zhao , Ruiyi Zhang , Yufan Zhou , Junsong Yuan , Changyou Chen

Realistic human geometry generation is an important yet challenging task, requiring both the preservation of fine clothing details and the accurate modeling of clothing-body interactions. To tackle this challenge, we build upon Geometry…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Xiangjun Tang , Biao Zhang , Peter Wonka

In this work, we investigate a simple and must-known conditional generative framework based on Vector Quantised-Variational AutoEncoder (VQ-VAE) and Generative Pre-trained Transformer (GPT) for human motion generation from textural…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jianrong Zhang , Yangsong Zhang , Xiaodong Cun , Shaoli Huang , Yong Zhang , Hongwei Zhao , Hongtao Lu , Xi Shen

In this paper, we extend a famous motion planning approach GPMP2 to multi-robot cases, yielding a novel centralized trajectory generation method for the multi-robot formation. A sparse Gaussian Process model is employed to represent the…

Robotics · Computer Science 2021-08-02 Shuang Guo , Bo Liu , Shen Zhang , Jifeng Guo , Changhong Wang

This paper introduces MotionGlot, a model that can generate motion across multiple embodiments with different action dimensions, such as quadruped robots and human bodies. By leveraging the well-established training procedures commonly used…

Robotics · Computer Science 2025-05-02 Sudarshan Harithas , Srinath Sridhar

The generation of energy-efficient and dynamic-aware robot motions that satisfy constraints such as joint limits, self-collisions, and collisions with the environment remains a challenge. In this context, Riemannian geometry offers…

Robotics · Computer Science 2023-07-31 Holger Klein , Noémie Jaquier , Andre Meixner , Tamim Asfour

Text-driven human motion generation in computer vision is both significant and challenging. However, current methods are limited to producing either deterministic or imprecise motion sequences, failing to effectively control the temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Yin Wang , Zhiying Leng , Frederick W. B. Li , Shun-Cheng Wu , Xiaohui Liang

In this work, we develop an automated method to generate 3D human walking motion in simulation which is comparable to real-world human motion. At the core, our work leverages the ability of deep reinforcement learning methods to learn…

Robotics · Computer Science 2021-03-16 Visak Kumar

This paper proposed a hierarchical visible autoencoder in the adaptive phantom limbs generation according to the kinetic behavior of functional body-parts, which are measured by heterogeneous kinetic sensors. The proposed visible…

Human-Computer Interaction · Computer Science 2019-10-07 Dakila Ledesma , Yu Liang , Dalei Wu

Robots can rapidly acquire new skills from demonstrations. However, during generalisation of skills or transitioning across fundamentally different skills, it is unclear whether the robot has the necessary knowledge to perform the task.…

Machine Learning · Statistics 2018-08-08 Nutan Chen , Alexej Klushyn , Alexandros Paraschos , Djalel Benbouzid , Patrick van der Smagt

This work focuses on generating realistic, physically-based human behaviors from multi-modal inputs, which may only partially specify the desired motion. For example, the input may come from a VR controller providing arm motion and body…

Robotics · Computer Science 2025-02-11 Aayam Shrestha , Pan Liu , German Ros , Kai Yuan , Alan Fern

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as…

Robotics · Computer Science 2022-04-29 Sunwoo Kim , Maks Sorokin , Jehee Lee , Sehoon Ha

We propose an algorithm grounded in dynamical systems theory that generalizes manifold learning from a global state representation, to a network of local interacting manifolds termed a Generative Manifold Network (GMN). Manifolds are…

Dance serves as a powerful medium for expressing human emotions, but the lifelike generation of dance is still a considerable challenge. Recently, diffusion models have showcased remarkable generative abilities across various domains. They…

Sound · Computer Science 2024-06-25 Canyu Zhang , Youbao Tang , Ning Zhang , Ruei-Sung Lin , Mei Han , Jing Xiao , Song Wang

Quadruped robots face persistent challenges in achieving versatile locomotion due to limitations in reference motion data diversity. To address these challenges, we introduce an in-between motion generation based multi-style quadruped robot…

Robotics · Computer Science 2025-08-12 Yuanhao Chen , Liu Zhao , Ji Ma , Peng Lu

This work presents a methodology for modeling and predicting human behavior in settings with N humans interacting in highly multimodal scenarios (i.e. where there are many possible highly-distinct futures). A motivating example includes…

Robotics · Computer Science 2018-07-27 Boris Ivanovic , Edward Schmerling , Karen Leung , Marco Pavone

Diffusion models have made significant contributions to computer vision, sparking a growing interest in the community recently regarding the application of them to graph generation. Existing discrete graph diffusion models exhibit…

Machine Learning · Computer Science 2024-05-07 Xingcheng Fu , Yisen Gao , Yuecen Wei , Qingyun Sun , Hao Peng , Jianxin Li , Xianxian Li

Generating realistic human videos remains a challenging task, with the most effective methods currently relying on a human motion sequence as a control signal. Existing approaches often use existing motion extracted from other videos, which…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Hsin-Ping Huang , Yang Zhou , Jui-Hsien Wang , Difan Liu , Feng Liu , Ming-Hsuan Yang , Zhan Xu