English
Related papers

Related papers: A structured latent space for human body motion ge…

200 papers

In multi-view human body capture systems, the recovered 3D geometry or even the acquired imagery data can be heavily corrupted due to occlusions, noise, limited field of- view, etc. Direct estimation of 3D pose, body shape or motion on…

Computer Vision and Pattern Recognition · Computer Science 2018-02-02 Zhong Li , Yu Ji , Wei Yang , Jinwei Ye , Jingyi Yu

Co-speech gestures, if presented in the lively form of videos, can achieve superior visual effects in human-machine interaction. While previous works mostly generate structural human skeletons, resulting in the omission of appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xu He , Qiaochu Huang , Zhensong Zhang , Zhiwei Lin , Zhiyong Wu , Sicheng Yang , Minglei Li , Zhiyi Chen , Songcen Xu , Xiaofei Wu

Estimating the body shape and posture of a dressed human subject in motion represented as a sequence of (possibly incomplete) 3D meshes is important for virtual change rooms and security. To solve this problem, statistical shape spaces…

Computer Vision and Pattern Recognition · Computer Science 2015-03-30 Stefanie Wuhrer , Leonid Pishchulin , Alan Brunton , Chang Shu , Jochen Lang

We present DIMO, a generative approach capable of generating diverse 3D motions for arbitrary objects from a single image. The core idea of our work is to leverage the rich priors in well-trained video models to extract the common motion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Linzhan Mou , Jiahui Lei , Chen Wang , Lingjie Liu , Kostas Daniilidis

We present a system that allows users to visualize complex human motion via 3D motion sculptures---a representation that conveys the 3D structure swept by a human body as it moves through space. Given an input video, our system computes the…

Human-Computer Interaction · Computer Science 2019-01-03 Xiuming Zhang , Tali Dekel , Tianfan Xue , Andrew Owens , Qiurui He , Jiajun Wu , Stefanie Mueller , William T. Freeman

Human motion synthesis is an important task in computer graphics and computer vision. While focusing on various conditioning signals such as text, action class, or audio to guide the generation process, most existing methods utilize…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Kebing Xue , Hyewon Seo

In this work, we introduce an unconditional video generative model, InMoDeGAN, targeted to (a) generate high quality videos, as well as to (b) allow for interpretation of the latent space. For the latter, we place emphasis on interpreting…

Computer Vision and Pattern Recognition · Computer Science 2021-01-11 Yaohui Wang , Francois Bremond , Antitza Dantcheva

We propose ArtiLatent, a generative framework that synthesizes human-made 3D objects with fine-grained geometry, accurate articulation, and realistic appearance. Our approach jointly models part geometry and articulation dynamics by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Honghua Chen , Yushi Lan , Yongwei Chen , Xingang Pan

We present a versatile latent representation that enables physically simulated character to efficiently utilize motion priors. To build a powerful motion embedding that is shared across multiple tasks, the physics controller should employ…

Graphics · Computer Science 2025-03-18 Jinseok Bae , Jungdam Won , Donggeun Lim , Inwoo Hwang , Young Min Kim

Human communication is inherently multimodal, involving a combination of verbal and non-verbal cues such as speech, facial expressions, and body gestures. Modeling these behaviors is essential for understanding human interaction and for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Changan Chen , Juze Zhang , Shrinidhi K. Lakshmikanth , Yusu Fang , Ruizhi Shao , Gordon Wetzstein , Li Fei-Fei , Ehsan Adeli

Investigating the impact of fatigue on human physiological function and motor behavior is crucial for developing biomechanics and medical applications aimed at mitigating fatigue, reducing injury risk, and creating sophisticated ergonomic…

Graphics · Computer Science 2026-04-14 Iliana Loi , Konstantinos Moustakas

We present a structured graph variational autoencoder for generating the layout of indoor 3D scenes. Given the room type (e.g., living room or library) and the room layout (e.g., room elements such as floor and walls), our architecture…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Aditya Chattopadhyay , Xi Zhang , David Paul Wipf , Himanshu Arora , Rene Vidal

In this paper, we introduce a novel path to $\textit{general}$ human motion generation by focusing on 2D space. Traditional methods have primarily generated human motions in 3D, which, while detailed and realistic, are often limited by the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yuan Wang , Zhao Wang , Junhao Gong , Di Huang , Tong He , Wanli Ouyang , Jile Jiao , Xuetao Feng , Qi Dou , Shixiang Tang , Dan Xu

Different encodings of datapoints in the latent space of latent-vector generative models may result in more or less effective and disentangled characterizations of the different explanatory factors of variation behind the data. Many works…

Machine Learning · Computer Science 2022-07-15 Andrea Asperti , Valerio Tonelli

Skeleton generation is essential for animating 3D assets, but current deep learning methods remain limited: they cannot handle the growing structural complexity of modern models and offer minimal controllability, creating a major bottleneck…

Human motion generation has advanced rapidly in recent years, yet the critical problem of creating spatially grounded, context-aware gestures has been largely overlooked. Existing models typically specialize either in descriptive motion…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Anna Deichler , Jim O'Regan , Teo Guichoux , David Johansson , Jonas Beskow

Human motion generation involves creating natural sequences of human body poses, widely used in gaming, virtual reality, and human-computer interaction. It aims to produce lifelike virtual characters with realistic movements, enhancing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiayi Zhao , Dongdong Weng , Qiuxin Du , Zeyu Tian

Analyzing human motion is a challenging task with a wide variety of applications in computer vision and in graphics. One such application, of particular importance in computer animation, is the retargeting of motion from one performer to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Kfir Aberman , Rundi Wu , Dani Lischinski , Baoquan Chen , Daniel Cohen-Or

Generating 3D human motion based on textual descriptions has been a research focus in recent years. It requires the generated motion to be diverse, natural, and conform to the textual description. Due to the complex spatio-temporal nature…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Chongyang Zhong , Lei Hu , Zihao Zhang , Shihong Xia

We address the problem of generating diverse 3D human motions from textual descriptions. This challenging task requires joint modeling of both modalities: understanding and extracting useful human-centric information from the text, and then…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Mathis Petrovich , Michael J. Black , Gül Varol