中文
相关论文

相关论文: Marrying Text-to-Motion Generation with Skeleton-B…

200 篇论文

Human action recognition is a crucial task for intelligent robotics, particularly within the context of human-robot collaboration research. In self-supervised skeleton-based action recognition, the mask-based reconstruction paradigm learns…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Wei Wei , Shaojie Zhang , Yonghao Dang , Jianqin Yin

Data generation is a data augmentation technique for enhancing the generalization ability for skeleton-based human action recognition. Most existing data generation methods face challenges to ensure the temporal consistency of the dynamic…

计算机视觉与模式识别 · 计算机科学 2024-01-31 Long Liu , Xin Wang , Fangming Li , Jiayu Chen

Vision-based human activity recognition (HAR) has made substantial progress in recognizing predefined gestures but lacks adaptability for emerging activities. This paper introduces a paradigm shift by harnessing generative modeling and…

Generating human motions from textual descriptions has gained growing research interest due to its wide range of applications. However, only a few works consider human-scene interactions together with text conditions, which is crucial for…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Zhi Cen , Huaijin Pi , Sida Peng , Zehong Shen , Minghui Yang , Shuai Zhu , Hujun Bao , Xiaowei Zhou

Conditional motion generation has been extensively studied in computer vision, yet two critical challenges remain. First, while masked autoregressive methods have recently outperformed diffusion-based approaches, existing masking models…

计算机视觉与模式识别 · 计算机科学 2025-03-13 Zeyu Zhang , Yiran Wang , Wei Mao , Danning Li , Rui Zhao , Biao Wu , Zirui Song , Bohan Zhuang , Ian Reid , Richard Hartley

Text-motion retrieval aims to learn a semantically aligned latent space between natural language descriptions and 3D human motion skeleton sequences, enabling bidirectional search across the two modalities. Most existing methods use a…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Yao Zhang , Zhuchenyang Liu , Yanlan He , Thomas Ploetz , Yu Xiao

Current techniques face difficulties in generating motions from intricate semantic descriptions, primarily due to insufficient semantic annotations in datasets and weak contextual understanding. To address these issues, we present…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Xin He , Shaoli Huang , Xiaohang Zhan , Chao Weng , Ying Shan

Text-driven motion generation has attracted increasing attention due to its broad applications in virtual reality, animation, and robotics. While existing methods typically model human and animal motion separately, a joint cross-species…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Xuan Wang , Kai Ruan , Liyang Qian , Zhizhi Guo , Chang Su , Gaoang Wang

This paper investigates body bones from skeleton data for skeleton based action recognition. Body joints, as the direct result of mature pose estimation technologies, are always the key concerns of traditional action recognition methods.…

计算机视觉与模式识别 · 计算机科学 2018-06-01 Xikun Zhang , Chang Xu , Xinmei Tian , Dacheng Tao

Pose-estimation methods enable extracting human motion from common videos in the structured form of 3D skeleton sequences. Despite great application opportunities, effective content-based access to such spatio-temporal motion data is a…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Nicola Messina , Jan Sedmidubsky , Fabrizio Falchi , Tomáš Rebok

Markerless motion capture has become an active field of research in computer vision in recent years. Its extensive applications are known in a great variety of fields, including computer animation, human motion analysis, biomedical…

计算机视觉与模式识别 · 计算机科学 2022-01-10 Doan Duy Vo , Russell Butler

Generating 3D human motion from text descriptions remains challenging due to the diverse and complex nature of human motion. While existing methods excel within the training distribution, they often struggle with out-of-distribution…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Zongye Zhang , Bohan Kong , Qingjie Liu , Yunhong Wang

Retargeting motion between characters with different skeleton structures is a fundamental challenge in computer animation. When source and target characters have vastly different bone arrangements, maintaining the original motion's…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Siqi Liu , Maoyu Wang , Bo Dai , Cewu Lu

The ability to identify and temporally segment fine-grained actions in motion capture sequences is crucial for applications in human movement analysis. Motion capture is typically performed with optical or inertial measurement systems,…

计算机视觉与模式识别 · 计算机科学 2022-12-20 Benjamin Filtjens , Bart Vanrumste , Peter Slaets

Human communication is inherently multimodal, involving a combination of verbal and non-verbal cues such as speech, facial expressions, and body gestures. Modeling these behaviors is essential for understanding human interaction and for…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Changan Chen , Juze Zhang , Shrinidhi K. Lakshmikanth , Yusu Fang , Ruizhi Shao , Gordon Wetzstein , Li Fei-Fei , Ehsan Adeli

This report reviews recent advancements in human motion prediction, reconstruction, and generation. Human motion prediction focuses on forecasting future poses and movements from historical data, addressing challenges like nonlinear…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Canxuan Gang , Yiran Wang

Recently, human motion analysis has experienced great improvement due to inspiring generative models such as the denoising diffusion model and large language model. While the existing approaches mainly focus on generating motions with…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Yiming Wu , Wei Ji , Kecheng Zheng , Zicheng Wang , Dong Xu

We address the problem of generating diverse 3D human motions from textual descriptions. This challenging task requires joint modeling of both modalities: understanding and extracting useful human-centric information from the text, and then…

计算机视觉与模式识别 · 计算机科学 2022-07-25 Mathis Petrovich , Michael J. Black , Gül Varol

Text-to-motion generation has recently garnered significant research interest, primarily focusing on generating human motion sequences in blank backgrounds. However, human motions commonly occur within diverse 3D scenes, which has prompted…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Ziyan Guo , Haoxuan Qu , Hossein Rahmani , Dewen Soh , Ping Hu , Qiuhong Ke , Jun Liu

Text-driven motion generation has advanced significantly with the rise of denoising diffusion models. However, previous methods often oversimplify representations for the skeletal joints, temporal frames, and textual words, limiting their…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Seokhyeon Hong , Chaelin Kim , Serin Yoon , Junghyun Nam , Sihun Cha , Junyong Noh