English
Related papers

Related papers: Fine-grained text-driven dual-human motion generat…

200 papers

This paper investigates the problem of efficient computation of physically consistent multi-contact behaviors. Recent work showed that under mild assumptions, the problem could be decomposed into simpler kinematic and centroidal dynamic…

Robotics · Computer Science 2021-02-19 Brahayam Ponton , Majid Khadiv , Avadesh Meduri , Ludovic Righetti

In dialogue generation, the naturalness of responses is crucial for effective human-machine interaction. Personalized response generation poses even greater challenges, as the responses must remain coherent and consistent with the user's…

Computation and Language · Computer Science 2025-06-18 Chih-Hao Hsu , Ying-Jia Lin , Hung-Yu Kao

Controlled execution of dynamic motions in quadrupedal robots, especially those with articulated soft bodies, presents a unique set of challenges that traditional methods struggle to address efficiently. In this study, we tackle these…

Robotics · Computer Science 2024-03-05 Francecso Vezzi , Jiatao Ding , Antonin Raffin , Jens Kober , Cosimo Della Santina

This paper aims to deal with the ignored real-world complexities in prior work on human motion forecasting, emphasizing the social properties of multi-person motion, the diversity of motion and social interactions, and the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Sirui Xu , Yu-Xiong Wang , Liang-Yan Gui

When hearing music, it is natural for people to dance to its rhythm. Automatic dance generation, however, is a challenging task due to the physical constraints of human motion and rhythmic alignment with target music. Conventional…

Graphics · Computer Science 2023-08-08 Qiaosong Qi , Le Zhuo , Aixi Zhang , Yue Liao , Fei Fang , Si Liu , Shuicheng Yan

Human motion prediction is an essential component for enabling closer human-robot collaboration. The task of accurately predicting human motion is non-trivial. It is compounded by the variability of human motion, both at a skeletal level…

Robotics · Computer Science 2021-07-02 Mohammad Samin Yasar , Tariq Iqbal

Human motion capture data has been widely used in data-driven character animation. In order to generate realistic, natural-looking motions, most data-driven approaches require considerable efforts of pre-processing, including motion…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Noshaba Cheema , Somayeh Hosseini , Janis Sprenger , Erik Herrmann , Han Du , Klaus Fischer , Philipp Slusallek

Fine-grained understanding of human actions and poses in videos is essential for human-centric AI applications. In this work, we introduce ActionArt, a fine-grained video-caption dataset designed to advance research in human-centric…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Yi-Xing Peng , Qize Yang , Yu-Ming Tang , Shenghao Fu , Kun-Yu Lin , Xihan Wei , Wei-Shi Zheng

Despite significant advancements in text-to-motion synthesis, generating language-guided human motion within 3D environments poses substantial challenges. These challenges stem primarily from (i) the absence of powerful generative models…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Zan Wang , Yixin Chen , Baoxiong Jia , Puhao Li , Jinlu Zhang , Jingze Zhang , Tengyu Liu , Yixin Zhu , Wei Liang , Siyuan Huang

Text-to-motion generation has gained increasing attention, but most existing methods are limited to generating short-term motions that correspond to a single sentence describing a single action. However, when a text stream describes a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Zhao Yang , Bing Su , Ji-Rong Wen

Text-to-motion generation has attracted increasing attention in the research community recently, with potential applications in animation, virtual reality, robotics, and human-computer interaction. Diffusion and autoregressive models are…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Kang Ding , Hongsong Wang , Jie Gui , Liang Wang

Multi-person interactive motion generation, a critical yet under-explored domain in computer character animation, poses significant challenges such as intricate modeling of inter-human interactions beyond individual motions and generating…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Boyuan Li , Xihua Wang , Ruihua Song , Wenbing Huang

Unsupervised large-scale vision-language pre-training has shown promising advances on various downstream tasks. Existing methods often model the cross-modal interaction either via the similarity of the global feature of each modality which…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Lewei Yao , Runhui Huang , Lu Hou , Guansong Lu , Minzhe Niu , Hang Xu , Xiaodan Liang , Zhenguo Li , Xin Jiang , Chunjing Xu

With the rapid advancement of game and film production, generating interactive motion from texts has garnered significant attention due to its potential to revolutionize content creation processes. In many practical applications, there is a…

Robotics · Computer Science 2025-02-18 Runqi Wang , Caoyuan Ma , Jian Zhao , Hanrui Xu , Dongfang Sun , Haoyang Chen , Lin Xiong , Zheng Wang , Xuelong Li

Recently, interactive digital human video generation has attracted widespread attention and achieved remarkable progress. However, building such a practical system that can interact with diverse input signals in real time remains…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Ming Chen , Liyuan Cui , Wenyuan Zhang , Haoxian Zhang , Yan Zhou , Xiaohan Li , Songlin Tang , Jiwen Liu , Borui Liao , Hejia Chen , Xiaoqiang Liu , Pengfei Wan

Generating long-term, coherent, and realistic music-conditioned dance sequences remains a challenging task in human motion synthesis. Existing approaches exhibit critical limitations: motion graph methods rely on fixed template libraries,…

Sound · Computer Science 2025-06-04 Mingyang Huang , Peng Zhang , Bang Zhang

3D human interaction generation has emerged as a key research area, focusing on producing dynamic and contextually relevant interactions between humans and various interactive entities. Recent rapid advancements in 3D model representation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Siyuan Fan , Wenke Huang , Xiantao Cai , Bo Du

Synthesizing multi-character interactions is a challenging task due to the complex and varied interactions between the characters. In particular, precise spatiotemporal alignment between characters is required in generating close…

Graphics · Computer Science 2022-08-05 Aman Goel , Qianhui Men , Edmond S. L. Ho

We introduce MUGL, a novel deep neural model for large-scale, diverse generation of single and multi-person pose-based action sequences with locomotion. Our controllable approach enables variable-length generations customizable by action…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Shubh Maheshwari , Debtanu Gupta , Ravi Kiran Sarvadevabhatla

In an era where visual content generation is increasingly driven by machine learning, the integration of human feedback into generative models presents significant opportunities for enhancing user experience and output quality. This study…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Dimitri von Rütte , Elisabetta Fedele , Jonathan Thomm , Lukas Wolf