English
Related papers

Related papers: CoheDancers: Enhancing Interactive Group Dance Gen…

200 papers

The seamless integration of music with dance movements is essential for communicating the artistic intent of a dance piece. This alignment also significantly improves the immersive quality of gaming experiences and animation productions.…

Sound · Computer Science 2024-09-16 Sifei Li , Weiming Dong , Yuxin Zhang , Fan Tang , Chongyang Ma , Oliver Deussen , Tong-Yee Lee , Changsheng Xu

Creating high-dynamic videos such as motion-rich actions and sophisticated visual effects poses a significant challenge in the field of artificial intelligence. Unfortunately, current state-of-the-art video generation methods, primarily…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Yan Zeng , Guoqiang Wei , Jiani Zheng , Jiaxin Zou , Yang Wei , Yuchen Zhang , Hang Li

Music-to-dance generation aims to translate auditory signals into expressive human motion, with broad applications in virtual reality, choreography, and digital entertainment. Despite promising progress, the limited generation efficiency of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Kaixing Yang , Xulong Tang , Ziqiao Peng , Xiangyue Zhang , Puwei Wang , Jun He , Hongyan Liu

In this paper, we propose a novel framework for music-driven dance motion synthesis with controllable key pose constraint. In contrast to methods that generate dance motion sequences only based on music without any other controllable…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Junfu Pu , Ying Shan

Existing music-driven dance generation approaches have achieved strong realism and effective audio-motion alignment. However, they generally lack semantic controllability, making it difficult to guide specific movements through natural…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Xinran Liu , Diptesh Kanojia , Wenwu Wang , Zhenhua Feng

Dancing to music is one of human's innate abilities since ancient times. In machine learning research, however, synthesizing dance movements from music is a challenging problem. Recently, researchers synthesize human motion sequences…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Ruozi Huang , Huang Hu , Wei Wu , Kei Sawada , Mi Zhang , Daxin Jiang

Music-to-dance generation has broad applications in virtual reality, dance education, and digital character animation. However, the limited coverage of existing 3D dance datasets confines current models to a narrow subset of music styles…

Artificial Intelligence · Computer Science 2026-03-31 Ziyue Yang , Kaixing Yang , Xulong Tang

Choreography creation requires high proficiency in artistic and technical skills. Choreographers typically go through four stages to create a dance piece: preparation, studio, performance, and reflection. This process is often…

Human-Computer Interaction · Computer Science 2024-05-29 Yimeng Liu , Misha Sra

Generating long-term, coherent, and realistic music-conditioned dance sequences remains a challenging task in human motion synthesis. Existing approaches exhibit critical limitations: motion graph methods rely on fixed template libraries,…

Sound · Computer Science 2025-06-04 Mingyang Huang , Peng Zhang , Bang Zhang

The advancement of generative AI has extended to the realm of Human Dance Generation, demonstrating superior generative capacities. However, current methods still exhibit deficiencies in achieving spatiotemporal consistency, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Haipeng Fang , Zhihao Sun , Ziyao Huang , Fan Tang , Juan Cao , Sheng Tang

How to automatically synthesize natural-looking dance movements based on a piece of music is an incrementally popular yet challenging task. Most existing data-driven approaches require hard-to-get paired training data and fail to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Bin Feng , Tenglong Ao , Zequn Liu , Wei Ju , Libin Liu , Ming Zhang

This paper presents an Exploratory 3D Dance generation framework, E3D2, designed to address the exploration capability deficiency in existing music-conditioned 3D dance generation models. Current models often generate monotonous and…

Human-Computer Interaction · Computer Science 2023-12-19 Zilin Wang , Haolin Zhuang , Lu Li , Yinmin Zhang , Junjie Zhong , Jun Chen , Yu Yang , Boshi Tang , Zhiyong Wu

Maintaining narrative coherence and visual consistency remains a central challenge in open-domain video generation. Existing text-to-video models often treat each shot independently, resulting in identity drift, scene inconsistency, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Qinglin Zeng , Kaitong Cai , Ruiqi Chen , Qinhan Lv , Keze Wang

Recent advances in dance generation have enabled the automatic synthesis of 3D dance motions. However, existing methods still face significant challenges in simultaneously achieving high realism, precise dance-music synchronization, diverse…

Controllable video generation (CVG) has advanced rapidly, yet current systems falter when more than one actor must move, interact, and exchange positions under noisy control signals. We address this gap with DanceTogether, the first…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Junhao Chen , Mingjin Chen , Jianjin Xu , Xiang Li , Junting Dong , Mingze Sun , Puhua Jiang , Hongxiang Li , Yuhang Yang , Hao Zhao , Xiaoxiao Long , Ruqi Huang

Gesture-driven music generation is an emerging human-computer interaction paradigm for touch-free and expressive musical interaction. However, many existing approaches treat the task as isolated gesture classification or map gestures to…

Multimedia · Computer Science 2026-04-29 Rathinaraja Jeyaraj , Barathi Subramanian , Kapilya Gangadharan , Anand Paul

Choreography creation is a multimodal endeavor, demanding cognitive abilities to develop creative ideas and technical expertise to convert choreographic ideas into physical dance movements. Previous endeavors have sought to reduce the…

Human-Computer Interaction · Computer Science 2024-02-21 Yimeng Liu , Misha Sra

Dance, as an art form, fundamentally hinges on the precise synchronization with musical beats. However, achieving aesthetically pleasing dance sequences from music is challenging, with existing methods often falling short in controllability…

Graphics · Computer Science 2024-07-11 Zikai Huang , Xuemiao Xu , Cheng Xu , Huaidong Zhang , Chenxi Zheng , Jing Qin , Shengfeng He

Music and dance have always co-existed as pillars of human activities, contributing immensely to the cultural, social, and entertainment functions in virtually all societies. Notwithstanding the gradual systematization of music and dance…

Sound · Computer Science 2022-02-01 Shuang Wu , Zhenguang Li , Shijian Lu , Li Cheng

In the realm of 3D digital human applications, music-to-dance presents a challenging task. Given the one-to-many relationship between music and dance, previous methods have been limited in their approach, relying solely on matching and…

Other Computer Science · Computer Science 2024-01-22 Xin Gao , Li Hu , Peng Zhang , Bang Zhang , Liefeng Bo