English
Related papers

Related papers: Music2Dance: DanceNet for Music-driven Dance Gener…

200 papers

Dance is an important human art form, but creating new dances can be difficult and time-consuming. In this work, we introduce Editable Dance GEneration (EDGE), a state-of-the-art method for editable dance generation that is capable of…

Sound · Computer Science 2022-11-29 Jonathan Tseng , Rodrigo Castellon , C. Karen Liu

How to automatically synthesize natural-looking dance movements based on a piece of music is an incrementally popular yet challenging task. Most existing data-driven approaches require hard-to-get paired training data and fail to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Bin Feng , Tenglong Ao , Zequn Liu , Wei Ju , Libin Liu , Ming Zhang

This paper presents an Exploratory 3D Dance generation framework, E3D2, designed to address the exploration capability deficiency in existing music-conditioned 3D dance generation models. Current models often generate monotonous and…

Human-Computer Interaction · Computer Science 2023-12-19 Zilin Wang , Haolin Zhuang , Lu Li , Yinmin Zhang , Junjie Zhong , Jun Chen , Yu Yang , Boshi Tang , Zhiyong Wu

In the realm of 3D digital human applications, music-to-dance presents a challenging task. Given the one-to-many relationship between music and dance, previous methods have been limited in their approach, relying solely on matching and…

Other Computer Science · Computer Science 2024-01-22 Xin Gao , Li Hu , Peng Zhang , Bang Zhang , Liefeng Bo

To generate dance that temporally and aesthetically matches the music is a challenging problem, as the following factors need to be considered. First, the aesthetic styles and messages conveyed by the motion and music should be consistent.…

Multimedia · Computer Science 2022-07-18 Ho Yin Au , Jie Chen , Junkun Jiang , Yike Guo

Human motion generation is a significant pursuit in generative computer vision with widespread applications in film-making, video games, AR/VR, and human-robot interaction. Current methods mainly utilize either diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Canxuan Gang

Music-to-dance generation aims to translate auditory signals into expressive human motion, with broad applications in virtual reality, choreography, and digital entertainment. Despite promising progress, the limited generation efficiency of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Kaixing Yang , Xulong Tang , Ziqiao Peng , Xiangyue Zhang , Puwei Wang , Jun He , Hongyan Liu

Dance and music are closely related forms of expression, with mutual retrieval between dance videos and music being a fundamental task in various fields like education, art, and sports. However, existing methods often suffer from unnatural…

Sound · Computer Science 2023-10-17 Kaixing Yang , Xukun Zhou , Xulong Tang , Ran Diao , Hongyan Liu , Jun He , Zhaoxin Fan

Choreography refers to creation of dance steps and motions for dances according to the latent knowledge in human mind, where the created dance motions are in general style-specific and consistent. So far, such latent style-specific…

Multimedia · Computer Science 2021-05-03 Xinjian Zhang , Yi Xu , Su Yang , Longwen Gao , Huyang Sun

Generating coherent and diverse human dances from music signals has gained tremendous progress in animating virtual avatars. While existing methods support direct dance synthesis, they fail to recognize that enabling users to edit dance…

Graphics · Computer Science 2025-08-26 Hengyuan Zhang , Zhe Li , Xingqun Qi , Mengze Li , Muyi Sun , Man Zhang , Sirui Han

Music-to-dance generation represents a challenging yet pivotal task at the intersection of choreography, virtual reality, and creative content generation. Despite its significance, existing methods face substantial limitation in achieving…

Generating dances that are both lifelike and well-aligned with music continues to be a challenging task in the cross-modal domain. This paper introduces PopDanceSet, the first dataset tailored to the preferences of young audiences, enabling…

Sound · Computer Science 2024-12-30 Zhenye Luo , Min Ren , Xuecai Hu , Yongzhen Huang , Li Yao

Existing keyframe-based motion synthesis mainly focuses on the generation of cyclic actions or short-term motion, such as walking, running, and transitions between close postures. However, these methods will significantly degrade the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Junjun Pan , Siyuan Wang , Junxuan Bai , Ju Dai

Choreographers determine what the dances look like, while cameramen determine the final presentation of dances. Recently, various methods and datasets have showcased the feasibility of dance synthesis. However, camera movement synthesis…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Zixuan Wang , Jia Jia , Shikun Sun , Haozhe Wu , Rong Han , Zhenyu Li , Di Tang , Jiaqing Zhou , Jiebo Luo

Dance generation is crucial and challenging, particularly in domains like dance performance and virtual gaming. In the current body of literature, most methodologies focus on Solo Music2Dance. While there are efforts directed towards Group…

Sound · Computer Science 2024-12-30 Kaixing Yang , Xulong Tang , Haoyu Wu , Qinliang Xue , Biao Qin , Hongyan Liu , Zhaoxin Fan

With the popularity of video-based user-generated content (UGC) on social media, harmony, as dictated by human perceptual principles, is critical in assessing the rhythmic consistency of audio-visual UGCs for better user engagement. In this…

Multimedia · Computer Science 2025-06-10 Xinyi Wu , Haohong Wang , Aggelos K. Katsaggelos

This paper presents a neural network model to generate virtual violinist's 3-D skeleton movements from music audio. Improved from the conventional recurrent neural network models for generating 2-D skeleton data in previous works, the…

Multimedia · Computer Science 2020-09-18 Hsuan-Kai Kao , Li Su

Music and dance have always co-existed as pillars of human activities, contributing immensely to the cultural, social, and entertainment functions in virtually all societies. Notwithstanding the gradual systematization of music and dance…

Sound · Computer Science 2022-02-01 Shuang Wu , Zhenguang Li , Shijian Lu , Li Cheng

Gesture-driven music generation is an emerging human-computer interaction paradigm for touch-free and expressive musical interaction. However, many existing approaches treat the task as isolated gesture classification or map gestures to…

Multimedia · Computer Science 2026-04-29 Rathinaraja Jeyaraj , Barathi Subramanian , Kapilya Gangadharan , Anand Paul

Recently, digital humans for interpersonal interaction in virtual environments have gained significant attention. In this paper, we introduce a novel multi-dancer synthesis task called partner dancer generation, which involves synthesizing…

Human-Computer Interaction · Computer Science 2023-10-10 Siyue Yao , Mingjie Sun , Bingliang Li , Fengyu Yang , Junle Wang , Ruimao Zhang