English
Related papers

Related papers: AI Choreographer: Music Conditioned 3D Dance Gener…

200 papers

Dance performance traditionally follows a unidirectional relationship where movement responds to music. While AI has advanced in various creative domains, its application in dance has primarily focused on generating choreography from…

Sound · Computer Science 2025-06-16 Olga Vechtomova , Jeff Bos

Group dance generation from music has broad applications in film, gaming, and animation production. However, it requires synchronizing multiple dancers while maintaining spatial coordination. As the number of dancers and sequence length…

Artificial Intelligence · Computer Science 2025-07-31 Jing Xu , Weiqiang Wang , Cunjian Chen , Jun Liu , Qiuhong Ke

Generating dances that are both lifelike and well-aligned with music continues to be a challenging task in the cross-modal domain. This paper introduces PopDanceSet, the first dataset tailored to the preferences of young audiences, enabling…

Sound · Computer Science 2024-12-30 Zhenye Luo , Min Ren , Xuecai Hu , Yongzhen Huang , Li Yao

This study aims to enhance the quality of music generation using Transformers by incorporating meta-information. While Transformer-based approaches are effective at capturing long-term dependencies in musical compositions, the music they…

Sound · Computer Science 2026-05-21 Shinnosuke Taksuka , Hideo Mukai

This paper proposes a framework which is able to generate a sequence of three-dimensional human dance poses for a given music. The proposed framework consists of three components: a music feature encoder, a pose generator, and a music genre…

Machine Learning · Computer Science 2019-11-12 Hyemin Ahn , Jaehun Kim , Kihyun Kim , Songhwai Oh

Music-driven 3D dance generation has become an intensive research topic in recent years with great potential for real-world applications. Most existing methods lack the consideration of genre, which results in genre inconsistency in the…

Sound · Computer Science 2023-04-26 Haolin Zhuang , Shun Lei , Long Xiao , Weiqin Li , Liyang Chen , Sicheng Yang , Zhiyong Wu , Shiyin Kang , Helen Meng

Music-to-dance generation aims to translate auditory signals into expressive human motion, with broad applications in virtual reality, choreography, and digital entertainment. Despite promising progress, the limited generation efficiency of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Kaixing Yang , Xulong Tang , Ziqiao Peng , Xiangyue Zhang , Puwei Wang , Jun He , Hongyan Liu

Forecasting long-term 3D human motion is challenging: the stochasticity of human behavior makes it hard to generate realistic human motion from the input sequence alone. Information on the scene environment and the motion of nearby people…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Felix B Mueller , Julian Tanke , Juergen Gall

Dance choreography for a piece of music is a challenging task, having to be creative in presenting distinctive stylistic dance elements while taking into account the musical theme and rhythm. It has been tackled by different approaches such…

Sound · Computer Science 2022-05-05 Shuang Wu , Shijian Lu , Li Cheng

Text-driven fashion synthesis and design is an extremely valuable part of artificial intelligence generative content(AIGC), which has the potential to propel a tremendous revolution in the traditional fashion industry. To advance the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Zhen Huang , Yihao Li , Dong Pei , Jiapeng Zhou , Xuliang Ning , Jianlin Han , Xiaoguang Han , Xuejun Chen

Lyrics often convey information about the songs that are beyond the auditory dimension, enriching the semantic meaning of movements and musical themes. Such insights are important in the dance choreography domain. However, most existing…

Multimedia · Computer Science 2023-10-03 Wenjie Yin , Qingyuan Yao , Yi Yu , Hang Yin , Danica Kragic , Mårten Björkman

To generate dance that temporally and aesthetically matches the music is a challenging problem, as the following factors need to be considered. First, the aesthetic styles and messages conveyed by the motion and music should be consistent.…

Multimedia · Computer Science 2022-07-18 Ho Yin Au , Jie Chen , Junkun Jiang , Yike Guo

Existing music-driven 3D dance generation methods mainly concentrate on high-quality dance generation, but lack sufficient control during the generation process. To address these issues, we propose a unified framework capable of generating…

Sound · Computer Science 2024-03-21 Ronghui Li , Yuqin Dai , Yachao Zhang , Jun Li , Jian Yang , Jie Guo , Xiu Li

Choreography creation requires high proficiency in artistic and technical skills. Choreographers typically go through four stages to create a dance piece: preparation, studio, performance, and reflection. This process is often…

Human-Computer Interaction · Computer Science 2024-05-29 Yimeng Liu , Misha Sra

In the task of generating music, the art factor plays a big role and is a great challenge for AI. Previous work involving adversarial training to produce new music pieces and modeling the compatibility of variety in music (beats, tempo,…

Sound · Computer Science 2023-01-09 Abhinav Kaushal Keshari

Driving 3D characters to dance following a piece of music is highly challenging due to the spatial constraints applied to poses by choreography norms. In addition, the generated dance sequence also needs to maintain temporal coherency with…

Sound · Computer Science 2022-03-28 Li Siyao , Weijiang Yu , Tianpei Gu , Chunze Lin , Quan Wang , Chen Qian , Chen Change Loy , Ziwei Liu

In the realm of 3D digital human applications, music-to-dance presents a challenging task. Given the one-to-many relationship between music and dance, previous methods have been limited in their approach, relying solely on matching and…

Other Computer Science · Computer Science 2024-01-22 Xin Gao , Li Hu , Peng Zhang , Bang Zhang , Liefeng Bo

Synthesizing high-quality dynamic medical videos remains a significant challenge due to the need for modeling both spatial consistency and temporal dynamics. Existing Transformer-based approaches face critical limitations, including…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Huihan Wang , Zhiwen Yang , Hui Zhang , Dan Zhao , Bingzheng Wei , Yan Xu

In this paper, we propose a novel framework for music-driven dance motion synthesis with controllable key pose constraint. In contrast to methods that generate dance motion sequences only based on music without any other controllable…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Junfu Pu , Ying Shan

Dance typically involves professional choreography with complex movements that follow a musical rhythm and can also be influenced by lyrical content. The integration of lyrics in addition to the auditory dimension, enriches the foundational…

Sound · Computer Science 2024-03-15 Wenjie Yin , Xuejiao Zhao , Yi Yu , Hang Yin , Danica Kragic , Mårten Björkman