English
Related papers

Related papers: CoheDancers: Enhancing Interactive Group Dance Gen…

200 papers

Existing music-driven 3D dance generation methods mainly concentrate on high-quality dance generation, but lack sufficient control during the generation process. To address these issues, we propose a unified framework capable of generating…

Sound · Computer Science 2024-03-21 Ronghui Li , Yuqin Dai , Yachao Zhang , Jun Li , Jian Yang , Jie Guo , Xiu Li

To generate dance that temporally and aesthetically matches the music is a challenging problem, as the following factors need to be considered. First, the aesthetic styles and messages conveyed by the motion and music should be consistent.…

Multimedia · Computer Science 2022-07-18 Ho Yin Au , Jie Chen , Junkun Jiang , Yike Guo

Dance serves as a powerful medium for expressing human emotions, but the lifelike generation of dance is still a considerable challenge. Recently, diffusion models have showcased remarkable generative abilities across various domains. They…

Sound · Computer Science 2024-06-25 Canyu Zhang , Youbao Tang , Ning Zhang , Ruei-Sung Lin , Mei Han , Jing Xiao , Song Wang

With the ongoing pandemic, virtual concerts and live events using digitized performances of musicians are getting traction on massive multiplayer online worlds. However, well choreographed dance movements are extremely complex to animate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Jiaman Li , Yihang Yin , Hang Chu , Yi Zhou , Tingwu Wang , Sanja Fidler , Hao Li

Music-driven group choreography poses a considerable challenge but holds significant potential for a wide range of industrial applications. The ability to generate synchronized and visually appealing group dance motions that are aligned…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Nhat Le , Tuong Do , Khoa Do , Hien Nguyen , Erman Tjiputra , Quang D. Tran , Anh Nguyen

Dance generation, as a branch of human motion generation, has attracted increasing attention. Recently, a few works attempt to enhance dance expressiveness, which includes genre matching, beat alignment, and dance dynamics, from certain…

Multimedia · Computer Science 2024-03-12 Qiaochu Huang , Xu He , Boshi Tang , Haolin Zhuang , Liyang Chen , Shuochen Gao , Zhiyong Wu , Haozhi Huang , Helen Meng

Generative AI has made significant strides in computer vision, particularly in text-driven image/video synthesis (T2I/T2V). Despite the notable advancements, it remains challenging in human-centric content synthesis such as realistic dance…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Tan Wang , Linjie Li , Kevin Lin , Yuanhao Zhai , Chung-Ching Lin , Zhengyuan Yang , Hanwang Zhang , Zicheng Liu , Lijuan Wang

Recently, digital humans for interpersonal interaction in virtual environments have gained significant attention. In this paper, we introduce a novel multi-dancer synthesis task called partner dancer generation, which involves synthesizing…

Human-Computer Interaction · Computer Science 2023-10-10 Siyue Yao , Mingjie Sun , Bingliang Li , Fengyu Yang , Junle Wang , Ruimao Zhang

Dance-driven music generation aims to generate musical pieces conditioned on dance videos. Previous works focus on monophonic or raw audio generation, while the multi-instruments scenario is under-explored. The challenges associated with…

Multimedia · Computer Science 2024-02-28 Bo Han , Yuheng Li , Yixuan Shen , Yi Ren , Feilin Han

Recent pose-to-video models can translate 2D pose sequences into photorealistic, identity-preserving dance videos, so the key challenge is to generate temporally coherent, rhythm-aligned 2D poses from music, especially under complex,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Yan Zhang , Han Zou , Lincong Feng , Cong Xie , Ruiqi Yu , Zhenpeng Zhan

Music-to-dance generation represents a challenging yet pivotal task at the intersection of choreography, virtual reality, and creative content generation. Despite its significance, existing methods face substantial limitation in achieving…

Generating group dance motion from the music is a challenging task with several industrial applications. Although several methods have been proposed to tackle this problem, most of them prioritize optimizing the fidelity in dancing…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Nhat Le , Khoa Do , Xuan Bui , Tuong Do , Erman Tjiputra , Quang D. Tran , Anh Nguyen

Dance and music typically go hand in hand. The complexities in dance, music, and their synchronisation make them fascinating to study from a computational creativity perspective. While several works have looked at generating dance for a…

Sound · Computer Science 2021-07-21 Gunjan Aggarwal , Devi Parikh

We present X-Dancer, a novel zero-shot music-driven image animation pipeline that creates diverse and long-range lifelike human dance videos from a single static image. As its core, we introduce a unified transformer-diffusion framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Zeyuan Chen , Hongyi Xu , Guoxian Song , You Xie , Chenxu Zhang , Xin Chen , Chao Wang , Di Chang , Linjie Luo

Dance is an important human art form, but creating new dances can be difficult and time-consuming. In this work, we introduce Editable Dance GEneration (EDGE), a state-of-the-art method for editable dance generation that is capable of…

Sound · Computer Science 2022-11-29 Jonathan Tseng , Rodrigo Castellon , C. Karen Liu

With the rise of online dance-video platforms and rapid advances in AI-generated content (AIGC), music-driven dance generation has emerged as a compelling research direction. Despite substantial progress in related domains such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Kaixing Yang , Jiashu Zhu , Xulong Tang , Ziqiao Peng , Xiangyue Zhang , Puwei Wang , Jiahong Wu , Xiangxiang Chu , Hongyan Liu , Jun He

Well-coordinated, music-aligned holistic dance enhances emotional expressiveness and audience engagement. However, generating such dances remains challenging due to the scarcity of holistic 3D dance datasets, the difficulty of achieving…

Multimedia · Computer Science 2025-07-30 Xiaojie Li , Ronghui Li , Shukai Fang , Shuzhao Xie , Xiaoyang Guo , Jiaqing Zhou , Junkun Peng , Zhi Wang

Synthesizing human motion through learning techniques is becoming an increasingly popular approach to alleviating the requirement of new data capture to produce animations. Learning to move naturally from music, i.e., to dance, is one of…

Dancing with music is always an essential human art form to express emotion. Due to the high temporal-spacial complexity, long-term 3D realist dance generation synchronized with music is challenging. Existing methods suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Siqi Yang , Zejun Yang , Zhisheng Wang

Recently, diffusion models have shown their impressive ability in visual generation tasks. Besides static images, more and more research attentions have been drawn to the generation of realistic videos. The video generation not only has a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Yucheng Xing , Jinxing Yin , Xiaodong Liu