English
Related papers

Related papers: Lodge++: High-quality and Long Dance Generation wi…

200 papers

Automatic choreography generation is a challenging task because it often requires an understanding of two abstract concepts - music and dance - which are realized in the two different modalities, namely audio and video, respectively. In…

Multimedia · Computer Science 2018-11-05 Juheon Lee , Seohyun Kim , Kyogu Lee

Music-to-dance generation aims to synthesize human dance motion conditioned on musical input. Despite recent progress, significant challenges remain due to the semantic gap between music and dance motion, as music offers only abstract cues,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Qing Wang , Xiaohang Yang , Yilan Dong , Naveen Raj Govindaraj , Gregory Slabaugh , Shanxin Yuan

The task of music-driven dance generation involves creating coherent dance movements that correspond to the given music. While existing methods can produce physically plausible dances, they often struggle to generalize to out-of-set data.…

Sound · Computer Science 2024-11-12 Bo Han , Teng Zhang , Zeyu Ling , Yi Ren , Xiang Yin , Feilin Han

Realistic 3D indoor scene generation is crucial for virtual reality, interior design, embodied intelligence, and scene understanding. While existing methods have made progress in coarse-scale furniture arrangement, they struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Xiping Wang , Yuxi Wang , Mengqi Zhou , Junsong Fan , Zhaoxiang Zhang

Dance typically involves professional choreography with complex movements that follow a musical rhythm and can also be influenced by lyrical content. The integration of lyrics in addition to the auditory dimension, enriches the foundational…

Sound · Computer Science 2024-03-15 Wenjie Yin , Xuejiao Zhao , Yi Yu , Hang Yin , Danica Kragic , Mårten Björkman

Music-to-dance generation represents a challenging yet pivotal task at the intersection of choreography, virtual reality, and creative content generation. Despite its significance, existing methods face substantial limitation in achieving…

The advancement of generative AI has extended to the realm of Human Dance Generation, demonstrating superior generative capacities. However, current methods still exhibit deficiencies in achieving spatiotemporal consistency, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Haipeng Fang , Zhihao Sun , Ziyao Huang , Fan Tang , Juan Cao , Sheng Tang

With the ongoing pandemic, virtual concerts and live events using digitized performances of musicians are getting traction on massive multiplayer online worlds. However, well choreographed dance movements are extremely complex to animate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Jiaman Li , Yihang Yin , Hang Chu , Yi Zhou , Tingwu Wang , Sanja Fidler , Hao Li

Group dance generation from music has broad applications in film, gaming, and animation production. However, it requires synchronizing multiple dancers while maintaining spatial coordination. As the number of dancers and sequence length…

Artificial Intelligence · Computer Science 2025-07-31 Jing Xu , Weiqiang Wang , Cunjian Chen , Jun Liu , Qiuhong Ke

Generating long-term, coherent, and realistic music-conditioned dance sequences remains a challenging task in human motion synthesis. Existing approaches exhibit critical limitations: motion graph methods rely on fixed template libraries,…

Sound · Computer Science 2025-06-04 Mingyang Huang , Peng Zhang , Bang Zhang

Dance generation is crucial and challenging, particularly in domains like dance performance and virtual gaming. In the current body of literature, most methodologies focus on Solo Music2Dance. While there are efforts directed towards Group…

Sound · Computer Science 2024-12-30 Kaixing Yang , Xulong Tang , Haoyu Wu , Qinliang Xue , Biao Qin , Hongyan Liu , Zhaoxin Fan

Recent advances in video generation models have enabled high-quality short video generation from text prompts. However, extending these models to longer videos remains a significant challenge, primarily due to degraded temporal consistency…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yu Lu , Yi Yang

Despite advances in dance generation, most methods are trained in the skeletal domain and ignore mesh-level physical constraints. As a result, motions that look plausible as joint trajectories often exhibit body self-penetration and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jidong Jia , Youjian Zhang , Huan Fu , Dacheng Tao

Modern artistic productions increasingly demand automated choreography generation that adapts to diverse musical styles and individual dancer characteristics. Existing approaches often fail to produce high-quality dance videos that…

Graphics · Computer Science 2025-07-29 Xuanchen Wang , Heng Wang , Weidong Cai

Well-coordinated, music-aligned holistic dance enhances emotional expressiveness and audience engagement. However, generating such dances remains challenging due to the scarcity of holistic 3D dance datasets, the difficulty of achieving…

Multimedia · Computer Science 2025-07-30 Xiaojie Li , Ronghui Li , Shukai Fang , Shuzhao Xie , Xiaoyang Guo , Jiaqing Zhou , Junkun Peng , Zhi Wang

Dance serves as a profound and universal expression of human culture, conveying emotions and stories through movements synchronized with music. Although some current works have achieved satisfactory results in the task of single-person…

Graphics · Computer Science 2025-03-14 Haozhou Pang , Tianwei Ding , Lanshan He , Qi Gan

This paper proposes a framework which is able to generate a sequence of three-dimensional human dance poses for a given music. The proposed framework consists of three components: a music feature encoder, a pose generator, and a music genre…

Machine Learning · Computer Science 2019-11-12 Hyemin Ahn , Jaehun Kim , Kihyun Kim , Songhwai Oh

Recent advances in video diffusion models have significantly improved visual quality, yet ultra-high-resolution (UHR) video generation remains a formidable challenge due to the compounded difficulties of motion modeling, semantic planning,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Chen Zhao , Jiawei Chen , Hongyu Li , Zhuoliang Kang , Shilin Lu , Xiaoming Wei , Kai Zhang , Jian Yang , Ying Tai

Synthesizing human motion with a global structure, such as a choreography, is a challenging task. Existing methods tend to concentrate on local smooth pose transitions and neglect the global context or the theme of the motion. In this work,…

Dance plays an important role as an artistic form and expression in human culture, yet automatically generating dance sequences is a significant yet challenging endeavor. Existing approaches often neglect the critical aspect of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hongsong Wang , Ying Zhu , Xin Geng , Liang Wang