English
Related papers

Related papers: Generative Autoregressive Networks for 3D Dancing …

200 papers

Dance requires skillful composition of complex movements that follow rhythmic, tonal and timbral features of music. Formally, generating dance conditioned on a piece of music can be expressed as a problem of modelling a high-dimensional…

This paper presents an Exploratory 3D Dance generation framework, E3D2, designed to address the exploration capability deficiency in existing music-conditioned 3D dance generation models. Current models often generate monotonous and…

Human-Computer Interaction · Computer Science 2023-12-19 Zilin Wang , Haolin Zhuang , Lu Li , Yinmin Zhang , Junjie Zhong , Jun Chen , Yu Yang , Boshi Tang , Zhiyong Wu

Dancing to music is one of human's innate abilities since ancient times. In machine learning research, however, synthesizing dance movements from music is a challenging problem. Recently, researchers synthesize human motion sequences…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Ruozi Huang , Huang Hu , Wei Wu , Kei Sawada , Mi Zhang , Daxin Jiang

Dance choreography for a piece of music is a challenging task, having to be creative in presenting distinctive stylistic dance elements while taking into account the musical theme and rhythm. It has been tackled by different approaches such…

Sound · Computer Science 2022-05-05 Shuang Wu , Shijian Lu , Li Cheng

This work presents computational methods for transferring body movements from one person to another with videos collected in the wild. Specifically, we train a personalized model on a single video from the Internet which can generate videos…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Yipin Zhou , Zhaowen Wang , Chen Fang , Trung Bui , Tamara L. Berg

Dance is an important human art form, but creating new dances can be difficult and time-consuming. In this work, we introduce Editable Dance GEneration (EDGE), a state-of-the-art method for editable dance generation that is capable of…

Sound · Computer Science 2022-11-29 Jonathan Tseng , Rodrigo Castellon , C. Karen Liu

Dance and music typically go hand in hand. The complexities in dance, music, and their synchronisation make them fascinating to study from a computational creativity perspective. While several works have looked at generating dance for a…

Sound · Computer Science 2021-07-21 Gunjan Aggarwal , Devi Parikh

This paper presents a neural network model to generate virtual violinist's 3-D skeleton movements from music audio. Improved from the conventional recurrent neural network models for generating 2-D skeleton data in previous works, the…

Multimedia · Computer Science 2020-09-18 Hsuan-Kai Kao , Li Su

Driving 3D characters to dance following a piece of music is highly challenging due to the spatial constraints applied to poses by choreography norms. In addition, the generated dance sequence also needs to maintain temporal coherency with…

Sound · Computer Science 2022-03-28 Li Siyao , Weijiang Yu , Tianpei Gu , Chunze Lin , Quan Wang , Chen Qian , Chen Change Loy , Ziwei Liu

Synthesizing human motion through learning techniques is becoming an increasingly popular approach to alleviating the requirement of new data capture to produce animations. Learning to move naturally from music, i.e., to dance, is one of…

Music-driven choreography is a challenging problem with a wide variety of industrial applications. Recently, many methods have been proposed to synthesize dance motions from music for a single dancer. However, generating dance motion for a…

Multimedia · Computer Science 2023-03-28 Nhat Le , Thang Pham , Tuong Do , Erman Tjiputra , Quang D. Tran , Anh Nguyen

3D animation of humans in action is quite challenging as it involves using a huge setup with several motion trackers all over the person's body to track the movements of every limb. This is time-consuming and may cause the person discomfort…

Graphics · Computer Science 2020-02-10 Laxman Kumarapu , Prerana Mukherjee

We present X-Dancer, a novel zero-shot music-driven image animation pipeline that creates diverse and long-range lifelike human dance videos from a single static image. As its core, we introduce a unified transformer-diffusion framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Zeyuan Chen , Hongyi Xu , Guoxian Song , You Xie , Chenxu Zhang , Xin Chen , Chao Wang , Di Chang , Linjie Luo

Inverse graphics aims to recover 3D models from 2D observations. Utilizing differentiable rendering, recent 3D-aware generative models have shown impressive results of rigid object generation using 2D images. However, it remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Fangzhou Hong , Zhaoxi Chen , Yushi Lan , Liang Pan , Ziwei Liu

Generating coherent and diverse human dances from music signals has gained tremendous progress in animating virtual avatars. While existing methods support direct dance synthesis, they fail to recognize that enabling users to edit dance…

Graphics · Computer Science 2025-08-26 Hengyuan Zhang , Zhe Li , Xingqun Qi , Mengze Li , Muyi Sun , Man Zhang , Sirui Han

Well-coordinated, music-aligned holistic dance enhances emotional expressiveness and audience engagement. However, generating such dances remains challenging due to the scarcity of holistic 3D dance datasets, the difficulty of achieving…

Multimedia · Computer Science 2025-07-30 Xiaojie Li , Ronghui Li , Shukai Fang , Shuzhao Xie , Xiaoyang Guo , Jiaqing Zhou , Junkun Peng , Zhi Wang

With the ongoing pandemic, virtual concerts and live events using digitized performances of musicians are getting traction on massive multiplayer online worlds. However, well choreographed dance movements are extremely complex to animate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Jiaman Li , Yihang Yin , Hang Chu , Yi Zhou , Tingwu Wang , Sanja Fidler , Hao Li

We hypothesize dance as a motion that forms a visual rhythm from music, where the visual rhythm can be perceived from an optical flow. If an agent can recognize the relationship between visual rhythm and music, it will be able to dance by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Hyemin Ahn

Synthesizing 3D human motion plays an important role in many graphics applications as well as understanding human activity. While many efforts have been made on generating realistic and natural human motion, most approaches neglect the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Jiashun Wang , Huazhe Xu , Jingwei Xu , Sifei Liu , Xiaolong Wang

How to automatically synthesize natural-looking dance movements based on a piece of music is an incrementally popular yet challenging task. Most existing data-driven approaches require hard-to-get paired training data and fail to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Bin Feng , Tenglong Ao , Zequn Liu , Wei Ju , Libin Liu , Ming Zhang