English
Related papers

Related papers: Diverse Dance Synthesis via Keyframes with Transfo…

200 papers

Human motion synthesis aims to generate plausible human motion sequences, which has raised widespread attention in computer animation. Recent score-based generative models (SGMs) have demonstrated impressive results on this task. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Yu Hua , Weiming Liu , Gui Xu , Yaqing Hou , Yew-Soon Ong , Qiang Zhang

We revisit human motion synthesis, a task useful in various real world applications, in this paper. Whereas a number of methods have been developed previously for this task, they are often limited in two aspects: focusing on the poses while…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jingbo Wang , Sijie Yan , Bo Dai , Dahua LIn

Recently, digital humans for interpersonal interaction in virtual environments have gained significant attention. In this paper, we introduce a novel multi-dancer synthesis task called partner dancer generation, which involves synthesizing…

Human-Computer Interaction · Computer Science 2023-10-10 Siyue Yao , Mingjie Sun , Bingliang Li , Fengyu Yang , Junle Wang , Ruimao Zhang

We introduce a method to synthesize animator guided human motion across 3D scenes. Given a set of sparse (3 or 4) joint locations (such as the location of a person's hand and two feet) and a seed motion sequence in a 3D scene, our method…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Aymen Mir , Xavier Puig , Angjoo Kanazawa , Gerard Pons-Moll

We present a novel method for populating 3D indoor scenes with virtual humans that can navigate in the environment and interact with objects in a realistic manner. Existing approaches rely on training sequences that contain captured human…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Kaifeng Zhao , Yan Zhang , Shaofei Wang , Thabo Beeler , Siyu Tang

We present DanceAnyWay, a generative learning method to synthesize beat-guided dances of 3D human characters synchronized with music. Our method learns to disentangle the dance movements at the beat frames from the dance movements at all…

Sound · Computer Science 2024-11-26 Aneesh Bhattacharya , Manas Paranjape , Uttaran Bhattacharya , Aniket Bera

Synthesize human motions from music, i.e., music to dance, is appealing and attracts lots of research interests in recent years. It is challenging due to not only the requirement of realistic and complex human motions for dance, but more…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Wenlin Zhuang , Congyi Wang , Siyu Xia , Jinxiang Chai , Yangang Wang

Text-driven human motion generation is an emerging task in animation and humanoid robot design. Existing algorithms directly generate the full sequence which is computationally expensive and prone to errors as it does not pay special…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Zichen Geng , Caren Han , Zeeshan Hayder , Jian Liu , Mubarak Shah , Ajmal Mian

We present a framework for generating music-synchronized, choreography aware animal dance videos. Our framework introduces choreography patterns -- structured sequences of motion beats that define the long-range structure of a dance -- as a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xiaojuan Wang , Aleksander Holynski , Brian Curless , Ira Kemelmacher , Steve Seitz

As entertainment robots gain popularity, the demand for natural and expressive motion, particularly in dancing, continues to rise. Traditionally, dancing motions have been manually designed by artists, a process that is both labor-intensive…

Robotics · Computer Science 2025-02-26 Ryo Watanabe , Chenhao Li , Marco Hutter

Data-driven modeling of human motions is ubiquitous in computer graphics and computer vision applications, such as synthesizing realistic motions or recognizing actions. Recent research has shown that such problems can be approached by…

Graphics · Computer Science 2019-08-21 He Wang , Edmond S. L. Ho , Hubert P. H. Shum , Zhanxing Zhu

The emergence of text-driven motion synthesis technique provides animators with great potential to create efficiently. However, in most cases, textual expressions only contain general and qualitative motion descriptions, while lack fine…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Dong Wei , Xiaoning Sun , Huaijiang Sun , Bin Li , Shengxiang Hu , Weiqing Li , Jianfeng Lu

Digitally synthesizing human motion is an inherently complex process, which can create obstacles in application areas such as virtual reality. We offer a new approach for predicting human motion, KP-RNN, a neural network which can integrate…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Patrick Perrine , Trevor Kirkby

Dancing video retargeting aims to synthesize a video that transfers the dance movements from a source video to a target person. Previous work need collect a several-minute-long video of a target person with thousands of frames to train a…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Yuying Ge , Yibing Song , Ruimao Zhang , Ping Luo

Although part-based motion synthesis networks have been investigated to reduce the complexity of modeling heterogeneous human motions, their computational cost remains prohibitive in interactive applications. To this end, we propose a novel…

Graphics · Computer Science 2023-06-22 Shuaiying Hou , Hongyu Tao , Hujun Bao , Weiwei Xu

We study the problem of synthesizing a number of likely future frames from a single input image. In contrast to traditional methods, which have tackled this problem in a deterministic or non-parametric way, we propose a novel approach that…

Computer Vision and Pattern Recognition · Computer Science 2016-07-12 Tianfan Xue , Jiajun Wu , Katherine L. Bouman , William T. Freeman

Recent progress in stochastic motion prediction, i.e., predicting multiple possible future human motions given a single past pose sequence, has led to producing truly diverse future motions and even providing control over the motion of some…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Wei Mao , Miaomiao Liu , Mathieu Salzmann

Dimensional synthesis of planar four-bar mechanisms is a challenging inverse problem in kinematics, requiring the determination of mechanism dimensions from desired motion specifications. We propose a data-driven framework that bypasses…

Machine Learning · Computer Science 2025-07-14 Woon Ryong Kim , Jaeheun Jung , Jeong Un Ha , Donghun Lee , Jae Kyung Shim

Synthesis of long-term human motion skeleton sequences is essential to aid human-centric video generation with potential applications in Augmented Reality, 3D character animations, pedestrian trajectory prediction, etc. Long-term human…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Neeraj Battan , Yudhik Agrawal , Veeravalli Saisooryarao , Aman Goel , Avinash Sharma

Dancing to music is one of human's innate abilities since ancient times. In machine learning research, however, synthesizing dance movements from music is a challenging problem. Recently, researchers synthesize human motion sequences…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Ruozi Huang , Huang Hu , Wei Wu , Kei Sawada , Mi Zhang , Daxin Jiang