English
Related papers

Related papers: Feel The Music: Automatically Generating A Dance F…

200 papers

Interpretability of machine learning models has gained more and more attention among researchers in the artificial intelligence (AI) and human-computer interaction (HCI) communities. Most existing work focuses on decision making, whereas we…

Human-Computer Interaction · Computer Science 2020-04-16 Haizi Yu , Heinrich Taube , James A. Evans , Lav R. Varshney

AI music generation has advanced rapidly, with models like diffusion and autoregressive algorithms enabling high-fidelity outputs. These tools can alter styles, mix instruments, or isolate them. Since sound can be visualized as…

Music generation has generally been focused on either creating scores or interpreting them. We discuss differences between these two problems and propose that, in fact, it may be valuable to work in the space of direct $\it performance$…

Sound · Computer Science 2018-08-14 Sageev Oore , Ian Simon , Sander Dieleman , Douglas Eck , Karen Simonyan

This paper introduces a system that learns to sing new tunes by listening to examples. It extracts sequencing rules from input music and uses these rules to generate new tunes, which are sung by a vocal synthesiser. We developed a method to…

Quantum Physics · Physics 2022-08-09 Eduardo Reck Miranda , Brian N. Siegelwax

This work introduces a new music generation system, called AffectMachine-Classical, that is capable of generating affective Classic music in real-time. AffectMachine was designed to be incorporated into biofeedback systems (such as…

Sound · Computer Science 2023-04-12 Kat R. Agres , Adyasha Dash , Phoebe Chua

Computational Music Generation is evolving towards non-conventional styles, demanding methods that enable precise and controllable blending of diverse music elements. In this work, we present a method for fine grained control using…

As deep learning advances, algorithms of music composition increase in performance. However, most of the successful models are designed for specific musical structures. Here, we present BachProp, an algorithmic composer that can generate…

Sound · Computer Science 2020-07-07 Florian Colombo , Johanni Brea , Wulfram Gerstner

Existing music-driven 3D dance generation methods mainly concentrate on high-quality dance generation, but lack sufficient control during the generation process. To address these issues, we propose a unified framework capable of generating…

Sound · Computer Science 2024-03-21 Ronghui Li , Yuqin Dai , Yachao Zhang , Jun Li , Jian Yang , Jie Guo , Xiu Li

This work introduces the M6(GPT)3 composer system, capable of generating complete, multi-minute musical compositions with complex structures in any time signature, in the MIDI domain from input descriptions in natural language. The system…

Sound · Computer Science 2025-09-30 Jakub Poćwiardowski , Mateusz Modrzejewski , Marek S. Tatara

We present a framework for generating music-synchronized, choreography aware animal dance videos. Our framework introduces choreography patterns -- structured sequences of motion beats that define the long-range structure of a dance -- as a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xiaojuan Wang , Aleksander Holynski , Brian Curless , Ira Kemelmacher , Steve Seitz

Generating 3D dances from music is an emerged research task that benefits a lot of applications in vision and graphics. Previous works treat this task as sequence generation, however, it is challenging to render a music-aligned long-term…

Artificial Intelligence · Computer Science 2023-07-28 Buyu Li , Yongchi Zhao , Zhelun Shi , Lu Sheng

Music has been commonly recognized as a means of expressing emotions. In this sense, an intense debate emerges from the need to verbalize musical emotions. This concern seems highly relevant today, considering the exponential growth of…

Multimedia · Computer Science 2023-11-08 Jorge Forero , Gilberto Bernardes , Mónica Mendes

We propose a novel task for generating 3D dance movements that simultaneously incorporate both text and music modalities. Unlike existing works that generate dance movements using a single modality such as music, our goal is to produce…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Kehong Gong , Dongze Lian , Heng Chang , Chuan Guo , Zihang Jiang , Xinxin Zuo , Michael Bi Mi , Xinchao Wang

We present the sense of effort through vibration to help the video viewer understand how the person in the video moves the body. We suppose sense of effort is related to force, so we generate vibration based on force and present the sense…

Human-Computer Interaction · Computer Science 2024-11-11 Ryoma Akai , Masashi Konyo , Satoshi Tadokoro

In addition to traditional tasks such as prediction, classification and translation, deep learning is receiving growing attention as an approach for music generation, as witnessed by recent research groups such as Magenta at Google and CTRL…

Sound · Computer Science 2018-11-13 Jean-Pierre Briot , François Pachet

The field of Automatic Music Generation has seen significant progress thanks to the advent of Deep Learning. However, most of these results have been produced by unconditional models, which lack the ability to interact with their users, not…

Sound · Computer Science 2022-12-22 Pedro Neves , Jose Fornari , João Florindo

This paper presents the Computoser hybrid probability/rule based algorithm for music composition (http://computoser.com) and provides a reference implementation. It addresses the issues of unpleasantness and lack of variation exhibited by…

Artificial Intelligence · Computer Science 2014-12-10 Bozhidar Bozhanov

Over the past several years, deep learning for sequence modeling has grown in popularity. To achieve this goal, LSTM network structures have proven to be very useful for making predictions for the next output in a series. For instance, a…

Sound · Computer Science 2022-03-24 Michael Conner , Lucas Gral , Kevin Adams , David Hunger , Reagan Strelow , Alexander Neuwirth

Finding the music of the moment can often be a challenging problem, even for well-versed music listeners. Musical tastes are constantly in flux, and the problem of developing computational models for musical taste dynamics presents a rich…

Information Retrieval · Computer Science 2018-06-19 Massimo Quadrana , Marta Reznakova , Tao Ye , Erik Schmidt , Hossein Vahabi

Music Inpainting is the task of filling in missing or lost information in a piece of music. We investigate this task from an interactive music creation perspective. To this end, a novel deep learning-based approach for musical score…

Machine Learning · Computer Science 2020-04-14 Ashis Pati , Alexander Lerch , Gaëtan Hadjeres