English
Related papers

Related papers: Feel The Music: Automatically Generating A Dance F…

200 papers

This project brings music to sight. Music can be a visual masterpiece. Some people naturally experience a visualization of audio - a condition called synesthesia. The type of synesthesia explored is when sounds create colors in the 'mind's…

Multimedia · Computer Science 2020-12-16 Matthew Joseph Adiletta , Oliver Thomas

Existing AI-generated dance methods primarily train on motion capture data from solo dance performances, but a critical feature of dance in nearly any genre is the interaction of two or more bodies in space. Moreover, many works at the…

Machine Learning · Computer Science 2025-03-07 Zixuan Wang , Luis Zerkowski , Ilya Vidrin , Mariel Pettee

We introduce anticipation: a method for constructing a controllable generative model of a temporal point process (the event process) conditioned asynchronously on realizations of a second, correlated process (the control process). We…

Sound · Computer Science 2024-07-29 John Thickstun , David Hall , Chris Donahue , Percy Liang

New music is made with computers, taking advantage of its graphics displays rather than its audio algorithms. Pure Data can be used to compose them. This essay will show a case study that uses Pure Data, in connection with INScore, for…

Sound · Computer Science 2022-08-10 Patricio F. Calatayud

Dancing to music is one of human's innate abilities since ancient times. In machine learning research, however, synthesizing dance movements from music is a challenging problem. Recently, researchers synthesize human motion sequences…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Ruozi Huang , Huang Hu , Wei Wu , Kei Sawada , Mi Zhang , Daxin Jiang

Deep generative models allow even novice composers to generate various melodies by sampling latent vectors. However, finding the desired melody is challenging since the latent space is unintuitive and high-dimensional. In this work, we…

Sound · Computer Science 2020-10-08 Yijun Zhou , Yuki Koyama , Masataka Goto , Takeo Igarashi

A big challenge in algorithmic composition is to devise a model that is both easily trainable and able to reproduce the long-range temporal dependencies typical of music. Here we investigate how artificial neural networks can be trained on…

Machine Learning · Statistics 2016-06-24 Florian Colombo , Samuel P. Muscinelli , Alexander Seeholzer , Johanni Brea , Wulfram Gerstner

The aim of this study is to teach an algorithm how to recognize different types of music. Users will submit songs for analysis. Since the algorithm hasn't heard these songs before, it needs to figure out what makes each song unique. It does…

Sound · Computer Science 2024-05-28 Navin Kamuni , Dheerendra Panwar

In this study, the notion of perceptual features is introduced for describing general music properties based on human perception. This is an attempt at rethinking the concept of features, in order to understand the underlying human…

Information Retrieval · Computer Science 2014-04-01 Anders Friberg , Erwin Schoonderwaldt , Anton Hedblad , Marco Fabiani , Anders Elowsson

This study investigates how musical stimuli evoke feelings of creativity through predictive mechanisms, while also examining the role of interoceptive bodily sensations, particularly those linked to the heart and stomach regions.…

Neurons and Cognition · Quantitative Biology 2024-10-17 Tatsuya Daikoku , Masaki Tanaka

This work presents computational methods for transferring body movements from one person to another with videos collected in the wild. Specifically, we train a personalized model on a single video from the Internet which can generate videos…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Yipin Zhou , Zhaowen Wang , Chen Fang , Trung Bui , Tamara L. Berg

When hearing music, it is natural for people to dance to its rhythm. Automatic dance generation, however, is a challenging task due to the physical constraints of human motion and rhythmic alignment with target music. Conventional…

Graphics · Computer Science 2023-08-08 Qiaosong Qi , Le Zhuo , Aixi Zhang , Yue Liao , Fei Fang , Si Liu , Shuicheng Yan

Two modest-sized symbolic corpora of post-tonal and post-metric keyboard music have been constructed, one algorithmic, the other improvised. Deep learning models of each have been trained and largely optimised. Our purpose is to obtain a…

Sound · Computer Science 2017-12-22 Roger T. Dean , Jamie Forth

Despite advances in deep algorithmic music generation, evaluation of generated samples often relies on human evaluation, which is subjective and costly. We focus on designing a homogeneous, objective framework for evaluating samples of…

Musical mode is one of the most critical element that establishes the framework of pitch organization and determines the harmonic relationships. Previous works often use the simplistic and rigid alignment method, and overlook the diversity…

Sound · Computer Science 2025-01-15 Qian Liang , Yi Zeng , Menghaoran Tang

Considering music as a sequence of events with multiple complex dependencies, the Long Short-Term Memory (LSTM) architecture has proven very efficient in learning and reproducing musical styles. However, the generation of rhythms requires…

Sound · Computer Science 2019-01-23 Dimos Makris , Maximos Kaliakatsos-Papakostas , Katia Lida Kermanidis

How to automatically synthesize natural-looking dance movements based on a piece of music is an incrementally popular yet challenging task. Most existing data-driven approaches require hard-to-get paired training data and fail to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Bin Feng , Tenglong Ao , Zequn Liu , Wei Ju , Libin Liu , Ming Zhang

Making music with other people is a social activity as well as an artistic one. Music therapists take advantage of the social aspects of music to obtain benefits for the patients, interacting with them musically, but this activity requires…

Multimedia · Computer Science 2022-09-01 Filippo Carnovalini , Antonio Rodà , Paolo Caneva

In recent years, AI-generated music has made significant progress, with several models performing well in multimodal and complex musical genres and scenes. While objective metrics can be used to evaluate generative music, they often lack…

Sound · Computer Science 2023-08-29 Zeyu Xiong , Weitao Wang , Jing Yu , Yue Lin , Ziyan Wang

A music mashup combines audio elements from two or more songs to create a new work. To reduce the time and effort required to make them, researchers have developed algorithms that predict the compatibility of audio elements. Prior work has…

Sound · Computer Science 2021-03-29 Jiawen Huang , Ju-Chiang Wang , Jordan B. L. Smith , Xuchen Song , Yuxuan Wang