English
Related papers

Related papers: Automatic Music Mixing using a Generative Model of…

200 papers

Multimodal music generation aims to produce music from diverse input modalities, including text, videos, and images. Existing methods use a common embedding space for multimodal fusion. Despite their effectiveness in other modalities, their…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Baisen Wang , Le Zhuo , Zhaokai Wang , Chenxi Bao , Wu Chengjing , Xuecheng Nie , Jiao Dai , Jizhong Han , Yue Liao , Si Liu

Generating human motion guided by conditions such as textual descriptions is challenging due to the need for datasets with pairs of high-quality motion and their corresponding conditions. The difficulty increases when aiming for finer…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Pablo Ruiz-Ponce , German Barquero , Cristina Palmero , Sergio Escalera , José García-Rodríguez

We propose a visually conditioned music remixing system by incorporating deep visual and audio models. The method is based on a state of the art audio-visual source separation model which performs music instrument source separation with…

Sound · Computer Science 2020-10-29 Li-Chia Yang , Alexander Lerch

This study proposes a system designed to enumerate the process of collaborative composition among humans, using automatic music composition technology. By integrating multiple Recurrent Neural Network (RNN) models, the system provides an…

Sound · Computer Science 2024-03-07 So Hirawata , Noriko Otani

We present a hybrid neural network and rule-based system that generates pop music. Music produced by pure rule-based systems often sounds mechanical. Music produced by machine learning sounds better, but still lacks hierarchical temporal…

Sound · Computer Science 2017-10-09 Yifei Teng , An Zhao , Camille Goudeseune

Music rearrangement involves reshuffling, deleting, and repeating sections of a music piece with the goal of producing a standalone version that has a different duration. It is a creative and time-consuming task commonly performed by an…

Sound · Computer Science 2023-05-15 Christos Plachouras , Marius Miron

While both the data volume and heterogeneity of the digital music content is huge, it has become increasingly important and convenient to build a recommendation or search system to facilitate surfacing these content to the user or consumer…

To train a machine learning model is necessary to take numerous decisions about many options for each process involved, in the field of sequence generation and more specifically of music composition, the nature of the problem helps to…

Sound · Computer Science 2021-01-20 Sebastian Garcia-Valencia , Alejandro Betancourt , Juan G. Lalinde-Pulido

This paper introduces a simple method for producing multichannel MIDI music that is based on randomness and simple probabilities. One distinctive feature of the method is that it produces and sends in parallel to the sound card more than…

Sound · Computer Science 2013-12-17 Yannis Tzitzikas

A big challenge in algorithmic composition is to devise a model that is both easily trainable and able to reproduce the long-range temporal dependencies typical of music. Here we investigate how artificial neural networks can be trained on…

Machine Learning · Statistics 2016-06-24 Florian Colombo , Samuel P. Muscinelli , Alexander Seeholzer , Johanni Brea , Wulfram Gerstner

Commercial adoption of automatic music composition requires the capability of generating diverse and high-quality music suitable for the desired context (e.g., music for romantic movies, action games, restaurants, etc.). In this paper, we…

Sound · Computer Science 2022-11-18 Lee Hyun , Taehyun Kim , Hyolim Kang , Minjoo Ki , Hyeonchan Hwang , Kwanho Park , Sharang Han , Seon Joo Kim

Modern digital music production typically involves combining numerous acoustic elements to compile a piece of music. Important types of such elements are drum samples, which determine the characteristics of the percussive components of the…

Sound · Computer Science 2022-08-03 Stefan Lattner

Separating the individual elements in a musical mixture is an essential process for music analysis and practice. While this is generally addressed using neural networks optimized to mask or transform the time-frequency representation of a…

Sound · Computer Science 2025-11-27 Genís Plaja-Roglans , Yun-Ning Hung , Xavier Serra , Igor Pereira

Machine-generated music (MGM) has become a groundbreaking innovation with wide-ranging applications, such as music therapy, personalised editing, and creative inspiration within the music industry. However, the unregulated proliferation of…

Sound · Computer Science 2026-04-30 Yupei Li , Qiyang Sun , Hanqian Li , Lucia Specia , Björn W. Schuller

Generative artificial intelligence raises concerns related to energy consumption, copyright infringement and creative atrophy. We show that randomly initialized recurrent neural networks can produce arpeggios and low-frequency oscillations…

Sound · Computer Science 2025-07-23 Hugo Chateau-Laurent , Tara Vanhatalo , Wei-Tung Pan , Xavier Hinaut

Beat tracking is a widely researched topic in music information retrieval. However, current beat tracking methods face challenges due to the scarcity of labeled data, which limits their ability to generalize across diverse musical styles…

Sound · Computer Science 2025-09-10 Ganghui Ru , Jieying Wang , Jiahao Zhao , Yulun Wu , Yi Yu , Nannan Jiang , Wei Wang , Wei Li

Recent advances in deep neural networks have enabled algorithms to compose music that is comparable to music composed by humans. However, few algorithms allow the user to generate music with tunable parameters. The ability to tune…

Sound · Computer Science 2018-02-06 Huanru Henry Mao , Taylor Shin , Garrison W. Cottrell

Real music signals are highly variable, yet they have strong statistical structure. Prior information about the underlying physical mechanisms by which sounds are generated and rules by which complex sound structure is constructed (notes,…

Machine Learning · Statistics 2016-06-13 Pablo A. Alvarado , Dan Stowell

The present methodology is aimed at cross-modal machine learning and uses multidisciplinary tools and methods drawn from a broad range of areas and disciplines, including music, systematic musicology, dance, motion capture, human-computer…

Human-Computer Interaction · Computer Science 2017-12-04 Fabio Paolizzo

Evaluating generative models remains a fundamental challenge, particularly when the goal is to reflect human preferences. In this paper, we use music generation as a case study to investigate the gap between automatic evaluation metrics and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Huan Zhang , Jinhua Liang , Huy Phan , Wenwu Wang , Emmanouil Benetos