English
Related papers

Related papers: Exploring Conditioning for Generative Music System…

200 papers

We present a framework for real-time human-AI musical co-performance, in which a latent diffusion model generates instrumental accompaniment in response to a live stream of context audio. The system combines a MAX/MSP front-end-handling…

Sound · Computer Science 2026-04-10 Tornike Karchkhadze , Shlomo Dubnov

Generating musical audio directly with neural networks is notoriously difficult because it requires coherently modeling structure at many different timescales. Fortunately, most music is also highly structured and can be represented as…

We propose Polyffusion, a diffusion model that generates polyphonic music scores by regarding music as image-like piano roll representations. The model is capable of controllable music generation with two paradigms: internal control and…

Sound · Computer Science 2023-07-21 Lejun Min , Junyan Jiang , Gus Xia , Jingwei Zhao

Directly learning to generate audio waveforms in an autoregressive manner is a challenging task, due to the length of the raw sequences and the existence of important structure on many different timescales. Traditional approaches based on…

Sound · Computer Science 2025-10-06 Konrad Szewczyk , Daniel Gallo Fernández , James Townsend

Data-driven approaches are increasingly popular for identifying dynamical systems due to improved accuracy and availability of sensor data. However, relying solely on data for identification does not guarantee that the identified systems…

Systems and Control · Electrical Eng. & Systems 2024-10-04 Nam T. Nguyen , Juan C. Tique

A model of music needs to have the ability to recall past details and have a clear, coherent understanding of musical structure. Detailed in the paper is a deep reinforcement learning architecture that predicts and generates polyphonic…

Sound · Computer Science 2018-12-05 Nikhil Kotecha

Assessing instruction quality is a fundamental component of any improvement efforts in the education system. However, traditional manual assessments are expensive, subjective, and heavily dependent on observers' expertise and idiosyncratic…

Computation and Language · Computer Science 2025-01-03 Paiheng Xu , Jing Liu , Nathan Jones , Julie Cohen , Wei Ai

We present a supervised neural network model for polyphonic piano music transcription. The architecture of the proposed model is analogous to speech recognition systems and comprises an acoustic model and a music language model. The…

Machine Learning · Statistics 2016-02-12 Siddharth Sigtia , Emmanouil Benetos , Simon Dixon

Spurred by the potential of deep learning, computational music generation has gained renewed academic interest. A crucial issue in music generation is that of user control, especially in scenarios where the music generation process is…

Sound · Computer Science 2019-08-05 Stefan Lattner , Maarten Grachten

While Large Language Models (LLMs) make symbolic music generation increasingly accessible, producing music with distinctive composition and rich expressiveness remains a significant challenge. Many studies have introduced emotion models to…

Sound · Computer Science 2025-11-19 Dengyun Huang , Yonghua Zhu

Recurrent neural networks (RNNs) are more suitable for learning non-linear dependencies in dynamical systems from observed time series data. In practice all the external variables driving such systems are not known a priori, especially in…

Machine Learning · Computer Science 2020-06-02 Mhlasakululeka Mvubu , Emmanuel Kabuga , Christian Plitz , Bubacarr Bah , Ronnie Becker , Hans Georg Zimmermann

We proposed a model for the Conference of Music and Technology (CSMT2020) data challenge of melody classification. Our model used the Performance Event Vector as the input sequence to build a Bidirectional RNN network for classfication. The…

Sound · Computer Science 2020-10-19 Jinyue Guo , Aozhi Liu , Jing Xiao

While deep generative models have become the leading methods for algorithmic composition, it remains a challenging problem to control the generation process because the latent variables of most deep-learning models lack good…

Sound · Computer Science 2020-08-18 Ziyu Wang , Dingsu Wang , Yixiao Zhang , Gus Xia

Recurrent neural networks (RNNs) were designed for dealing with time-series data and have recently been used for creating predictive models from functional magnetic resonance imaging (fMRI) data. However, gathering large fMRI datasets for…

Image and Video Processing · Electrical Eng. & Systems 2019-10-16 Nicha C. Dvornek , Xiaoxiao Li , Juntang Zhuang , James S. Duncan

Sound events often occur in unstructured environments where they exhibit wide variations in their frequency content and temporal structure. Convolutional neural networks (CNN) are able to extract higher level features that are invariant to…

Machine Learning · Computer Science 2017-05-31 Emre Çakır , Giambattista Parascandolo , Toni Heittola , Heikki Huttunen , Tuomas Virtanen

Music generation is always interesting in a sense that there is no formalized recipe. In this work, we propose a novel dual-track architecture for generating classical piano music, which is able to model the inter-dependency of left-hand…

Sound · Computer Science 2020-05-12 Sudi Lyu , Anxiang Zhang , Rong Song

Music transcription is the process of transcribing music audio into music notation. It is a field in which the machines still cannot beat human performance. The main motivation for automatic music transcription is to make it possible for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-25 Bojan Sofronievski , Branislav Gerazov

Automatic music generation is an interdisciplinary research topic that combines computational creativity and semantic analysis of music to create automatic machine improvisations. An important property of such a system is allowing the user…

Sound · Computer Science 2020-03-03 Ke Chen , Gus Xia , Shlomo Dubnov

Text-to-music generation models are now capable of generating high-quality music audio in broad styles. However, text control is primarily suitable for the manipulation of global musical attributes like genre, mood, and tempo, and is less…

Sound · Computer Science 2023-11-14 Shih-Lun Wu , Chris Donahue , Shinji Watanabe , Nicholas J. Bryan

We studied the ability of deep neural networks (DNNs) to restore missing audio content based on its context, a process usually referred to as audio inpainting. We focused on gaps in the range of tens of milliseconds. The proposed DNN…

Sound · Computer Science 2022-02-21 Andrés Marafioti , Nicki Holighaus , Piotr Majdak , Nathanaël Perraudin