English
Related papers

Related papers: Chord-Conditioned Melody Harmonization with Contro…

200 papers

Harmony in visual compositions is a concept that cannot be defined or easily expressed mathematically, even by humans. The goal of the research described in this paper was to find a numerical representation of artistic compositions with…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Adam Vandor , Marie van Vollenhoven , Gerhard Weiss , Gerasimos Spanakis

Lyric-to-melody generation is a highly challenging task in the field of AI music generation. Due to the difficulty of learning strict yet weak correlations between lyrics and melodies, previous methods have suffered from weak…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-16 Li Chai , Donglin Wang

Musical expression requires control of both what notes are played, and how they are performed. Conventional audio synthesizers provide detailed expressive controls, but at the cost of realism. Black-box neural audio synthesis and…

This paper presents a new approach to algorithmic composition, called predictive controlled music (PCM), which combines model predictive control (MPC) with music generation. PCM uses dynamic models to predict and optimize the music…

Sound · Computer Science 2026-01-09 Midhun T. Augustine

Music is a complex socio-cultural construct, which fascinates researchers in diverse fields, as well as the general public. Understanding the historical development of music may help us understand perceptual and cognition, while also…

Physics and Society · Physics 2023-08-08 Alfredo González-Espinoza , Joshua B. Plotkin

Recent large-scale generative models learned on big data are capable of synthesizing incredible images yet suffer from limited controllability. This work offers a new generation paradigm that allows flexible control of the output image,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Lianghua Huang , Di Chen , Yu Liu , Yujun Shen , Deli Zhao , Jingren Zhou

Progress in automatic chord recognition has been slow since the advent of deep learning in the field. To understand why, I conduct experiments on existing methods and test hypotheses enabled by recent developments in generative models.…

Sound · Computer Science 2025-12-30 Pierre Mackenzie

In this paper, we study a novel task that learns to compose music from natural language. Given the lyrics as input, we propose a melody composition model that generates lyrics-conditional melody as well as the exact alignment between the…

Computation and Language · Computer Science 2018-09-13 Hangbo Bao , Shaohan Huang , Furu Wei , Lei Cui , Yu Wu , Chuanqi Tan , Songhao Piao , Ming Zhou

Symbolic Music Generation relies on the contextual representation capabilities of the generative model, where the most prevalent approach is the Transformer-based model. The learning of musical context is also related to the structural…

Sound · Computer Science 2022-07-12 Guowei Wu , Shipei Liu , Xiaoya Fan

We demonstrate how conditional generation from diffusion models can be used to tackle a variety of realistic tasks in the production of music in 44.1kHz stereo audio with sampling-time guidance. The scenarios we consider include…

Sound · Computer Science 2023-12-06 Mark Levy , Bruno Di Giorgi , Floris Weers , Angelos Katharopoulos , Tom Nickson

The field of automatic music composition has seen great progress in recent years, specifically with the invention of transformer-based architectures. When using any deep learning model which considers music as a sequence of events with…

Sound · Computer Science 2022-02-22 Dimos Makris , Guo Zixun , Maximos Kaliakatsos-Papakostas , Dorien Herremans

The EMelodyGen system focuses on emotional melody generation in ABC notation controlled by the musical feature template. Owing to the scarcity of well-structured and emotionally labeled sheet music, we designed a template for controlling…

Information Retrieval · Computer Science 2025-05-20 Monan Zhou , Xiaobing Li , Feng Yu , Wei Li

Research on style transfer and domain translation has clearly demonstrated the ability of deep learning-based algorithms to manipulate images in terms of artistic style. More recently, several attempts have been made to extend such…

Sound · Computer Science 2021-06-11 Ondřej Cífka , Umut Şimşekli , Gaël Richard

Music generation with the aid of computers has been recently grabbed the attention of many scientists in the area of artificial intelligence. Deep learning techniques have evolved sequence production methods for this purpose. Yet, a…

Neural and Evolutionary Computing · Computer Science 2020-04-09 Majid Farzaneh , Rahil Mahdian Toroghi

We contribute a pop-song automation framework for lead melody generation and accompaniment arrangement. The framework reflects the major procedures of human music composition, generating both lead melody and piano accompaniment by a unified…

Sound · Computer Science 2018-12-31 Ziyu Wang , Gus Xia

We formalize and analyze a new automata-theoretic problem termed control improvisation. Given an automaton, the problem is to produce an improviser, a probabilistic algorithm that randomly generates words in its language, subject to two…

Formal Languages and Automata Theory · Computer Science 2017-04-25 Daniel J. Fremont , Alexandre Donzé , Sanjit A. Seshia , David Wessel

Lyric-to-melody generation, which generates melody according to given lyrics, is one of the most important automatic music composition tasks. With the rapid development of deep learning, previous works address this task with end-to-end…

Sound · Computer Science 2022-07-13 Chen Zhang , Luchin Chang , Songruoyao Wu , Xu Tan , Tao Qin , Tie-Yan Liu , Kejun Zhang

Chord recognition systems depend on robust feature extraction pipelines. While these pipelines are traditionally hand-crafted, recent advances in end-to-end machine learning have begun to inspire researchers to explore data-driven methods…

Machine Learning · Computer Science 2016-12-16 Filip Korzeniowski , Gerhard Widmer

Arranging music for a different set of instruments that it was originally written for is traditionally a tedious and time-consuming process, performed by experts with intricate knowledge of the specific instruments and involving significant…

Music generated by deep learning methods often suffers from a lack of coherence and long-term organization. Yet, multi-scale hierarchical structure is a distinctive feature of music signals. To leverage this information, we propose a…

Sound · Computer Science 2024-02-29 Manvi Agarwal , Changhong Wang , Gaël Richard