English
Related papers

Related papers: Everybody Compose: Deep Beats To Music

200 papers

We present the Latent Timbre Synthesis (LTS), a new audio synthesis method using Deep Learning. The synthesis method allows composers and sound designers to interpolate and extrapolate between the timbre of multiple sounds using the latent…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-03 K. Tatar , D. Bisig , P. Pasquier

A great number of deep learning based models have been recently proposed for automatic music composition. Among these models, the Transformer stands out as a prominent approach for generating expressive classical piano performance with a…

Sound · Computer Science 2020-08-11 Yu-Siang Huang , Yi-Hsuan Yang

Attempts to use generative models for music generation have been common in recent years, and some of them have achieved good results. Pieces generated by some of these models are almost indistinguishable from those being composed by human…

Sound · Computer Science 2020-11-26 You Li , Zhuowen Lin

This study introduces a text-conditioned approach to generating drumbeats with Latent Diffusion Models (LDMs). It uses informative conditioning text extracted from training data filenames. By pretraining a text and drumbeat encoder through…

Sound · Computer Science 2024-08-07 Pushkar Jajoria , James McDermott

Music mixing traditionally involves recording instruments in the form of clean, individual tracks and blending them into a final mixture using audio effects and expert knowledge (e.g., a mixing engineer). The automation of music production…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-30 Marco A. Martínez-Ramírez , Wei-Hsiang Liao , Giorgio Fabbro , Stefan Uhlich , Chihiro Nagashima , Yuki Mitsufuji

Automatic melody generation for pop music has been a long-time aspiration for both AI researchers and musicians. However, learning to generate euphonious melody has turned out to be highly challenging due to a number of factors.…

We present Subtractive Training, a simple and novel method for synthesizing individual musical instrument stems given other instruments as context. This method pairs a dataset of complete music mixes with 1) a variant of the dataset lacking…

In this work we describe and evaluate methods to learn musical embeddings. Each embedding is a vector that represents four contiguous beats of music and is derived from a symbolic representation. We consider autoencoding-based methods…

Sound · Computer Science 2017-06-19 Mason Bretan , Sageev Oore , Doug Eck , Larry Heck

Most digital music tools emphasize precision and control, but often lack support for tactile, improvisational workflows grounded in environmental interaction. Lumia addresses this by enabling users to "compose through looking"--transforming…

Human-Computer Interaction · Computer Science 2025-12-22 Chung-Ta Huang , Connie Cheng , Vealy Lai

We propose a deep attention-based alignment network, which aims to automatically predict lyrics and melody with given incomplete lyrics as input in a way similar to the music creation of humans. Most importantly, a deep neural…

Sound · Computer Science 2023-01-25 Gurunath Reddy M , Zhe Zhang , Yi Yu , Florian Harscoet , Simon Canales , Suhua Tang

Music evokes emotion in many people. We introduce a novel way to manipulate the emotional content of a song using AI tools. Our goal is to achieve the desired emotion while leaving the original melody as intact as possible. For this, we…

Sound · Computer Science 2024-06-14 Adel N. Abdalla , Jared Osborne , Razvan Andonie

Symbolic melodies generation is one of the essential tasks for automatic music generation. Recently, models based on neural networks have had a significant influence on generating symbolic melodies. However, the musical context structure is…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Jin Li , Haibin Liu , Nan Yan , Lan Wang

Two modest-sized symbolic corpora of post-tonal and post-metric keyboard music have been constructed, one algorithmic, the other improvised. Deep learning models of each have been trained and largely optimised. Our purpose is to obtain a…

Sound · Computer Science 2017-12-22 Roger T. Dean , Jamie Forth

The ultimate purpose of generative music AI is music production. The studio-lab, a social form within the art-science branch of cross-disciplinarity, is a way to advance music production with AI music models. During a studio-lab experiment…

Sound · Computer Science 2026-05-18 Emmanuel Deruty , Maarten Grachten

Algorithmic music composition is a way of composing musical pieces with minimal to no human intervention. While recurrent neural networks are traditionally applied to many sequence-to-sequence prediction tasks, including successful…

Machine Learning · Computer Science 2022-11-03 Moseli Mots'oehli , Anna Sergeevna Bosman , Johan Pieter De Villiers

Deep learning models are typically evaluated to measure and compare their performance on a given task. The metrics that are commonly used to evaluate these models are standard metrics that are used for different tasks. In the field of music…

Sound · Computer Science 2022-04-05 Carlos Hernandez-Olivan , Jorge Abadias Puyuelo , Jose R. Beltran

The ability to automatically generate music that appropriately matches an arbitrary input track is a challenging task. We present a novel controllable system for generating single stems to accompany musical mixes of arbitrary length. At the…

Sound · Computer Science 2024-02-05 Marco Pasini , Maarten Grachten , Stefan Lattner

While Large Language Models (LLMs) demonstrate impressive capabilities in text generation, we find that their ability has yet to be generalized to music, humanity's creative language. We introduce ChatMusician, an open-source LLM that…

Program synthesis from input-output examples, also called programming by example (PBE), has had tremendous impact on automating end-user tasks. Large language models (LLMs) have the ability to solve PBE tasks by generating code in different…

Programming Languages · Computer Science 2025-03-21 Ruhma Khan , Sumit Gulwani , Vu Le , Arjun Radhakrishna , Ashish Tiwari , Gust Verbruggen

Discovering and exploring the underlying structure of multi-instrumental music using learning-based approaches remains an open problem. We extend the recent MusicVAE model to represent multitrack polyphonic measures as vectors in a latent…

Machine Learning · Statistics 2018-06-04 Ian Simon , Adam Roberts , Colin Raffel , Jesse Engel , Curtis Hawthorne , Douglas Eck