English
Related papers

Related papers: Melody transcription via generative pre-training

200 papers

Melody estimation or melody extraction refers to the extraction of the primary or fundamental dominant frequency in a melody. This sequence of frequencies obtained represents the pitch of the dominant melodic line from recorded music audio…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-30 Udhav Gupta , Avi , Bhavesh Jain

Deep learning models for music have advanced drastically in recent years, but how good are machine learning models at capturing emotion, and what challenges are researchers facing? In this paper, we provide a comprehensive overview of the…

Sound · Computer Science 2025-06-25 Jaeyong Kang , Dorien Herremans

This paper is a survey and an analysis of different ways of using deep learning (deep artificial neural networks) to generate musical content. We propose a methodology based on five dimensions for our analysis: Objective - What musical…

Sound · Computer Science 2019-08-09 Jean-Pierre Briot , Gaëtan Hadjeres , François-David Pachet

Recent advances in text-to-music generation (TTM) have yielded high-quality results, but often at the cost of extensive compute and the use of large proprietary internal data. To improve the affordability and openness of TTM training, an…

Sound · Computer Science 2026-01-22 Wei-Jaw Lee , Fang-Chih Hsieh , Xuanjun Chen , Fang-Duo Tsai , Yi-Hsuan Yang

Recently, symbolic music generation has become a focus of numerous deep learning research. Structure as an important part of music, contributes to improving the quality of music, and an increasing number of works start to study the…

Sound · Computer Science 2024-10-16 Yishan Lv , Jing Luo , Boyuan Ju , Xinyu Yang

The traditional songwriting process is rather complex and this is evident in the time it takes to produce lyrics that fit the genre and form comprehensive verses. Our project aims to simplify this process with deep learning techniques, thus…

Computation and Language · Computer Science 2024-09-24 Tracy Cai , Wilson Liang , Donte Townes

This work present a music dataset named MusicTM-Dataset, which is utilized in improving the representation learning ability of different types of cross-modal retrieval (CMR). Little large music dataset including three modalities is…

Sound · Computer Science 2021-05-10 Donghuo Zeng , Yi Yu , Keizo Oyama

Music source separation performance has greatly improved in recent years with the advent of approaches based on deep learning. Such methods typically require large amounts of labelled training data, which in the case of music consist of…

Sound · Computer Science 2019-09-19 Ethan Manilow , Gordon Wichern , Prem Seetharaman , Jonathan Le Roux

Benefiting from large-scale datasets and pre-trained models, the field of generative models has recently gained significant momentum. However, most datasets for symbolic music are very small, which potentially limits the performance of…

Sound · Computer Science 2023-01-05 Shangda Wu , Maosong Sun

Large deep-learning models for music, including those focused on learning general-purpose music audio representations, are often assumed to require substantial training data to achieve high performance. If true, this would pose challenges…

Sound · Computer Science 2025-05-12 Christos Plachouras , Emmanouil Benetos , Johan Pauwels

In this paper, we tackle the problem of transfer learning for Jazz automatic generation. Jazz is one of representative types of music, but the lack of Jazz data in the MIDI format hinders the construction of a generative model for Jazz.…

Sound · Computer Science 2019-08-27 Hsiao-Tzu Hung , Chung-Yang Wang , Yi-Hsuan Yang , Hsin-Min Wang

Music structure analysis (MSA) methods traditionally search for musically meaningful patterns in audio: homogeneity, repetition, novelty, and segment-length regularity. Hand-crafted audio features such as MFCCs or chromagrams are often used…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-03 Ju-Chiang Wang , Jordan B. L. Smith , Wei-Tsung Lu , Xuchen Song

Music generation with the aid of computers has been recently grabbed the attention of many scientists in the area of artificial intelligence. Deep learning techniques have evolved sequence production methods for this purpose. Yet, a…

Neural and Evolutionary Computing · Computer Science 2020-04-09 Majid Farzaneh , Rahil Mahdian Toroghi

Music foundation models possess impressive music generation capabilities. When people compose music, they may infuse their understanding of music into their work, by using notes and intervals to craft melodies, chords to build progressions,…

Sound · Computer Science 2024-10-02 Megan Wei , Michael Freeman , Chris Donahue , Chen Sun

Automatic Music Transcription (AMT) -- the task of converting music audio into note representations -- has seen rapid progress, driven largely by deep learning systems. Due to the limited availability of richly annotated music datasets,…

Sound · Computer Science 2026-01-27 Lukáš Samuel Marták , Patricia Hu , Gerhard Widmer

Many practices have been presented in music generation recently. While stylistic music generation using deep learning techniques has became the main stream, these models still struggle to generate music with high musicality, different…

Sound · Computer Science 2021-05-12 Shuqi Dai , Xichu Ma , Ye Wang , Roger B. Dannenberg

Diffusion models have shown promising results in cross-modal generation tasks, including text-to-image and text-to-audio generation. However, generating music, as a special type of audio, presents unique challenges due to limited…

Sound · Computer Science 2023-08-04 Ke Chen , Yusong Wu , Haohe Liu , Marianna Nezhurina , Taylor Berg-Kirkpatrick , Shlomo Dubnov

Multi-modal music generation, using multiple modalities like text, images, and video alongside musical scores and audio as guidance, is an emerging research area with broad applications. This paper reviews this field, categorizing music…

Sound · Computer Science 2026-03-09 Shuyu Li , Shulei Ji , Zihao Wang , Songruoyao Wu , Jiaxing Yu , Kejun Zhang

Music exists in various modalities, such as score images, symbolic scores, MIDI, and audio. Translations between each modality are established as core tasks of music information retrieval, such as automatic music transcription…

Sound · Computer Science 2026-04-08 Jongmin Jung , Dongmin Kim , Sihun Lee , Seola Cho , Hyungjoon Soh , Irmak Bukey , Chris Donahue , Dasaem Jeong

Despite significant advancements in deep learning for vision and natural language, unsupervised domain adaptation in audio remains relatively unexplored. We, in part, attribute this to the lack of an appropriate benchmark dataset. To…

Sound · Computer Science 2023-09-27 Chia-Hsin Lin , Charles Jones , Björn W. Schuller , Harry Coppock