English
Related papers

Related papers: Exploring Transformer-Based Music Overpainting for…

200 papers

In the stereo-to-multichannel upmixing problem for music, one of the main tasks is to set the directionality of the instrument sources in the multichannel rendering results. In this paper, we propose a modified variational autoencoder model…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-24 Haici Yang , Sanna Wager , Spencer Russell , Mike Luo , Minje Kim , Wontak Kim

This paper describes a streaming audio-to-MIDI piano transcription approach that aims to sequentially translate a music signal into a sequence of note onset and offset events. The sequence-to-sequence nature of this task may call for the…

Sound · Computer Science 2025-03-04 Weixing Wei , Jiahao Zhao , Yulun Wu , Kazuyoshi Yoshii

Existing approaches for generating multitrack music with transformer models have been limited in terms of the number of instruments, the length of the music segments and slow inference. This is partly due to the memory requirements of the…

Sound · Computer Science 2023-05-26 Hao-Wen Dong , Ke Chen , Shlomo Dubnov , Julian McAuley , Taylor Berg-Kirkpatrick

Piano covers of pop music are enjoyed by many people. However, the task of automatically generating piano covers of pop music is still understudied. This is partly due to the lack of synchronized {Pop, Piano Cover} data pairs, which made it…

Sound · Computer Science 2023-04-04 Jongho Choi , Kyogu Lee

Recent years have witnessed a growing interest in research related to the detection of piano pedals from audio signals in the music information retrieval community. However, to our best knowledge, recent generative models for symbolic music…

Sound · Computer Science 2021-11-03 Joann Ching , Yi-Hsuan Yang

Despite its potential, AI advances in music education are hindered by proprietary systems that limit the democratization of technology in this domain. In particular, AI-driven music difficulty adjustment is especially promising, as…

Sound · Computer Science 2025-11-25 Pedro Ramoneda , Emilia Parada-Cabaleiro , Dasaem Jeong , Xavier Serra

In recent years, advancements in neural network designs and the availability of large-scale labeled datasets have led to significant improvements in the accuracy of piano transcription models. However, most previous work focused on…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-11 Taegyun Kwon , Dasaem Jeong , Juhan Nam

We consider the problem of learning high-level controls over the global structure of generated sequences, particularly in the context of symbolic music generation with complex language models. In this work, we present the Transformer…

Sound · Computer Science 2020-07-01 Kristy Choi , Curtis Hawthorne , Ian Simon , Monica Dinculescu , Jesse Engel

Given a musical audio recording, the goal of automatic music transcription is to determine a score-like representation of the piece underlying the recording. Despite significant interest within the research community, several studies have…

Sound · Computer Science 2016-09-05 Sebastian Ewert , Mark Sandler

In an attempt at exploring the limitations of simple approaches to the task of piano transcription (as usually defined in MIR), we conduct an in-depth analysis of neural network-based framewise transcription. We systematically compare…

This project presents an AI-based system for tone replication in music production, focusing on predicting EQ parameter settings directly from audio features. Unlike traditional audio-to-audio methods, our approach outputs interpretable…

Sound · Computer Science 2025-09-30 Song-Ze Yu

At present, neural network-based models, including transformers, struggle to generate memorable and readily comprehensible music from unified and repetitive musical material due to a lack of understanding of musical structure. Consequently,…

Sound · Computer Science 2026-01-21 Shangxuan Luo , Joshua Reiss

Advances in neural network design and the availability of large-scale labeled datasets have driven major improvements in piano transcription. Existing approaches target either offline applications, with no restrictions on computational…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-10 Patricia Hu , Silvan David Peter , Jan Schlüter , Gerhard Widmer

State-of-the-art end-to-end Optical Music Recognition (OMR) has, to date, primarily been carried out using monophonic transcription techniques to handle complex score layouts, such as polyphony, often by resorting to simplifications or…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Antonio Ríos-Vila , Jorge Calvo-Zaragoza , Thierry Paquet

The automated creation of accurate musical notation from an expressive human performance is a fundamental task in computational musicology. To this end, we present an end-to-end deep learning approach that constructs detailed musical scores…

Sound · Computer Science 2024-10-02 Tim Beyer , Angela Dai

In the realm of music AI, arranging rich and structured multi-track accompaniments from a simple lead sheet presents significant challenges. Such challenges include maintaining track cohesion, ensuring long-term coherence, and optimizing…

Sound · Computer Science 2024-11-26 Jingwei Zhao , Gus Xia , Ziyu Wang , Ye Wang

Deep generative models have been used in style transfer tasks for images. In this study, we adapt and improve CycleGAN model to perform music style transfer on Jazz and Classic genres. By doing so, we aim to easily generate new songs, cover…

Sound · Computer Science 2025-03-31 Fidan Samet , Oguz Bakir , Adnan Fidan

Despite deep learning's remarkable advances in style transfer across various domains, generating controllable performance-level musical style transfer for complete symbolically represented musical works remains a challenging area of…

Due to long-distance correlation and powerful pretrained models, transformer-based methods have initiated a breakthrough in visual object tracking performance. Previous works focus on designing effective architectures suited for tracking,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Jie Zhao , Johan Edstedt , Michael Felsberg , Dong Wang , Huchuan Lu

We are interested in the task of generating multi-instrumental music scores. The Transformer architecture has recently shown great promise for the task of piano score generation; here we adapt it to the multi-instrumental setting.…