English
Related papers

Related papers: Enabling Factorized Piano Music Modeling and Gener…

200 papers

Musical expression requires control of both what notes are played, and how they are performed. Conventional audio synthesizers provide detailed expressive controls, but at the cost of realism. Black-box neural audio synthesis and…

While piano music has become a significant area of study in Music Information Retrieval (MIR), there is a notable lack of datasets for piano solo music with text labels. To address this gap, we present PIAST (PIano dataset with Audio,…

Sound · Computer Science 2024-11-08 Hayeon Bang , Eunjin Choi , Megan Finch , Seungheon Doh , Seolhee Lee , Gyeong-Hoon Lee , Juhan Nam

Recent advances in polyphonic piano transcription have been made primarily by a deliberate design of neural network architectures that detect different note states such as onset or sustain and model the temporal evolution of the states. The…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-05 Taegyun Kwon , Dasaem Jeong , Juhan Nam

We consider the conversion of musical recordings into human-readable sheet music annotated with timestamps. Such output lets a listener clearly visualize rubato (temporally expressive playing), a learner diagnose ensemble precision and…

Sound · Computer Science 2026-05-26 Nazif Can Tamer , Victoria Ebert , Guang Yang , Noah A. Smith

While piano music transcription models have shown high performance for solo piano recordings, their performance degrades when applied to ensemble recordings. This study aims to analyze the impact of different data augmentation methods on…

Sound · Computer Science 2023-05-24 Hyemi Kim , Jiyun Park , Taegyun Kwon , Dasaem Jeong , Juhan Nam

Computational engine sound modeling is central to the automotive audio industry, particularly for active sound design, virtual prototyping, and emerging data-driven engine sound synthesis methods. These applications require large volumes of…

Sound · Computer Science 2026-03-10 Robin Doerfler , Lonce Wyse

From clinical healthcare to daily living, continuous sensor monitoring across multiple modalities has shown great promise for real-world intelligent decision-making but also faces various challenges. In this work, we introduce MAESTRO, a…

Machine Learning · Computer Science 2025-10-01 Payal Mohapatra , Yueyuan Sui , Akash Pandey , Stephen Xia , Qi Zhu

Symbolic music datasets with matched scores and performances are essential for many music information retrieval (MIR) tasks. Yet, existing resources often cover a narrow range of composers, lack performance variety, omit note-level…

Sound · Computer Science 2026-05-08 Ilya Borovik

Managing the emotional aspect remains a challenge in automatic music generation. Prior works aim to learn various emotions at once, leading to inadequate modeling. This paper explores the disentanglement of emotions in piano performance…

Sound · Computer Science 2024-07-31 Jingyue Huang , Ke Chen , Yi-Hsuan Yang

Audio-driven bimanual piano motion generation requires precise modeling of complex musical structures and dynamic cross-hand coordination. However, existing methods often rely on acoustic-only representations lacking symbolic priors, employ…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Xuan Wang , Kai Ruan , Jiayi Han , Kaiyue Zhou , Gaoang Wang

In this paper, we consider the problem of probabilistically modelling symbolic music data. We introduce a representation which reduces polyphonic music to a univariate categorical sequence. In this way, we are able to apply state of the art…

Sound · Computer Science 2016-06-07 Christian Walder

Rapid advancements in artificial intelligence have significantly enhanced generative tasks involving music and images, employing both unimodal and multimodal approaches. This research develops a model capable of generating music that…

Sound · Computer Science 2024-09-13 Tanisha Hisariya , Huan Zhang , Jinhua Liang

Music arrangement generation is a subtask of automatic music generation, which involves reconstructing and re-conceptualizing a piece with new compositional techniques. Such a generation process inevitably requires reference from the…

Sound · Computer Science 2020-08-18 Ziyu Wang , Ke Chen , Junyan Jiang , Yiyi Zhang , Maoran Xu , Shuqi Dai , Xianbin Gu , Gus Xia

We introduce a structure-aware approach for symbolic piano accompaniment that decouples high-level planning from note-level realization. A lightweight transformer predicts an interpretable, per-measure style plan conditioned on…

Sound · Computer Science 2026-02-18 Wanyu Zang , Yang Yu , Meng Yu

We present an audio-to-analysis pipeline that produces composer-level information-theoretic profiles : reflecting compositional vocabulary as it emerges from aggregated performances : from raw recordings, built on a transcription layer…

Sound · Computer Science 2026-05-11 Fred Jalbert-Desforges

A great number of deep learning based models have been recently proposed for automatic music composition. Among these models, the Transformer stands out as a prominent approach for generating expressive classical piano performance with a…

Sound · Computer Science 2020-08-11 Yu-Siang Huang , Yi-Hsuan Yang

We present a method for the generation of Midi files of piano music. The method models the right and left hands using two networks, where the left hand is conditioned on the right hand. This way, the melody is generated before the harmony.…

Sound · Computer Science 2021-11-29 Or Goren , Eliya Nachmani , Lior Wolf

This paper introduces a novel method for emulating piano sounds. We propose to exploit the sines, transient, and noise decomposition to design a differentiable spectral modeling synthesizer replicating piano notes. Three sub-modules learn…

Sound · Computer Science 2025-02-04 Riccardo Simionato , Stefano Fasciani

Estimating piano dynamic from audio recordings is a fundamental challenge in computational music analysis. In this paper, we propose an efficient multi-task network that jointly predicts dynamic levels, change points, beats, and downbeats…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-04 Zhanhong He , Hanyu Meng , David Huang , Roberto Togneri

Learning musical structures and composition patterns is necessary for both music generation and understanding, but current methods do not make uniform use of learned features to generate and comprehend music simultaneously. In this paper,…

Sound · Computer Science 2024-12-10 Xiao Liang , Zijian Zhao , Weichao Zeng , Yutong He , Fupeng He , Yiyi Wang , Chengying Gao