English
Related papers

Related papers: The Piano Inpainting Application

200 papers

In this work we present a new approach for the task of predicting fingerings for piano music. While prior neural approaches have often treated this as a sequence tagging problem with independent predictions, we put forward a checklist…

Machine Learning · Computer Science 2022-09-14 Nikita Srivatsan , Taylor Berg-Kirkpatrick

In the pursuit of developing expressive music performance models using artificial intelligence, this paper introduces DExter, a new approach leveraging diffusion probabilistic models to render Western classical piano performances. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Huan Zhang , Shreyan Chowdhury , Carlos Eduardo Cancino-Chacón , Jinhua Liang , Simon Dixon , Gerhard Widmer

We present a study that explores the role of user-centred design in developing Generative AI (GenAI) tools for music composition. Through semi-structured interviews with professional composers, we gathered insights on a novel generative…

Sound · Computer Science 2024-12-17 Eleanor Row , György Fazekas

The ultimate purpose of generative music AI is music production. The studio-lab, a social form within the art-science branch of cross-disciplinarity, is a way to advance music production with AI music models. During a studio-lab experiment…

Sound · Computer Science 2026-05-18 Emmanuel Deruty , Maarten Grachten

Research on automatic music generation has seen great progress due to the development of deep neural networks. However, the generation of multi-instrument music of arbitrary genres still remains a challenge. Existing research either works…

Sound · Computer Science 2018-07-31 Hao-Min Liu , Yi-Hsuan Yang

While deep generative models have empowered music generation, it remains a challenging and under-explored problem to edit an existing musical piece at fine granularity. In this paper, we propose SDMuse, a unified Stochastic Differential…

Sound · Computer Science 2022-11-03 Chen Zhang , Yi Ren , Kejun Zhang , Shuicheng Yan

This study focuses on the perception of music performances when contextual factors, such as room acoustics and instrument, change. We propose to distinguish the concept of "performance" from the one of "interpretation", which expresses the…

Sound · Computer Science 2022-03-08 Federico Simonetta , Federico Avanzini , Stavros Ntalampiras

Recent advances in generative AI for music have achieved remarkable fidelity and stylistic diversity, yet these systems often fail to align with nuanced human preferences due to the specific loss functions they use. This paper advocates for…

Sound · Computer Science 2025-11-20 Dorien Herremans , Abhinaba Roy

While neural network models are making significant progress in piano transcription, they are becoming more resource-consuming due to requiring larger model size and more computing power. In this paper, we attempt to apply more prior about…

Sound · Computer Science 2022-09-01 Weixing Wei , Peilin Li , Yi Yu , Wei Li

Generating music is an interesting and challenging problem in the field of machine learning. Mimicking human creativity has been popular in recent years, especially in the field of computer vision and image processing. With the advent of…

Sound · Computer Science 2020-11-03 Ashish Ranjan , Varun Nagesh Jolly Behera , Motahar Reza

We introduce Composer's Assistant, a system for interactive human-computer composition in the REAPER digital audio workstation. We consider the task of multi-track MIDI infilling when arbitrary track-measures have been deleted from a…

Sound · Computer Science 2023-07-18 Martin E. Malandro

Large-scale pre-trained language models, such as BERT and GPT-2, have achieved excellent performance in language representation learning and free-form text generation. However, these models cannot be directly employed to generate text under…

Computation and Language · Computer Science 2020-09-29 Yizhe Zhang , Guoyin Wang , Chunyuan Li , Zhe Gan , Chris Brockett , Bill Dolan

Despite recent achievements of deep learning automatic music generation algorithms, few approaches have been proposed to evaluate whether a single-track music excerpt is composed by automatons or Homo sapiens. To tackle this problem, we…

Sound · Computer Science 2021-02-02 Mingshuo Ding , Yinghao Ma

This article presents a benchmark study of symbolic piano music classification using the masked language modelling approach of the Bidirectional Encoder Representations from Transformers (BERT). Specifically, we consider two types of MIDI…

Sound · Computer Science 2024-04-16 Yi-Hui Chou , I-Chun Chen , Chin-Jui Chang , Joann Ching , Yi-Hsuan Yang

We introduce MIDI-VAE, a neural network model based on Variational Autoencoders that is capable of handling polyphonic music with multiple instrument tracks, as well as modeling the dynamics of music by incorporating note durations and…

Sound · Computer Science 2018-09-21 Gino Brunner , Andres Konrad , Yuyi Wang , Roger Wattenhofer

In recent decades, neuroscientific and psychological research has traced direct relationships between taste and auditory perceptions. This article explores multimodal generative models capable of converting taste information into music,…

Sound · Computer Science 2025-09-01 Matteo Spanio , Massimiliano Zampini , Antonio Rodà , Franco Pierucci

Learning musical structures and composition patterns is necessary for both music generation and understanding, but current methods do not make uniform use of learned features to generate and comprehend music simultaneously. In this paper,…

Sound · Computer Science 2024-12-10 Xiao Liang , Zijian Zhao , Weichao Zeng , Yutong He , Fupeng He , Yiyi Wang , Chengying Gao

This pictorial aims to critically consider the nature of text-to-audio and text-to-music generative tools in the context of explainable AI. As a group of experimental musicians and researchers, we are enthusiastic about the creative…

Sound · Computer Science 2024-08-15 Jesse Allison , Drew Farrar , Treya Nash , Carlos Román , Morgan Weeks , Fiona Xue Ju

Recent advancements in generative AI have made text-guided image inpainting - adding, removing, or altering image regions using textual prompts - widely accessible. However, generating semantically correct photorealistic imagery, typically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Paschalis Giakoumoglou , Dimitrios Karageorgiou , Symeon Papadopoulos , Panagiotis C. Petrantonakis

Recent advances in generative AI have made music generation a prominent research focus. However, many neural-based models rely on large datasets, raising concerns about copyright infringement and high-performance costs. In contrast, we…

Sound · Computer Science 2025-11-24 Callie C. Liao , Duoduo Liao , Ellie L. Zhang