English
Related papers

Related papers: Learning Audio - Sheet Music Correspondences for S…

200 papers

Machine-learning techniques have been recently used with spectacular results to generate artefacts such as music or text. However, these techniques are still unable to capture and generate artefacts that are convincingly structured. In this…

Artificial Intelligence · Computer Science 2017-03-03 Pierre Roy , Alexandre Papadopoulos , François Pachet

As one of the most intuitive interfaces known to humans, natural language has the potential to mediate many tasks that involve human-computer interaction, especially in application-focused fields like Music Information Retrieval. In this…

Sound · Computer Science 2022-08-26 Ilaria Manco , Emmanouil Benetos , Elio Quinton , György Fazekas

In this paper, we bridge the gap between visualization and musicology by focusing on rhythm analysis tasks, which are tedious due to the complex visual encoding of the well-established Common Music Notation (CMN). Instead of replacing the…

Human-Computer Interaction · Computer Science 2020-09-07 Daniel Fürst , Matthias Miller , Daniel Keim , Alexandra Bonnici , Hanna Schäfer , Mennatallah El-Assady

In this paper we present current trends in real-time music tracking (a.k.a. score following). Casually speaking, these algorithms "listen" to a live performance of music, compare the audio signal to an abstract representation of the score,…

Multimedia · Computer Science 2017-08-08 Andreas Arzt , Matthias Dorfer

Deep neural networks have frequently been used to directly learn representations useful for a given task from raw input data. In terms of overall performance metrics, machine learning solutions employing deep representations frequently have…

Machine Learning · Computer Science 2019-10-21 Jaehun Kim , Julián Urbano , Cynthia C. S. Liem , Alan Hanjalic

Music rearrangement involves reshuffling, deleting, and repeating sections of a music piece with the goal of producing a standalone version that has a different duration. It is a creative and time-consuming task commonly performed by an…

Sound · Computer Science 2023-05-15 Christos Plachouras , Marius Miron

We present a supervised neural network model for polyphonic piano music transcription. The architecture of the proposed model is analogous to speech recognition systems and comprises an acoustic model and a music language model. The…

Machine Learning · Statistics 2016-02-12 Siddharth Sigtia , Emmanouil Benetos , Simon Dixon

We address the problem of disambiguating large scale catalogs through the definition of an unknown artist clustering task. We explore the use of metric learning techniques to learn artist embeddings directly from audio, and using a…

Information Retrieval · Computer Science 2018-10-04 Jimena Royo-Letelier , Romain Hennequin , Viet-Anh Tran , Manuel Moussallam

In this paper, we present a neural network approach for synchronizing audio recordings of human piano performances with their corresponding loosely aligned MIDI files. The task is addressed using a Convolutional Recurrent Neural Network…

Sound · Computer Science 2025-06-30 Sebastian Murgul , Moritz Reiser , Michael Heizmann , Christoph Seibert

We introduce a dataset for facilitating audio-visual analysis of music performances. The dataset comprises 44 simple multi-instrument classical music pieces assembled from coordinated but separately recorded performances of individual…

Multimedia · Computer Science 2018-08-09 Bochen Li , Xinzhao Liu , Karthik Dinesh , Zhiyao Duan , Gaurav Sharma

With the recent growth of remote work, online meetings often encounter challenging audio contexts such as background noise, music, and echo. Accurate real-time detection of music events can help to improve the user experience. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-18 Chandan K. A. Reddy , Vishak Gopa , Harishchandra Dubey , Sergiy Matusevych , Ross Cutler , Robert Aichner

This paper investigates the problem of matching a MIDI file against a large database of piano sheet music images. Previous sheet-audio and sheet-MIDI alignment approaches have primarily focused on a 1-to-1 alignment task, which is not a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-23 TJ Tsai

Music retrieval and recommendation applications often rely on content features encoded as embeddings, which provide vector representations of items in a music dataset. Numerous complementary embeddings can be derived from processing items…

Information Retrieval · Computer Science 2023-08-15 Andres Ferraro , Jaehun Kim , Sergio Oramas , Andreas Ehmann , Fabien Gouyon

This paper approaches the problem of separating the notes from a quantized symbolic music piece (e.g., a MIDI file) into multiple voices and staves. This is a fundamental part of the larger task of music score engraving (or score…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-01 Francesco Foscarin , Emmanouil Karystinaios , Eita Nakamura , Gerhard Widmer

Music structure analysis (MSA) methods traditionally search for musically meaningful patterns in audio: homogeneity, repetition, novelty, and segment-length regularity. Hand-crafted audio features such as MFCCs or chromagrams are often used…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-03 Ju-Chiang Wang , Jordan B. L. Smith , Wei-Tsung Lu , Xuchen Song

Deep learning has successfully shown excellent performance in learning joint representations between different data modalities. Unfortunately, little research focuses on cross-modal correlation learning where temporal structures of…

Multimedia · Computer Science 2019-08-13 Donghuo Zeng , Yi Yu , Keizo Oyama

Music recommender systems frequently utilize network-based models to capture relationships between music pieces, artists, and users. Although these relationships provide valuable insights for predictions, new music pieces or artists often…

Sound · Computer Science 2024-09-16 Florian Grötschla , Luca Strässle , Luca A. Lanzendörfer , Roger Wattenhofer

Having access to multi-modal cues (e.g. vision and audio) empowers some cognitive tasks to be done faster compared to learning from a single modality. In this work, we propose to transfer knowledge across heterogeneous modalities, even…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Yanbei Chen , Yongqin Xian , A. Sophia Koepke , Ying Shan , Zeynep Akata

Towards improving the performance in various music information processing tasks, recent studies exploit different modalities able to capture diverse aspects of music. Such modalities include audio recordings, symbolic music scores,…

Multimedia · Computer Science 2019-02-15 Federico Simonetta , Stavros Ntalampiras , Federico Avanzini

In this paper our objectives are, first, networks that can embed audio and visual inputs into a common space that is suitable for cross-modal retrieval; and second, a network that can localize the object that sounds in an image, given the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Relja Arandjelović , Andrew Zisserman