English
Related papers

Related papers: Learning Audio - Sheet Music Correspondences for S…

200 papers

Generating music medleys is about finding an optimal permutation of a given set of music clips. Toward this goal, we propose a self-supervised learning task, called the music puzzle game, to train neural network models to learn the…

Machine Learning · Statistics 2017-11-20 Yu-Siang Huang , Szu-Yu Chou , Yi-Hsuan Yang

Music Inpainting is the task of filling in missing or lost information in a piece of music. We investigate this task from an interactive music creation perspective. To this end, a novel deep learning-based approach for musical score…

Machine Learning · Computer Science 2020-04-14 Ashis Pati , Alexander Lerch , Gaëtan Hadjeres

This article investigates a cross-modal retrieval problem in which a user would like to retrieve a passage of music from a MIDI file by taking a cell phone picture of several lines of sheet music. This problem is challenging for two…

Multimedia · Computer Science 2020-04-27 TJ Tsai , Daniel Yang , Mengyi Shan , Thitaree Tanprasert , Teerapat Jenrungrot

We have seen remarkable success in representation learning and language models (LMs) using deep neural networks. Many studies aim to build the underlying connections among different modalities via the alignment and mappings at the token or…

Sound · Computer Science 2025-03-04 Daniel Chin , Gus Xia

Music classification has been one of the most popular tasks in the field of music information retrieval. With the development of deep learning models, the last decade has seen impressive improvements in a wide range of classification tasks.…

Sound · Computer Science 2023-07-03 Yiwei Ding , Alexander Lerch

Music prediction tasks range from predicting tags given a song or clip of audio, predicting the name of the artist, or predicting related songs given a song, clip, artist name or tag. That is, we are interested in every semantic…

Machine Learning · Computer Science 2015-03-19 Jason Weston , Samy Bengio , Philippe Hamel

The assessment of music performances in most cases takes into account the underlying musical score being performed. While there have been several automatic approaches for objective music performance assessment (MPA) based on extracted…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Jiawen Huang , Yun-Ning Hung , Ashis Pati , Siddharth Kumar Gururani , Alexander Lerch

Estimating the performance difficulty of a musical score is crucial in music education for adequately designing the learning curriculum of the students. Although the Music Information Retrieval community has recently shown interest in this…

Sound · Computer Science 2023-09-29 Pedro Ramoneda , Jose J. Valero-Mas , Dasaem Jeong , Xavier Serra

The present methodology is aimed at cross-modal machine learning and uses multidisciplinary tools and methods drawn from a broad range of areas and disciplines, including music, systematic musicology, dance, motion capture, human-computer…

Human-Computer Interaction · Computer Science 2017-12-04 Fabio Paolizzo

This paper explores a specific sub-task of cross-modal music retrieval. We consider the delicate task of retrieving a performance or rendition of a musical piece based on a description of its style, expressive character, or emotion from a…

Sound · Computer Science 2024-01-29 Shreyan Chowdhury , Gerhard Widmer

Music similarity is an essential aspect of music retrieval, recommendation systems, and music analysis. Moreover, similarity is of vital interest for music experts, as it allows studying analogies and influences among composers and…

Sound · Computer Science 2023-06-22 Andrea Poltronieri

While both the data volume and heterogeneity of the digital music content is huge, it has become increasingly important and convenient to build a recommendation or search system to facilitate surfacing these content to the user or consumer…

In this work, we study music/video cross-modal recommendation, i.e. recommending a music track for a video or vice versa. We rely on a self-supervised learning paradigm to learn from a large amount of unlabelled data. We rely on a…

Multimedia · Computer Science 2021-05-03 Laure Pretet , Gael Richard , Geoffroy Peeters

Up to now, only limited research has been conducted on cross-modal retrieval of suitable music for a specified video or vice versa. Moreover, much of the existing research relies on metadata such as keywords, tags, or associated description…

Computer Vision and Pattern Recognition · Computer Science 2017-09-04 Sungeun Hong , Woobin Im , Hyun S. Yang

This paper investigates a cross-modal retrieval problem in which a user would like to retrieve a passage of music from a MIDI file by taking a cell phone picture of a physical page of sheet music. While audio-sheet music retrieval has been…

Multimedia · Computer Science 2020-04-23 Daniel Yang , Thitaree Tanprasert , Teerapat Jenrungrot , Mengyi Shan , TJ Tsai

We study cross-modal recommendation of music tracks to be used as soundtracks for videos. This problem is known as the music supervision task. We build on a self-supervised system that learns a content association between music and video.…

Multimedia · Computer Science 2023-06-13 Laure Prétet , Gaël Richard , Clément Souchier , Geoffroy Peeters

Music genre classification has been widely studied in past few years for its various applications in music information retrieval. Previous works tend to perform unsatisfactorily, since those methods only use audio content or jointly use…

Sound · Computer Science 2023-06-13 Ganghui Ru , Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

This paper introduces a new large-scale music dataset, MusicNet, to serve as a source of supervision and evaluation of machine learning methods for music research. MusicNet consists of hundreds of freely-licensed classical music recordings…

Machine Learning · Statistics 2017-04-07 John Thickstun , Zaid Harchaoui , Sham Kakade

In this paper, we propose to infer music genre embeddings from audio datasets carrying semantic information about genres. We show that such embeddings can be used for disambiguating genre tags (identification of different labels for the…

Information Retrieval · Computer Science 2018-09-20 Romain Hennequin , Jimena Royo-Letelier , Manuel Moussallam

Finding sound effects or environmental sounds that match a creator's intended impression remains a largely manual process in multimedia production. This is especially relevant for comics and other visual media, where visually stylized…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-19 Keisuke Imoto , Yamato Kojima , Takao Tsuchiya