English
Related papers

Related papers: Multi-Modal Chorus Recognition for Improving Song …

200 papers

This work present a music dataset named MusicTM-Dataset, which is utilized in improving the representation learning ability of different types of cross-modal retrieval (CMR). Little large music dataset including three modalities is…

Sound · Computer Science 2021-05-10 Donghuo Zeng , Yi Yu , Keizo Oyama

Music exists in various modalities, such as score images, symbolic scores, MIDI, and audio. Translations between each modality are established as core tasks of music information retrieval, such as automatic music transcription…

Sound · Computer Science 2026-04-08 Jongmin Jung , Dongmin Kim , Sihun Lee , Seola Cho , Hyungjoon Soh , Irmak Bukey , Chris Donahue , Dasaem Jeong

Modeling various aspects that make a music piece unique is a challenging task, requiring the combination of multiple sources of information. Deep learning is commonly used to obtain representations using various sources of information, such…

Sound · Computer Science 2021-04-05 Andres Ferraro , Xavier Favory , Konstantinos Drossos , Yuntae Kim , Dmitry Bogdanov

Multimodal learning has driven innovation across various industries, particularly in the field of music. By enabling more intuitive interaction experiences and enhancing immersion, it not only lowers the entry barriers to the music but also…

Multimedia · Computer Science 2026-02-24 Sifei Li , Mining Tan , Feier Shen , Minyan Luo , Zijiao Yin , Fan Tang , Weiming Dong , Changsheng Xu

This paper explores a new natural language processing task, review-driven multi-label music style classification. This task requires the system to identify multiple styles of music based on its reviews on websites. The biggest challenge…

Computation and Language · Computer Science 2018-08-24 Guangxiang Zhao , Jingjing Xu , Qi Zeng , Xuancheng Ren

Music prediction tasks range from predicting tags given a song or clip of audio, predicting the name of the artist, or predicting related songs given a song, clip, artist name or tag. That is, we are interested in every semantic…

Machine Learning · Computer Science 2015-03-19 Jason Weston , Samy Bengio , Philippe Hamel

Multi-modal music generation, using multiple modalities like text, images, and video alongside musical scores and audio as guidance, is an emerging research area with broad applications. This paper reviews this field, categorizing music…

Sound · Computer Science 2026-03-09 Shuyu Li , Shulei Ji , Zihao Wang , Songruoyao Wu , Jiaxing Yu , Kejun Zhang

We propose MoodNet - A Deep Convolutional Neural Network based architecture to effectively predict the emotion associated with a piece of music given its audio and lyrical content.We evaluate different architectures consisting of varying…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-15 Aniruddha Bhattacharya , K. V. Kadambari

Audio-based cover song detection has received much attention in the MIR community in the recent years. To date, the most popular formulation of the problem has been to compare the audio signals of two tracks and to make a binary decision…

Sound · Computer Science 2019-05-29 Marc Sarfati , Anthony Hu , Jonathan Donier

The aim of this study is to teach an algorithm how to recognize different types of music. Users will submit songs for analysis. Since the algorithm hasn't heard these songs before, it needs to figure out what makes each song unique. It does…

Sound · Computer Science 2024-05-28 Navin Kamuni , Dheerendra Panwar

Up to now, only limited research has been conducted on cross-modal retrieval of suitable music for a specified video or vice versa. Moreover, much of the existing research relies on metadata such as keywords, tags, or associated description…

Computer Vision and Pattern Recognition · Computer Science 2017-09-04 Sungeun Hong , Woobin Im , Hyun S. Yang

Cover song detection is a very relevant task in Music Information Retrieval (MIR) studies and has been mainly addressed using audio-based systems. Despite its potential impact in industrial contexts, low performances and lack of scalability…

Information Retrieval · Computer Science 2018-08-31 Albin Andrew Correya , Romain Hennequin , Mickaël Arcos

Music retrieval and recommendation applications often rely on content features encoded as embeddings, which provide vector representations of items in a music dataset. Numerous complementary embeddings can be derived from processing items…

Information Retrieval · Computer Science 2023-08-15 Andres Ferraro , Jaehun Kim , Sergio Oramas , Andreas Ehmann , Fabien Gouyon

Lyrics transcription of polyphonic music is challenging because singing vocals are corrupted by the background music. To improve the robustness of lyrics transcription to the background music, we propose a strategy of combining the features…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-25 Xiaoxue Gao , Chitralekha Gupta , Haizhou Li

A main challenge in applying deep learning to music processing is the availability of training data. One potential solution is Multi-task Learning, in which the model also learns to solve related auxiliary tasks on additional datasets to…

Sound · Computer Science 2018-04-06 Daniel Stoller , Sebastian Ewert , Simon Dixon

We present a new approach to evaluate chord recognition systems on songs which do not have full annotations. The principle is to use online chord databases to generate high accurate "pseudo annotations" for these songs and compute "pseudo…

Information Retrieval · Computer Science 2011-09-05 Yizhao Ni , Matt Mcvicar , Raul Santos-Rodriguez , Tijl De Bie

In recent years, there has been a notable increase in research on machine learning models for music retrieval and generation systems that are capable of taking natural language sentences as inputs. However, there is a scarcity of…

Computation and Language · Computer Science 2025-01-07 Takashi Harada , Takehiro Motomitsu , Katsuhiko Hayashi , Yusuke Sakai , Hidetaka Kamigaito

Many applications of cross-modal music retrieval are related to connecting sheet music images to audio recordings. A typical and recent approach to this is to learn, via deep neural networks, a joint embedding space that correlates short…

Sound · Computer Science 2023-09-22 Luis Carvalho , Gerhard Widmer

Music Information Retrieval (MIR) is a collaborative scientific study that help to build innovative information research themes, novel frameworks, and developing connected delivery mechanisms in addition to making the world's massive…

Sound · Computer Science 2021-09-09 Shah Riya Chiragkumar

When songs are composed or performed, there is often an intent by the singer/songwriter of expressing feelings or emotions through it. For humans, matching the emotiveness in a musical composition or performance with the subjective…