English
Related papers

Related papers: Pre-Training Strategies Using Contrastive Learning…

200 papers

Modeling various aspects that make a music piece unique is a challenging task, requiring the combination of multiple sources of information. Deep learning is commonly used to obtain representations using various sources of information, such…

Sound · Computer Science 2021-04-05 Andres Ferraro , Xavier Favory , Konstantinos Drossos , Yuntae Kim , Dmitry Bogdanov

Contrastive learning constitutes an emerging branch of self-supervised learning that leverages large amounts of unlabeled data, by learning a latent space, where pairs of different views of the same sample are associated. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-12 Christos Garoufis , Athanasia Zlatintsi , Petros Maragos

Methods based on supervised learning using annotations in an end-to-end fashion have been the state-of-the-art for classification problems. However, they may be limited in their generalization capability, especially in the low data regime.…

Sound · Computer Science 2023-08-14 Ilyass Moummad , Nicolas Farrugia

Contrastive learning is a powerful way of learning multimodal representations across various domains such as image-caption retrieval and audio-visual representation learning. In this work, we investigate if these findings generalize to the…

Information Retrieval · Computer Science 2023-09-04 Karel Veldkamp , Mariya Hendriksen , Zoltán Szlávik , Alexander Keijser

Ambiguities in data and problem constraints can lead to diverse, equally plausible outcomes for a machine learning task. In beat and downbeat tracking, for instance, different listeners may adopt various rhythmic interpretations, none of…

Sound · Computer Science 2025-10-30 Antonin Gagnere , Slim Essid , Geoffroy Peeters

Content creators often use music to enhance their videos, from soundtracks in movies to background music in video blogs and social media content. However, identifying the best music for a video can be a difficult and time-consuming task. To…

Multimedia · Computer Science 2024-12-24 Shanti Stewart , Gouthaman KV , Lie Lu , Andrea Fanelli

Linking sheet music images to audio recordings remains a key problem for the development of efficient cross-modal music retrieval systems. One of the fundamental approaches toward this task is to learn a cross-modal embedding space via deep…

Sound · Computer Science 2023-09-22 Luis Carvalho , Tobias Washüttl , Gerhard Widmer

Self-supervised learning has emerged as a powerful way to pre-train generalizable machine learning models on large amounts of unlabeled data. It is particularly compelling in the music domain, where obtaining labeled data is time-consuming,…

Sound · Computer Science 2024-04-16 Gabriel Meseguer-Brocal , Dorian Desblancs , Romain Hennequin

Several automatic approaches for objective music performance assessment (MPA) have been proposed in the past, however, existing systems are not yet capable of reliably predicting ratings with the same accuracy as professional judges. This…

Sound · Computer Science 2021-08-16 Pavan Seshadri , Alexander Lerch

Music retrieval and recommendation applications often rely on content features encoded as embeddings, which provide vector representations of items in a music dataset. Numerous complementary embeddings can be derived from processing items…

Information Retrieval · Computer Science 2023-08-15 Andres Ferraro , Jaehun Kim , Sergio Oramas , Andreas Ehmann , Fabien Gouyon

Music recommender systems frequently utilize network-based models to capture relationships between music pieces, artists, and users. Although these relationships provide valuable insights for predictions, new music pieces or artists often…

Sound · Computer Science 2024-09-16 Florian Grötschla , Luca Strässle , Luca A. Lanzendörfer , Roger Wattenhofer

Sampling, the technique of reusing pieces of existing audio tracks to create new music content, is a very common practice in modern music production. In this paper, we tackle the challenging task of automatic sample identification, that is,…

Sound · Computer Science 2025-10-28 Alain Riou , Joan Serrà , Yuki Mitsufuji

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Self-supervised representation learning can mitigate the limitations in recognition tasks with few manually labeled data but abundant unlabeled data---a common scenario in sound event research. In this work, we explore unsupervised…

Sound · Computer Science 2020-11-17 Eduardo Fonseca , Diego Ortego , Kevin McGuinness , Noel E. O'Connor , Xavier Serra

Data cleansing is a well studied strategy for cleaning erroneous labels in datasets, which has not yet been widely adopted in Music Information Retrieval. Previously proposed data cleansing models do not consider structured (e.g. time…

Machine Learning · Computer Science 2021-04-28 Gabriel Meseguer-Brocal , Rachel Bittner , Simon Durand , Brian Brost

Mood recognition is an important problem in music informatics and has key applications in music discovery and recommendation. These applications have become even more relevant with the rise of music streaming. Our work investigates the…

Sound · Computer Science 2021-10-12 Rajnish Kumar , Manjeet Dahiya

The common research goal of self-supervised learning is to extract a general representation which an arbitrary downstream task would benefit from. In this work, we investigate music audio representation learned from different contrastive…

Sound · Computer Science 2022-07-12 Jeong Choi , Seongwon Jang , Hyunsouk Cho , Sehee Chung

Visual contrastive learning aims to learn representations by contrasting similar (positive) and dissimilar (negative) pairs of data samples. The design of these pairs significantly impacts representation quality, training efficiency, and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Shasvat Desai , Debasmita Ghose , Deep Chakraborty

Does popular music from the 60s sound different than that of the 90s? Prior study has shown that there would exist some variations of patterns and regularities related to instrumentation changes and growing loudness across multi-decadal…

Sound · Computer Science 2024-07-09 Qiqi He , Xuchen Song , Weituo Hao , Ju-Chiang Wang , Wei-Tsung Lu , Wei Li
‹ Prev 1 2 3 10 Next ›