English
Related papers

Related papers: Semantic-Aware Interpretable Multimodal Music Auto…

200 papers

Feature learning and deep learning have drawn great attention in recent years as a way of transforming input data into more effective representations using learning algorithms. Such interest has grown in the area of music information…

Machine Learning · Computer Science 2016-10-18 Juhan Nam , Jorge Herrera , Kyogu Lee

Recently, we proposed a self-attention based music tagging model. Different from most of the conventional deep architectures in music information retrieval, which use stacked 3x3 filters by treating music spectrograms as images, the…

Sound · Computer Science 2019-11-12 Minz Won , Sanghyuk Chun , Xavier Serra

Combining multiple audio features can improve the performance of music tagging, but common deep learning-based feature fusion methods often lack interpretability. To address this problem, we propose a Genetic Programming (GP) pipeline that…

Music autotagging, an established problem in Music Information Retrieval, aims to alleviate the human cost required to manually annotate collections of recorded music with textual labels by automating the process. Many autotagging systems…

Information Retrieval · Computer Science 2014-10-02 Fabien Gouyon , Bob L. Sturm , Joao Lobato Oliveira , Nuno Hespanhol , Thibault Langlois

Music information retrieval faces a challenge in modeling contextualized musical concepts formulated by a set of co-occurring tags. In this paper, we investigate the suitability of our recently proposed approach based on a Siamese neural…

Machine Learning · Computer Science 2016-06-08 Ubai Sandouk , Ke Chen

Music generated by deep learning methods often suffers from a lack of coherence and long-term organization. Yet, multi-scale hierarchical structure is a distinctive feature of music signals. To leverage this information, we propose a…

Sound · Computer Science 2024-02-29 Manvi Agarwal , Changhong Wang , Gaël Richard

Interpretation of retrieved results is an important issue in music recommender systems, particularly from a user perspective. In this study, we investigate the methods for providing interpretability of content features using self-attention.…

Information Retrieval · Computer Science 2018-09-05 Seungjin Lee , Juheon Lee , Kyogu lee

Towards improving the performance in various music information processing tasks, recent studies exploit different modalities able to capture diverse aspects of music. Such modalities include audio recordings, symbolic music scores,…

Multimedia · Computer Science 2019-02-15 Federico Simonetta , Stavros Ntalampiras , Federico Avanzini

Machine-generated music (MGM) has become a groundbreaking innovation with wide-ranging applications, such as music therapy, personalised editing, and creative inspiration within the music industry. However, the unregulated proliferation of…

Sound · Computer Science 2026-04-30 Yupei Li , Qiyang Sun , Hanqian Li , Lucia Specia , Björn W. Schuller

Word embedding has become an essential means for text-based information retrieval. Typically, word embeddings are learned from large quantities of general and unstructured text data. However, in the domain of music, the word embedding may…

Sound · Computer Science 2024-04-24 SeungHeon Doh , Jongpil Lee , Dasaem Jeong , Juhan Nam

Music auto-tagging is crucial for enhancing music discovery and recommendation. Existing models in Music Information Retrieval (MIR) struggle with real-world noise such as environmental and speech sounds in multimedia content. This study…

Sound · Computer Science 2024-01-30 Haesun Joung , Kyogu Lee

In this paper, we introduce a novel interpreting framework that learns an interpretable model based on an ontology-based sampling technique to explain agnostic prediction models. Different from existing approaches, our algorithm considers…

Machine Learning · Computer Science 2020-04-02 Phung Lai , NhatHai Phan , Han Hu , Anuja Badeti , David Newman , Dejing Dou

We propose music tagging with classifier chains that model the interplay of music tags. Most conventional methods estimate multiple tags independently by treating them as multiple independent binary classification problems. This treatment…

Sound · Computer Science 2025-01-20 Takuya Hasumi , Tatsuya Komatsu , Yusuke Fujita

As music has become more available especially on music streaming platforms, people have started to have distinct preferences to fit to their varying listening situations, also known as context. Hence, there has been a growing interest in…

Sound · Computer Science 2022-11-15 Karim M. Ibrahim , Elena V. Epure , Geoffroy Peeters , Gaël Richard

Interpretability allows the domain-expert to directly evaluate the model's relevance and reliability, a practice that offers assurance and builds trust. In the healthcare setting, interpretable models should implicate relevant biological…

Machine Learning · Computer Science 2020-06-18 Thomas P. Quinn , Dang Nguyen , Santu Rana , Sunil Gupta , Svetha Venkatesh

This paper presents a novel approach to music representation learning. Triplet loss based networks have become popular for representation learning in various multimedia retrieval domains. Yet, one of the most crucial parts of this approach…

Multimedia · Computer Science 2019-09-18 Alexander Schindler , Peter Knees

Music listening preferences at a given time depend on a wide range of contextual factors, such as user emotional state, location and activity at listening time, the day of the week, the time of the day, etc. It is therefore of great…

Music has a unique and complex structure which is challenging for both expert humans and existing AI systems to understand, and presents unique challenges relative to other forms of audio. We present LLark, an instruction-tuned multimodal…

Sound · Computer Science 2024-06-04 Josh Gardner , Simon Durand , Daniel Stoller , Rachel M. Bittner

Clustering is a fundamental learning task widely used as a first step in data analysis. For example, biologists use cluster assignments to analyze genome sequences, medical records, or images. Since downstream analysis is typically…

Machine Learning · Computer Science 2024-06-11 Jonathan Svirsky , Ofir Lindenbaum

Multimodal sentiment analysis is an important area for understanding the user's internal states. Deep learning methods were effective, but the problem of poor interpretability has gradually gained attention. Previous works have attempted to…

Computation and Language · Computer Science 2023-05-15 Sixia Li , Shogo Okada