English
Related papers

Related papers: Controllable Embedding Transformation for Mood-Gui…

200 papers

Audio-text retrieval enables semantic alignment between audio content and natural language queries, supporting applications in multimedia search, accessibility, and surveillance. However, current state-of-the-art approaches struggle with…

Computation and Language · Computer Science 2026-04-28 Meizhu Liu , Matthew Rowe , Amit Agarwal , Michael Avendi , Yassi Abbasi , Hitesh Laxmichand Patel , Paul Li , Kyu J. Han , Tao Sheng , Sujith Ravi , Dan Roth

Two modest-sized symbolic corpora of post-tonal and post-metric keyboard music have been constructed, one algorithmic, the other improvised. Deep learning models of each have been trained and largely optimised. Our purpose is to obtain a…

Sound · Computer Science 2017-12-22 Roger T. Dean , Jamie Forth

The subjective quality of natural signals can be approximated with objective perceptual metrics. Designed to approximate the perceptual behaviour of human observers, perceptual metrics often reflect structures found in natural signals and…

Sound · Computer Science 2024-09-26 Tashi Namgyal , Alexander Hepburn , Raul Santos-Rodriguez , Valero Laparra , Jesus Malo

Music auto-tagging is essential for organizing and discovering music in extensive digital libraries. While foundation models achieve exceptional performance in this domain, their outputs often lack interpretability, limiting trust and…

Machine Learning · Computer Science 2026-05-28 Andreas Patakis , Vassilis Lyberatos , Spyridon Kantarelis , Edmund Dervakos , Giorgos Stamou

High-level musical qualities (such as emotion) are often abstract, subjective, and hard to quantify. Given these difficulties, it is not easy to learn good feature representations with supervised learning techniques, either because of the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-31 Hao Hao Tan , Dorien Herremans

More music foundation models are recently being released, promising a general, mostly task independent encoding of musical information. Common ways of adapting music foundation models to downstream tasks are probing and fine-tuning. These…

Sound · Computer Science 2024-12-02 Yiwei Ding , Alexander Lerch

Conventional word embeddings represent words with fixed vectors, which are usually trained based on co-occurrence patterns among words. In doing so, however, the power of such representations is limited, where the same word might be…

Computation and Language · Computer Science 2020-01-10 Hongming Zhang , Jiaxin Bai , Yan Song , Kun Xu , Changlong Yu , Yangqiu Song , Wilfred Ng , Dong Yu

One of the challenging problems in Music Information Retrieval is the acquisition of enough non-copyrighted audio recordings for model training and evaluation. This study compares two Transformer-based neural network models for chord…

Sound · Computer Science 2025-08-11 Martyna Majchrzak , Jacek Mańdziuk

The Song Generation task aims to synthesize music composed of vocals and accompaniment from given lyrics. While the existing method, Jukebox, has explored this task, its constrained control over the generations often leads to deficiency in…

Sound · Computer Science 2024-09-11 Shuochen Gao , Shun Lei , Fan Zhuo , Hangyu Liu , Feng Liu , Boshi Tang , Qiaochu Huang , Shiyin Kang , Zhiyong Wu

The increasing amount of online videos brings several opportunities for training self-supervised neural networks. The creation of large scale datasets of videos such as the YouTube-8M allows us to deal with this large amount of data in…

Information Retrieval · Computer Science 2018-01-09 Didac Surís , Amanda Duarte , Amaia Salvador , Jordi Torres , Xavier Giró-i-Nieto

Melody extraction is a vital music information retrieval task among music researchers for its potential applications in education pedagogy and the music industry. Melody extraction is a notoriously challenging task due to the presence of…

Sound · Computer Science 2022-02-03 Gurunath Reddy M , K. Sreenivasa Rao , Partha Pratim Das

Deep representation learning offers a powerful paradigm for mapping input data onto an organized embedding space and is useful for many music information retrieval tasks. Two central methods for representation learning include deep metric…

Sound · Computer Science 2020-08-14 Jongpil Lee , Nicholas J. Bryan , Justin Salamon , Zeyu Jin , Juhan Nam

Music semantics is embodied, in the sense that meaning is biologically mediated by and grounded in the human body and brain. This embodied cognition perspective also explains why music structures modulate kinetic and somatosensory…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Francisco Afonso Raposo , David Martins de Matos , Ricardo Ribeiro

Melodic similarity measurement is of key importance in music information retrieval. In this paper, we use geometric matching techniques to measure the similarity between two melodies. We represent music as sets of points or sets of…

In this work, we study the association between song lyrics and mood through a data-driven analysis. Our data set consists of nearly one million songs, with song-mood associations derived from user playlists on the Spotify streaming…

Multimedia · Computer Science 2022-07-13 Shahrzad Naseri , Sravana Reddy , Joana Correia , Jussi Karlgren , Rosie Jones

Automated music playlist generation is a specific form of music recommendation. Generally stated, the user receives a set of song suggestions defining a coherent listening session. We hypothesize that the best way to convey such playlist…

Information Retrieval · Computer Science 2017-09-08 Andreu Vall , Hamid Eghbal-zadeh , Matthias Dorfer , Markus Schedl , Gerhard Widmer

In deep learning research, many melody extraction models rely on redesigning neural network architectures to improve performance. In this paper, we propose an input feature modification and a training objective modification based on two…

Sound · Computer Science 2023-08-08 Keren Shao , Ke Chen , Taylor Berg-Kirkpatrick , Shlomo Dubnov

Most work on musical score models (a.k.a. musical language models) for music transcription has focused on describing the local sequential dependence of notes in musical scores and failed to capture their global repetitive structure, which…

Sound · Computer Science 2021-02-17 Eita Nakamura , Kazuyoshi Yoshii

We have seen remarkable success in representation learning and language models (LMs) using deep neural networks. Many studies aim to build the underlying connections among different modalities via the alignment and mappings at the token or…

Sound · Computer Science 2025-03-04 Daniel Chin , Gus Xia

Inspired by the success of deploying deep learning in the fields of Computer Vision and Natural Language Processing, this learning paradigm has also found its way into the field of Music Information Retrieval. In order to benefit from deep…

Neural and Evolutionary Computing · Computer Science 2019-02-13 Jaehun Kim , Julián Urbano , Cynthia C. S. Liem , Alan Hanjalic