English
Related papers

Related papers: Deep rank-based transposition-invariant distances …

200 papers

We present an approach for recommending a music track for a given video, and vice versa, based on both their temporal alignment and their correspondence at an artistic level. We propose a self-supervised approach that learns this…

Multimedia · Computer Science 2022-06-16 Didac Suris , Carl Vondrick , Bryan Russell , Justin Salamon

This paper presents the first step in a research project situated within the field of musical agents. The objective is to achieve, through training, the tuning of the desired musical relationship between a live musical input and a real-time…

Sound · Computer Science 2025-10-01 Balthazar Bujard , Jérôme Nika , Fédéric Bevilacqua , Nicolas Obin

Definitive embeddings remain a fundamental challenge of computational musicology for symbolic music in deep learning today. Analogous to natural language, music can be modeled as a sequence of tokens. This motivates the majority of existing…

Sound · Computer Science 2020-10-19 Hongru Liang , Wenqiang Lei , Paul Yaozhu Chan , Zhenglu Yang , Maosong Sun , Tat-Seng Chua

Music is often experienced as a progression of concurrent streams of notes, or voices. The degree to which this happens depends on the position along a voice-leading continuum, ranging from monophonic, to homophonic, to polyphonic, which…

Sound · Computer Science 2020-11-06 Patrick Gray , Razvan Bunescu

Sequence modeling with neural networks has lead to powerful models of symbolic music data. We address the problem of exploiting these models to reach creative musical goals, by combining with human input. To this end we generalise previous…

Artificial Intelligence · Computer Science 2017-10-03 Christian Walder , Dongwoo Kim

Most Machine Learning (ML) methods, from clustering to classification, rely on a distance function to describe relationships between datapoints. For complex datasets it is hard to avoid making some arbitrary choices when defining a distance…

Machine Learning · Statistics 2016-07-04 Gina Gruenhage , Manfred Opper , Simon Barthelme

A model of music needs to have the ability to recall past details and have a clear, coherent understanding of musical structure. Detailed in the paper is a deep reinforcement learning architecture that predicts and generates polyphonic…

Sound · Computer Science 2018-12-05 Nikhil Kotecha

Modeling various aspects that make a music piece unique is a challenging task, requiring the combination of multiple sources of information. Deep learning is commonly used to obtain representations using various sources of information, such…

Sound · Computer Science 2021-04-05 Andres Ferraro , Xavier Favory , Konstantinos Drossos , Yuntae Kim , Dmitry Bogdanov

High-quality datasets for learning-based modelling of polyphonic symbolic music remain less readily-accessible at scale than in other domains, such as language modelling or image classification. Deep learning algorithms show great potential…

Sound · Computer Science 2022-04-04 Omar Peracha

Music-to-dance translation is a brand-new and powerful feature in recent role-playing games. Players can now let their characters dance along with specified music clips and even generate fan-made dance videos. Previous works of this topic…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Yinglin Duan , Tianyang Shi , Zhengxia Zou , Jia Qin , Yifei Zhao , Yi Yuan , Jie Hou , Xiang Wen , Changjie Fan

Many music AI models learn a map between music content and human-defined labels. However, many annotations, such as chords, can be naturally expressed within the music modality itself, e.g., as sequences of symbolic notes. This observation…

Sound · Computer Science 2025-09-30 Junyan Jiang , Daniel Chin , Liwei Lin , Xuanjie Liu , Gus Xia

Symbolic music analysis tasks are often performed by models originally developed for Natural Language Processing, such as Transformers. Such models require the input data to be represented as sequences, which is achieved through a process…

Information Retrieval · Computer Science 2025-01-09 Dinh-Viet-Toan Le , Louis Bigo , Mikaela Keller

Existing symbolic music generation methods usually utilize discriminator to improve the quality of generated music via global perception of music. However, considering the complexity of information in music, such as rhythm and melody, a…

Sound · Computer Science 2024-08-06 Zhedong Zhang , Liang Li , Jiehua Zhang , Zhenghui Hu , Hongkui Wang , Chenggang Yan , Jian Yang , Yuankai Qi

Deep learning models have become a critical tool for analysis and classification of musical data. These models operate either on the audio signal, e.g. waveform or spectrogram, or on a symbolic representation, such as MIDI. In the latter,…

Sound · Computer Science 2024-07-26 Léo Géré , Philippe Rigaux , Nicolas Audebert

Representations in the auditory cortex might be based on mechanisms similar to the visual ventral stream; modules for building invariance to transformations and multiple layers for compositionality and selectivity. In this paper we propose…

Music is a structured and perceptually rich sequence of sounds in time, whose perception is shaped by the interplay of expectation and uncertainty about what comes next. Yet the uncertainty we infer from music depends on how the musical…

Physics and Society · Physics 2026-03-12 Lluc Bono Rosselló , Robert Jankowski , Hugues Bersini , Marián Boguñá , M. Ángeles Serrano

Audio embeddings enable large scale comparisons of the similarity of audio files for applications such as search and recommendation. Due to the subjectivity of audio similarity, it can be desirable to design systems that answer not only…

Inspired by the success of deploying deep learning in the fields of Computer Vision and Natural Language Processing, this learning paradigm has also found its way into the field of Music Information Retrieval. In order to benefit from deep…

Neural and Evolutionary Computing · Computer Science 2019-02-13 Jaehun Kim , Julián Urbano , Cynthia C. S. Liem , Alan Hanjalic

In this paper we propose a deep learning method for performing attributed-based music-to-image translation. The proposed method is applied for synthesizing visual stories according to the sentiment expressed by songs. The generated images…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Nikolaos Passalis , Stavros Doropoulos

Distances are fundamental primitives whose choice significantly impacts the performances of algorithms in machine learning and signal processing. However selecting the most appropriate distance for a given task is an endeavor. Instead of…

Machine Learning · Computer Science 2020-10-01 Frank Nielsen , Richard Nock