English
Related papers

Related papers: Towards Deep Modeling of Music Semantics using EEG…

200 papers

Music comprises of a set of complex simultaneous events organized in time. In this paper we introduce a novel framework that we call Deep Musical Information Dynamics, which combines two parallel streams - a low rate latent representation…

Sound · Computer Science 2021-02-03 Shlomo Dubnov

Deep learning is widely used to decode the electroencephalogram (EEG) signal. However, there are few attempts to specifically investigate how to explain the EEG-based deep learning models. We conduct a review to summarize the existing works…

Machine Learning · Computer Science 2022-05-31 Hanqi Wang , Xiaoguang Zhu , Tao Chen , Chengfang Li , Liang Song

Feature learning and deep learning have drawn great attention in recent years as a way of transforming input data into more effective representations using learning algorithms. Such interest has grown in the area of music information…

Machine Learning · Computer Science 2016-10-18 Juhan Nam , Jorge Herrera , Kyogu Lee

Pronounced as "musician", the musicnn library contains a set of pre-trained musically motivated convolutional neural networks for music audio tagging: https://github.com/jordipons/musicnn. This repository also includes some pre-trained…

Sound · Computer Science 2019-09-17 Jordi Pons , Xavier Serra

We studied the ability of deep neural networks (DNNs) to restore missing audio content based on its context, a process usually referred to as audio inpainting. We focused on gaps in the range of tens of milliseconds. The proposed DNN…

Sound · Computer Science 2022-02-21 Andrés Marafioti , Nicki Holighaus , Piotr Majdak , Nathanaël Perraudin

Electroencephalogram (EEG) signals generally exhibit low signal-to-noise ratio (SNR) and high inter-subject variability, making generalization across subjects and domains challenging. Recent advances in deep learning, particularly…

Machine Learning · Computer Science 2026-04-08 Jiazhen Hong , Geoffrey Mackellar , Soheila Ghane

Given the recent surge in developments of deep learning, this article provides a review of the state-of-the-art deep learning techniques for audio signal processing. Speech, music, and environmental sound processing are considered…

Sound · Computer Science 2019-05-28 Hendrik Purwins , Bo Li , Tuomas Virtanen , Jan Schlüter , Shuo-yiin Chang , Tara Sainath

Neural models have become ubiquitous in automatic speech recognition systems. While neural networks are typically used as acoustic models in more complex systems, recent studies have explored end-to-end speech recognition systems based on…

Computation and Language · Computer Science 2017-09-15 Yonatan Belinkov , James Glass

Electroencephalography (EEG) is an objective tool for emotion recognition and shows promising performance. However, the label scarcity problem is a main challenge in this field, which limits the wide application of EEG-based emotion…

Signal Processing · Electrical Eng. & Systems 2024-09-02 Rushuang Zhou , Weishan Ye , Zhiguo Zhang , Yanyang Luo , Li Zhang , Linling Li , Gan Huang , Yining Dong , Yuan-Ting Zhang , Zhen Liang

In this paper, we propose a new paradigm to learn audio features for Music Structure Analysis (MSA). We train a deep encoder to learn features such that the Self-Similarity-Matrix (SSM) resulting from those approximates a ground-truth SSM.…

Sound · Computer Science 2022-11-16 Geoffroy Peeters , Florian Angulo

Long-sequence electroencephalogram (EEG) modeling is essential for developing generalizable EEG representation models. This need arises from the high sampling rate of EEG data and the long recording durations required to capture extended…

Machine Learning · Computer Science 2025-11-25 Jiazhen Hong , Geoffrey Mackellar , Soheila Ghane

While previous studies on image segmentation focus on handling severe (or explicit) label noise, real-world datasets also exhibit subtle (or implicit) label imperfections. These arise from inherent challenges, such as ambiguous object…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Yechan Kim , Dongho Yoon , Younkwan Lee , Unse Fatima , Hong Kook Kim , Songjae Lee , Sanga Park , Jeong Ho Park , Seonjong Kang , Moongu Jeon

We propose a framework to learn semantics from raw audio signals using two types of representations, encoding contextual and phonetic information respectively. Specifically, we introduce a speech-to-unit processing pipeline that captures…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-05 Jaeyeon Kim , Injune Hwang , Kyogu Lee

In this paper, we explore the unsupervised learning of a semantic embedding space for co-occurring sensory inputs. Specifically, we focus on the task of learning a semantic vector space for both spoken and handwritten digits using the…

Machine Learning · Computer Science 2017-12-12 Kenneth Leidal , David Harwath , James Glass

Domain Generalized Semantic Segmentation (DGSS) seeks to utilize source domain data exclusively to enhance the generalization of semantic segmentation across unknown target domains. Prevailing studies predominantly concentrate on feature…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Hongwei Niu , Linhuang Xie , Jianghang Lin , Shengchuan Zhang

Music similarity search is useful for a variety of creative tasks such as replacing one music recording with another recording with a similar "feel", a common task in video editing. For this task, it is typically necessary to define a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Jongpil Lee , Nicholas J. Bryan , Justin Salamon , Zeyu Jin , Juhan Nam

We propose the Neuralogram -- a deep neural network based representation for understanding audio signals which, as the name suggests, transforms an audio signal to a dense, compact representation based upon embeddings learned via a neural…

Sound · Computer Science 2019-04-11 Prateek Verma , Chris Chafe , Jonathan Berger

We present PECMAE, an interpretable model for music audio classification based on prototype learning. Our model is based on a previous method, APNet, which jointly learns an autoencoder and a prototypical network. Instead, we propose to…

Electronic Health Records have become popular sources of data for secondary research, but their use is hampered by the amount of effort it takes to overcome the sparsity, irregularity, and noise that they contain. Modern learning…

Applications · Statistics 2025-02-28 Jacek M. Bajor , Diego A. Mesa , Travis J. Osterman , Thomas A. Lasko

In audio processing applications, the generation of expressive sounds based on high-level representations demonstrates a high demand. These representations can be used to manipulate the timbre and influence the synthesis of creative…

Sound · Computer Science 2023-01-19 Anastasia Natsiou , Luca Longo , Sean O'Leary