English
Related papers

Related papers: Towards Deep Modeling of Music Semantics using EEG…

200 papers

We propose a deep learning approach to predicting audio event onsets in electroencephalogram (EEG) recorded from users as they listen to music. We use a publicly available dataset containing ten contemporary songs and concurrently recorded…

Signal Processing · Electrical Eng. & Systems 2021-02-15 Ashvala Vinay , Alexander Lerch , Grace Leslie

Data Visualization has been receiving growing attention recently, with ubiquitous smart devices designed to render information in a variety of ways. However, while evaluations of visual tools for their interpretability and intuitiveness…

Human-Computer Interaction · Computer Science 2018-08-21 Maneesh Bilalpur , Mohan Kankanhalli , Stefan Winkler , Ramanathan Subramanian

Understanding the neural mechanisms behind auditory and linguistic processing is key to advancing cognitive neuroscience. In this study, we use Magnetoencephalography (MEG) data to analyze brain responses to spoken language stimuli. We…

Neurons and Cognition · Quantitative Biology 2025-01-08 Matteo Ciferri , Matteo Ferrante , Nicola Toschi

Sound modelling is the process of developing algorithms that generate sound under parametric control. There are a few distinct approaches that have been developed historically including modelling the physics of sound production and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-26 M. Huzaifah , L. Wyse

Supervised learning methods can solve the given problem in the presence of a large set of labeled data. However, the acquisition of a dataset covering all the target classes typically requires manual labeling which is expensive and…

Sound · Computer Science 2022-06-13 Duygu Dogan , Huang Xie , Toni Heittola , Tuomas Virtanen

Decoding neurophysiological signals into language is of great research interest within brain-computer interface (BCI) applications. Electroencephalography (EEG), known for its non-invasiveness, ease of use, and cost-effectiveness, has been…

Quantitative Methods · Quantitative Biology 2024-09-26 Yitian Tao , Yan Liang , Luoyu Wang , Yongqing Li , Qing Yang , Han Zhang

Many applications of cross-modal music retrieval are related to connecting sheet music images to audio recordings. A typical and recent approach to this is to learn, via deep neural networks, a joint embedding space that correlates short…

Sound · Computer Science 2023-09-22 Luis Carvalho , Gerhard Widmer

In the age of music streaming platforms, the task of automatically tagging music audio has garnered significant attention, driving researchers to devise methods aimed at enhancing performance metrics on standard datasets. Most recent…

Sound · Computer Science 2024-02-26 Vassilis Lyberatos , Spyridon Kantarelis , Edmund Dervakos , Giorgos Stamou

In natural language processing (NLP), the semantic similarity task requires large-scale, high-quality human-annotated labels for fine-tuning or evaluation. By contrast, in cases of music similarity, such labels are expensive to collect and…

Sound · Computer Science 2021-09-10 Xinran Zhang , Maosong Sun , Jiafeng Liu , Xiaobing Li

Music auto-tagging is essential for organizing and discovering music in extensive digital libraries. While foundation models achieve exceptional performance in this domain, their outputs often lack interpretability, limiting trust and…

Machine Learning · Computer Science 2026-05-28 Andreas Patakis , Vassilis Lyberatos , Spyridon Kantarelis , Edmund Dervakos , Giorgos Stamou

We present a novel deep neural architecture for learning electroencephalogram (EEG). To learn the spatial information, our model first obtains the Riemannian mean and distance from spatial covariance matrices (SCMs) on a Riemannian…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Guangyi Zhang , Ali Etemad

Deep learning has emerged as the preferred modeling approach for automatic ECG analysis. In this study, we investigate three elements aimed at improving the quantitative accuracy of such systems. These components consistently enhance…

Signal Processing · Electrical Eng. & Systems 2023-08-30 Temesgen Mehari , Nils Strodthoff

The human brain receives stimuli in multiple ways; among them, audio constitutes an important source of relevant stimuli for the brain regarding communication, amusement, warning, etc. In this context, the aim of this manuscript is to…

Signal Processing · Electrical Eng. & Systems 2024-11-21 Isaac Ariza , Ana M. Barbancho , Lorenzo J. Tardon , Isabel Barbancho

Objective. When a person listens to continuous speech, a corresponding response is elicited in the brain and can be recorded using electroencephalography (EEG). Linear models are presently used to relate the EEG recording to the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-19 Corentin Puffay , Bernd Accou , Lies Bollens , Mohammad Jalilpour Monesi , Jonas Vanthornhout , Hugo Van hamme , Tom Francart

EEG and audio are inherently distinct modalities, differing in sampling rate, channel structure, and scale. Yet, we show that pretrained neural audio codecs can serve as effective starting points for EEG compression, provided that the data…

Machine Learning · Computer Science 2025-12-01 Ard Kastrati , Luca Lanzendörfer , Riccardo Rigoni , John Staib Matilla , Roger Wattenhofer

When we hear the word "house", we don't just process sound, we imagine walls, doors, memories. The brain builds meaning through layers, moving from raw acoustics to rich, multimodal associations. Inspired by this, we build on recent work…

Machine Learning · Computer Science 2025-11-11 Kateryna Shapovalenko , Quentin Auster

Deep learning approaches have recently achieved impressive performance on both audio source separation and sound classification. Most audio source separation approaches focus only on separating sources belonging to a restricted domain of…

Sound · Computer Science 2021-05-14 Efthymios Tzinis , Scott Wisdom , John R. Hershey , Aren Jansen , Daniel P. W. Ellis

Two techniques are proposed to alleviate the computational burden of MUltiple SIgnal Classification (MUSIC) algorithm applied to Electroencephalogram (EEG) source localization. A significant reduction was achieved by parsing the cortex…

Neurons and Cognition · Quantitative Biology 2017-07-27 Seyede Mahya Safavi , Beth Lopour , Pai H. Chou

In the context of music information retrieval, similarity-based approaches are useful for a variety of tasks that benefit from a query-by-example scenario. Music however, naturally decomposes into a set of semantically meaningful factors of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-03 Sebastian Ribecky , Jakob Abeßer , Hanna Lukashevich

Music structure segmentation is a key task in audio analysis, but existing models perform poorly on Electronic Dance Music (EDM). This problem exists because most approaches rely on lyrical or harmonic similarity, which works well for pop…

Sound · Computer Science 2026-03-11 Sahal Sajeer , Krish Patel , Oscar Chung , Joel Song Bae