English
Related papers

Related papers: EEG2Mel: Reconstructing Sound from Brain Responses…

200 papers

Recent studies demonstrate the use of a two-stage supervised framework to generate images that depict human perception to visual stimuli from EEG, referring to EEG-visual reconstruction. They are, however, unable to reproduce the exact…

Multimedia · Computer Science 2022-08-19 Zesheng Ye , Lina Yao , Yu Zhang , Sylvia Gustin

Electroencephalography (EEG) serves as an effective diagnostic tool for mental disorders and neurological abnormalities. Enhanced analysis and classification of EEG signals can help improve detection performance. A new approach is examined…

Signal Processing · Electrical Eng. & Systems 2020-02-11 Lubna Shibly Mokatren , Rashid Ansari , Ahmet Enis Cetin , Alex D Leow , Heide Klumpp , Olusola Ajilore , Fatos Yarman Vural

Stimulus-evoked EEG data has a notoriously low signal-to-noise ratio and high inter-subject variability. We propose a novel paradigm for the self-supervised extraction of stimulus-related brain response data: a model is trained to extract…

Neurons and Cognition · Quantitative Biology 2024-05-15 Bernd Accou , Hugo Van hamme , Tom Francart

Electroencephalography (EEG) is a tool that allows us to analyze brain activity with high temporal resolution. These measures, combined with deep learning and digital signal processing, are widely used in neurological disorder detection and…

Signal Processing · Electrical Eng. & Systems 2024-11-20 Isaac Ariza , Lorenzo J. Tardon , Ana M. Barbancho , Irene De-Torres , Isabel Barbancho

Existing approaches to modeling associations between visual stimuli and brain responses are facing difficulties in handling between-subject variance and model generalization. Inspired by the recent progress in modeling speech-brain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Yiqian Yang , Zhengqiao Zhao , Qian Wang , Yan Yang , Jingdong Chen

Emotion estimation in music listening is confronting challenges to capture the emotion variation of listeners. Recent years have witnessed attempts to exploit multimodality fusing information from musical contents and physiological signals…

Artificial Intelligence · Computer Science 2016-12-01 Nattapong Thammasan , Ken-ichi Fukui , Masayuki Numao

Patterns of brain activity are associated with different brain processes and can be used to identify different brain states and make behavioral predictions. However, the relevant features are not readily apparent and accessible. To mine…

Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode…

Computation and Language · Computer Science 2024-08-12 Jinzhao Zhou , Yiqun Duan , Ziyi Zhao , Yu-Cheng Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

One of the challenges in modeling cognitive events from electroencephalogram (EEG) data is finding representations that are invariant to inter- and intra-subject differences, as well as to inherent noise associated with such data. Herein,…

Machine Learning · Computer Science 2016-03-02 Pouya Bashivan , Irina Rish , Mohammed Yeasin , Noel Codella

Decoding speech from brain signals is a challenging research problem that holds significant importance for studying speech processing in the brain. Although breakthroughs have been made in reconstructing the mel spectrograms of audio…

Signal Processing · Electrical Eng. & Systems 2025-01-22 Cunhang Fan , Sheng Zhang , Jingjing Zhang , Zexu Pan , Zhao Lv

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

Reconstructing 3D visual stimuli from Electroencephalography (EEG) data holds significant potential for applications in Brain-Computer Interfaces (BCIs) and aiding individuals with communication disorders. Traditionally, efforts have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yuxiang Ge , Jionghao Cheng , Ruiquan Ge , Zhaojie Fang , Gangyong Jia , Xiang Wan , Nannan Li , Ahmed Elazab , Changmiao Wang

Modeling of music audio semantics has been previously tackled through learning of mappings from audio data to high-level tags or latent unsupervised spaces. The resulting semantic spaces are theoretically limited, either because the chosen…

Information Retrieval · Computer Science 2017-12-18 Francisco Raposo , David Martins de Matos , Ricardo Ribeiro , Suhua Tang , Yi Yu

In this paper, we propose a novel information theoretic model to interpret the entire "transmission chain" comprising stimulus generation, brain processing by the human subject, and the electroencephalograph (EEG) response measurements as a…

Information Theory · Computer Science 2015-09-15 Ketan Mehta , Jörg Kliewer

Restoring speech communication from neural signals is a central goal of brain-computer interface research, yet EEG-based speech reconstruction remains challenging due to limited spatial resolution, susceptibility to noise, and the absence…

Signal Processing · Electrical Eng. & Systems 2025-12-30 Hanbeot Park , Yunjeong Cho , Hunhee Kim

We present the MEEG dataset, a multi-modal collection of music-induced electroencephalogram (EEG) recordings designed to capture emotional responses to various musical stimuli across different valence and arousal levels. This public dataset…

Human-Computer Interaction · Computer Science 2024-11-19 Minghao Xiao , Zhengxi Zhu , Kang Xie , Bin Jiang

Recent behavioral and electroencephalograph (EEG) studies have defined ways that auditory spatial attention can be allocated over large regions of space. As with most experimental studies, behavior EEG was averaged over 10s of minutes…

Signal Processing · Electrical Eng. & Systems 2019-05-07 Zhentao Liu , Jeffrey Mock , Yufei Huang , Edward Golob

Decoding imagined speech from non-invasive brain recordings is challenging because imagined datasets are scarce and difficult to align temporally across subjects and sessions In this work, we propose a new approach to the decoding of…

Machine Learning · Computer Science 2026-05-11 Maryam Maghsoudi , Shihab Shamma

Understanding the neural mechanisms behind auditory and linguistic processing is key to advancing cognitive neuroscience. In this study, we use Magnetoencephalography (MEG) data to analyze brain responses to spoken language stimuli. We…

Neurons and Cognition · Quantitative Biology 2025-01-08 Matteo Ciferri , Matteo Ferrante , Nicola Toschi

Electroencephalography (EEG) signals, known for convenient non-invasive acquisition but low signal-to-noise ratio, have recently gained substantial attention due to the potential to decode natural images. This paper presents a…

Human-Computer Interaction · Computer Science 2024-04-05 Yonghao Song , Bingchuan Liu , Xiang Li , Nanlin Shi , Yijun Wang , Xiaorong Gao