English
Related papers

Related papers: Relate auditory speech to EEG by shallow-deep atte…

200 papers

Classification of sleep stages plays an essential role in diagnosing sleep-related diseases including Sleep Disorder Breathing (SDB) disease. In this study, we propose an end-to-end deep learning architecture, named SSNet, which comprises…

Signal Processing · Electrical Eng. & Systems 2023-07-12 Haifa Almutairi , Ghulam Mubashar Hassan , Amitava Datta

This study introduces a WaveNet-based deep learning model designed to automate the classification of intracranial electroencephalography (iEEG) signals into physiological activity, pathological (epileptic) activity, power-line noise, and…

Machine Learning · Computer Science 2026-01-14 Casper van Laar , Khubaib Ahmed

Reconstructing speech envelopes from EEG signals is essential for exploring neural mechanisms underlying speech perception. Yet, EEG variability across subjects and physiological artifacts complicate accurate reconstruction. To address this…

Signal Processing · Electrical Eng. & Systems 2025-01-16 Li Zhang , Jiyao Liu

Brain-related disorders such as epilepsy can be diagnosed by analyzing electroencephalograms (EEG). However, manual analysis of EEG data requires highly trained clinicians, and is a procedure that is known to have relatively low inter-rater…

Signal Processing · Electrical Eng. & Systems 2018-05-21 Subhrajit Roy , Isabell Kiral-Kornek , Stefan Harrer

Existing approaches to modeling associations between visual stimuli and brain responses are facing difficulties in handling between-subject variance and model generalization. Inspired by the recent progress in modeling speech-brain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Yiqian Yang , Zhengqiao Zhao , Qian Wang , Yan Yang , Jingdong Chen

Audiovisual active speaker detection (ASD) addresses the task of determining the speech activity of a candidate speaker given acoustic and visual data. Typically, systems model the temporal correspondence of audiovisual cues, such as the…

Multimedia · Computer Science 2025-02-11 Jason Clarke , Yoshihiko Gotoh , Stefan Goetze

Carrying conversations in multi-sound environments is one of the more challenging tasks, since the sounds overlap across time and frequency making it difficult to understand a single sound source. One proposed approach to help isolate an…

Machine Learning · Computer Science 2024-10-25 Seyed Ali Alavi Bajestan , Mark Pitt , Donald S. Williamson

This paper presents a fused deep learning algorithm for ECG classification. It takes advantages of the combined convolutional and recurrent neural network for ECG classification, and the weight allocation capability of attention mechanism.…

Machine Learning · Computer Science 2022-11-01 Tongyue He , Yiming Chen , Junxin Chen , Wei Wang , Yicong Zhou

The ability to perceive and recognize objects is fundamental for the interaction with the external environment. Studies that investigate them and their relationship with brain activity changes have been increasing due to the possible…

Signal Processing · Electrical Eng. & Systems 2020-08-31 Jenifer Kalafatovich , Minji Lee , Seong-Whan Lee

Recent behavioral and electroencephalograph (EEG) studies have defined ways that auditory spatial attention can be allocated over large regions of space. As with most experimental studies, behavior EEG was averaged over 10s of minutes…

Signal Processing · Electrical Eng. & Systems 2019-05-07 Zhentao Liu , Jeffrey Mock , Yufei Huang , Edward Golob

The use of electroencephalogram (EEG) as the main input signal in brain-machine interfaces has been widely proposed due to the non-invasive nature of the EEG. Here we are specifically interested in interfaces that extract information from…

Signal Processing · Electrical Eng. & Systems 2018-04-30 Marc-Antoine Moinnereau , Thomas Brienne , Simon Brodeur , Jean Rouat , Kevin Whittingstall , Eric Plourde

A promising approach for steering auditory attention in complex listening environments relies on Auditory Attention Decoding (AAD), which aim to identify the attended speech stream in a multiple speaker scenario from neural recordings.…

Recognition of electroencephalographic (EEG) signals highly affect the efficiency of non-invasive brain-computer interfaces (BCIs). While recent advances of deep-learning (DL)-based EEG decoders offer improved performances, the development…

Machine Learning · Computer Science 2022-10-06 Yue-Ting Pan , Jing-Lun Chou , Chun-Shu Wei

In this article we present the results of our research related to the study of correlations between specific visual stimulation and the elicited brain's electro-physiological response collected by EEG sensors from a group of participants.…

Machine Learning · Computer Science 2017-08-04 Iaroslav Omelianenko

Eye movements can reveal valuable insights into various aspects of human mental processes, physical well-being, and actions. Recently, several datasets have been made available that simultaneously record EEG activity and eye movements. This…

Signal Processing · Electrical Eng. & Systems 2023-08-14 Nina Weng , Martyna Plomecka , Manuel Kaufmann , Ard Kastrati , Roger Wattenhofer , Nicolas Langer

Electroencephalography (EEG) signals are crucial for investigating brain function and cognitive processes. This study aims to address the challenges of efficiently recording and analyzing high-dimensional EEG signals while listening to…

Machine Learning · Computer Science 2024-08-23 Jingyi Wang , Zhiqun Wang , Guiran Liu

Understanding the correlation between EEG features and cognitive tasks is crucial for elucidating brain function. Brain activity synchronizes during speaking and listening tasks. However, it is challenging to estimate task-dependent brain…

Neurons and Cognition · Quantitative Biology 2024-10-01 Dai Shimizu , Ko Watanabe , Andreas Dengel

Everyday communication is dynamic and multisensory, often involving shifting attention, overlapping speech and visual cues. Yet, most neural attention tracking studies are still limited to highly controlled lab settings, using clean, often…

Signal Processing · Electrical Eng. & Systems 2026-01-22 Johanna Wilroth , Oskar Keding , Martin A. Skoglund , Maria Sandsten , Martin Enqvist , Emina Alickovic

Speech comprehension is an involuntary task for the healthy human brain, yet the understanding of the mechanisms underlying this brain functionality remains obscure. In this paper, we aim to quantify the role of acoustic and semantic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-31 Sai Samrat Kankanala , Akshara Soman , Sriram Ganapathy

Depression is a major cause of global mental illness and significantly influences suicide rates. Timely and accurate diagnosis is essential for effective intervention. Electroencephalography (EEG) provides a non-invasive and accessible…

Signal Processing · Electrical Eng. & Systems 2025-11-11 Soujanya Hazra , Sanjay Ghosh