English
Related papers

Related papers: DECAF: Dynamic Envelope Context-Aware Fusion for S…

200 papers

Identifying auditory attention by comparing auditory stimuli and corresponding brain responses, is known as auditory attention decoding (AAD). The majority of AAD algorithms utilize the so-called envelope entrainment mechanism, whereby…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Nhan Duc Thanh Nguyen , Huy Phan , Kaare Mikkelsen , Preben Kidmose

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

Electroencephalography (EEG) signal decoding is a key technology that translates brain activity into executable commands, laying the foundation for direct brain-machine interfacing and intelligent interaction. To address the inherent…

Machine Learning · Computer Science 2026-01-05 Xiangrui Cai , Shaocheng Ma , Lei Cao , Jie Li , Tianyu Liu , Yilin Dong

In this work, we focus on leveraging facial cues beyond the lip region for robust Audio-Visual Speech Enhancement (AVSE). The facial region, encompassing the lip region, reflects additional speech-related attributes such as gender, skin…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Feixiang Wang , Shuang Yang , Shiguang Shan , Xilin Chen

Relating speech to EEG holds considerable importance but is challenging. In this study, a deep convolutional network was employed to extract spatiotemporal features from EEG data. Self-supervised speech representation and contextual text…

Signal Processing · Electrical Eng. & Systems 2024-02-02 Bo Wang , Xiran Xu , Zechen Zhang , Haolin Zhu , YuJie Yan , Xihong Wu , Jing Chen

We introduce GAP-URGENet, a generative-predictive fusion framework developed for Track 1 of the ICASSP 2026 URGENT Challenge. The system integrates a generative branch, which performs full-stack speech restoration in a self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-03 Xiaobin Rong , Yushi Wang , Zheng Wang , Jing Lu

Auditory Attention Decoding (AAD) can help to determine the identity of the attended speaker during an auditory selective attention task, by analyzing and processing measurements of electroencephalography (EEG) data. Most studies on AAD are…

Signal Processing · Electrical Eng. & Systems 2024-09-16 Haolin Zhu , Yujie Yan , Xiran Xu , Zhongshu Ge , Pei Tian , Xihong Wu , Jing Chen

Steady-State Visual Evoked Potential is a brain response to visual stimuli flickering at constant frequencies. It is commonly used in brain-computer interfaces for direct brain-device communication due to their simplicity, minimal training…

Human-Computer Interaction · Computer Science 2025-06-03 Chenlong Wang , Jiaao Li , Shuailei Zhang , Wenbo Ding , Xinlei Chen

We introduce a two-stage self-supervised framework that combines the Joint-Embedding Predictive Architecture (JEPA) with a Density Adaptive Attention Mechanism (DAAM) for learning robust speech representations. Stage~1 uses JEPA with DAAM…

Recent promising results in auditory attention decoding (AAD) using scalp electroencephalography (EEG) have motivated the exploration of cEEGrid, a flexible and portable ear-EEG system. While prior cEEGrid-based studies have confirmed the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-23 Yuanming Zhang , Zeyan Song , Jing Lu , Fei Chen , Zhibin Lin

To investigate how speech is processed in the brain, we can model the relation between features of a natural speech signal and the corresponding recorded electroencephalogram (EEG). Usually, linear models are used in regression tasks.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-25 Corentin Puffay , Jana Van Canneyt , Jonas Vanthornhout , Hugo Van Hamme , Tom Francart

Selective auditory attention decoding aims to identify the speaker of interest from listeners' neural signals, such as electroencephalography (EEG), in the presence of multiple concurrent speakers. Most existing methods operate at the…

Signal Processing · Electrical Eng. & Systems 2026-02-17 Yuanyuan Yao , Simon Geirnaert , Tinne Tuytelaars , Alexander Bertrand

We study multimodal affect modeling when EEG and peripheral physiology are asynchronous, which most fusion methods ignore or handle with costly warping. We propose Cross-Temporal Attention Fusion (CTAF), a self-supervised module that learns…

Machine Learning · Computer Science 2026-02-04 Arian Khorasani , Théophile Demazure

Decoding speech directly from neural activity is a central goal in brain-computer interface (BCI) research. In recent years, exciting advances have been made through the growing use of intracranial field potential recordings, such as…

Signal Processing · Electrical Eng. & Systems 2025-05-28 Hui Zheng , Hai-Teng Wang , Yi-Tao Jing , Pei-Yang Lin , Han-Qing Zhao , Wei Chen , Peng-Hu Wei , Yong-Zhi Shan , Guo-Guang Zhao , Yun-Zhe Liu

In this study, a novel open-source brain-computer interface (BCI) platform was developed to decode scalp electroencephalography (EEG) signals associated with sustained attention. The EEG signal collection was conducted using a wireless…

Signal Processing · Electrical Eng. & Systems 2024-05-08 Maryam Norouzi , Mohammad Zaeri Amirani , Yalda Shahriari , Reza Abiri

Intracranial EEG (iEEG) recording, characterized by high spatial and temporal resolution and superior signal-to-noise ratio (SNR), enables the development of precise brain-computer interface (BCI) systems for neural decoding. However, the…

Human-Computer Interaction · Computer Science 2025-12-09 Maryam Ostadsharif Memar , Navid Ziaei , Behzad Nazari

The reconstruction of 3D objects from brain signals has gained significant attention in brain-computer interface (BCI) research. Current research predominantly utilizes functional magnetic resonance imaging (fMRI) for 3D reconstruction…

Graphics · Computer Science 2025-05-06 Xia Deng , Shen Chen , Jiale Zhou , Lei Li

Objective. When a person listens to continuous speech, a corresponding response is elicited in the brain and can be recorded using electroencephalography (EEG). Linear models are presently used to relate the EEG recording to the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-19 Corentin Puffay , Bernd Accou , Lies Bollens , Mohammad Jalilpour Monesi , Jonas Vanthornhout , Hugo Van hamme , Tom Francart

Recent progress in diffusion-based generative models has enabled high-quality image synthesis conditioned on diverse modalities. Extending such models to brain signals could deepen our understanding of human perception and mental…

Signal Processing · Electrical Eng. & Systems 2025-11-25 Jeyoung Lee , Hochul Kang

Dementia (DEM) is a growing global health challenge, underscoring the need for early and accurate diagnosis. Electroencephalography (EEG) provides a non-invasive window into brain activity, but conventional methods struggle to capture its…

Signal Processing · Electrical Eng. & Systems 2025-09-04 Mohammad Mehedi Hasan , Pedro G. Lind , Hernando Ombao , Anis Yazidi , Rabindra Khadka