English
Related papers

Related papers: Multi-class Decoding of Attended Speaker Direction…

200 papers

Although fully end-to-end speaker diarization systems have made significant progress in recent years, modular systems often achieve superior results in real-world scenarios due to their greater adaptability and robustness. Historically,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Ruoyu Wang , Shutong Niu , Gaobin Yang , Jun Du , Shuangqing Qian , Tian Gao , Jia Pan

Decoding the attended speaker in a multi-speaker environment from electroencephalography (EEG) has attracted growing interest in recent years, with neuro-steered hearing devices as a driver application. Current approaches typically rely on…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Yuanyuan Yao , Simon Geirnaert , Tinne Tuytelaars , Alexander Bertrand

In this study, a novel open-source brain-computer interface (BCI) platform was developed to decode scalp electroencephalography (EEG) signals associated with sustained attention. The EEG signal collection was conducted using a wireless…

Signal Processing · Electrical Eng. & Systems 2024-05-08 Maryam Norouzi , Mohammad Zaeri Amirani , Yalda Shahriari , Reza Abiri

Auditory attention decoding (AAD) algorithms decode the auditory attention from electroencephalography (EEG) signals that capture the listener's neural activity. Such AAD methods are believed to be an important ingredient towards so-called…

Signal Processing · Electrical Eng. & Systems 2021-02-02 Simon Geirnaert , Tom Francart , Alexander Bertrand

Decoding neural representations of visual stimuli from electroencephalography (EEG) offers valuable insights into brain activity and cognition. Recent advancements in deep learning have significantly enhanced the field of visual decoding of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Minsuk Choi , Hiroshi Ishikawa

Identifying auditory attention by comparing auditory stimuli and corresponding brain responses, is known as auditory attention decoding (AAD). The majority of AAD algorithms utilize the so-called envelope entrainment mechanism, whereby…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Nhan Duc Thanh Nguyen , Huy Phan , Kaare Mikkelsen , Preben Kidmose

Attentive listening in a multispeaker environment such as a cocktail party requires suppression of the interfering speakers and the noise around. People with normal hearing perform remarkably well in such situations. Analysis of the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-04 Ivine Kuruvila , Kubilay Can Demir , Eghart Fischer , Ulrich Hoppe

In the study of auditory attention, it has been revealed that there exists a robust correlation between attended speech and elicited neural responses, measurable through electroencephalography (EEG). Therefore, it is possible to use the…

Sound · Computer Science 2024-09-17 Dashanka De Silva , Siqi Cai , Saurav Pahuja , Tanja Schultz , Haizhou Li

Intracranial EEG (iEEG) recording, characterized by high spatial and temporal resolution and superior signal-to-noise ratio (SNR), enables the development of precise brain-computer interface (BCI) systems for neural decoding. However, the…

Human-Computer Interaction · Computer Science 2025-12-09 Maryam Ostadsharif Memar , Navid Ziaei , Behzad Nazari

The ability to perceive and recognize objects is fundamental for the interaction with the external environment. Studies that investigate them and their relationship with brain activity changes have been increasing due to the possible…

Signal Processing · Electrical Eng. & Systems 2020-08-31 Jenifer Kalafatovich , Minji Lee , Seong-Whan Lee

Reconstructing the speech audio envelope from scalp neural recordings (EEG) is a central task for decoding a listener's attentional focus in applications like neuro-steered hearing aids. Current methods for this reconstruction, however,…

Sound · Computer Science 2026-02-24 Karan Thakkar , Mounya Elhilali

In this study, we propose an ensemble learning framework for electroencephalogram-based overt speech classification, leveraging denoising diffusion probabilistic models with varying convolutional kernel sizes. The ensemble comprises three…

Sound · Computer Science 2024-11-15 Soowon Kim , Ha-Na Jo , Eunyeong Ko

Recent advances in reconstructing speech envelopes from Electroencephalogram (EEG) signals have enabled continuous auditory attention decoding (AAD) in multi-speaker environments. Most Deep Neural Network (DNN)-based envelope reconstruction…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-26 Yayun Liang , Yuanming Zhang , Fei Chen , Jing Lu , Zhibin Lin

Effectively learning the temporal dynamics in electroencephalogram (EEG) signals is challenging yet essential for decoding brain activities using brain-computer interfaces (BCIs). Although Transformers are popular for their long-term…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Yi Ding , Yong Li , Hao Sun , Rui Liu , Chengxuan Tong , Chenyu Liu , Xinliang Zhou , Cuntai Guan

Brain-computer interface (BCI) speech decoding has emerged as a promising tool for assisting individuals with speech impairments. In this context, the integration of electroencephalography (EEG) and electromyography (EMG) signals offers…

Sound · Computer Science 2025-11-17 Yifan Zhuang , Calvin Huang , Zepeng Yu , Yongjie Zou , Jiawei Ju

We address the fundamental incompatibility of attention-based encoder-decoder (AED) models with long-form acoustic encodings. AED models trained on segmented utterances learn to encode absolute frame positions by exploiting limited acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-17 Pawel Swietojanski , Xinwei Li , Mingbin Xu , Takaaki Hori , Dogan Can , Xiaodan Zhuang

Auditory spatial attention detection (ASAD) aims to decode the attended spatial location with EEG in a multiple-speaker setting. ASAD methods are inspired by the brain lateralization of cortical neural responses during the processing of…

Signal Processing · Electrical Eng. & Systems 2024-01-18 Xiran Xu , Bo Wang , Yujie Yan , Xihong Wu , Jing Chen

Brain-computer interfaces (BCIs) hold great potential for aiding individuals with speech impairments. Utilizing electroencephalography (EEG) to decode speech is particularly promising due to its non-invasive nature. However, recordings are…

Neurons and Cognition · Quantitative Biology 2024-07-11 Motoshige Sato , Kenichi Tomeoka , Ilya Horiguchi , Kai Arulkumaran , Ryota Kanai , Shuntaro Sasai

Human brain performs remarkably well in segregating a particular speaker from interfering ones in a multi-speaker scenario. It has been recently shown that we can quantitatively evaluate the segregation capability by modelling the…

Sound · Computer Science 2021-07-12 Ivine Kuruvila , Jan Muncke , Eghart Fischer , Ulrich Hoppe

Estimation of a speaker's direction and head orientation with binaural recordings can be a critical piece of information in many real-world applications with emerging `earable' devices, including smart headphones and AR/VR headsets.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-27 Harshvardhan Takawale , Nirupam Roy