English
Related papers

Related papers: Brain-Informed Speech Separation for Cochlear Impl…

200 papers

Cochlear implants (CIs) are implantable medical devices that can restore the hearing sense of people suffering from profound hearing loss. The CI uses a set of electrode contacts placed inside the cochlea to stimulate the auditory nerve…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Hendrik Hachmann , Benjamin Krüger , Bodo Rosenhahn , Waldo Nogueira

This paper introduces a novel algorithm designed for speech synthesis from neural activity recordings obtained using invasive electroencephalography (EEG) techniques. The proposed system offers a promising communication solution for…

Electroencephalography (EEG) is an essential technique for neuroscience research and brain-computer interface (BCI) applications. Recently, large-scale EEG foundation models have been developed, exhibiting robust generalization capabilities…

Signal Processing · Electrical Eng. & Systems 2025-10-15 Zhige Chen , Chengxuan Qin , Wenlong You , Rui Liu , Congying Chu , Rui Yang , Kay Chen Tan , Jibin Wu

The objective was to determine the effect of pulse rate on the sensitivity to use interaural-time-difference (ITD) cues and to explore the mechanisms behind rate-dependent degradation in ITD perception in bilateral cochlear implant (CI)…

Neurons and Cognition · Quantitative Biology 2023-05-08 Hongmei Hu , Stephan Ewert , Birger Kollmeier , Deborah Vickers

Multi-modal based speech separation has exhibited a specific advantage on isolating the target character in multi-talker noisy environments. Unfortunately, most of current separation strategies prefer a straightforward fusion based on…

Sound · Computer Science 2022-03-08 Junwen Xiong , Peng Zhang , Lei Xie , Wei Huang , Yufei Zha , Yanning Zhang

Different from the emotion recognition in individual utterances, we propose a multimodal learning framework using relation and dependencies among the utterances for conversational emotion analysis. The attention mechanism is applied to the…

Computation and Language · Computer Science 2019-10-25 Zheng Lian , Jianhua Tao , Bin Liu , Jian Huang

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices, providing critical support for individuals with motor impairments. However, accurate motor imagery (MI) decoding from…

Machine Learning · Computer Science 2026-04-08 Panagiotis Andrikopoulos , Siamak Mehrkanoon

Brain-computer interface (BCI) speech decoding has emerged as a promising tool for assisting individuals with speech impairments. In this context, the integration of electroencephalography (EEG) and electromyography (EMG) signals offers…

Sound · Computer Science 2025-11-17 Yifan Zhuang , Calvin Huang , Zepeng Yu , Yongjie Zou , Jiawei Ju

Non-invasive decoding of imagined speech remains challenging due to weak, distributed signals and limited labeled data. Our paper introduces an image-based approach that transforms magnetoencephalography (MEG) signals into time-frequency…

Computation and Language · Computer Science 2026-01-23 Soufiane Jhilal , Stéphanie Martin , Anne-Lise Giraud

Channel State Information (CSI) Feedback plays a crucial role in achieving higher gains through beamforming. However, for a massive MIMO system, this feedback overhead is huge and grows linearly with the number of antennas. To reduce the…

Signal Processing · Electrical Eng. & Systems 2022-10-20 Sharan Mourya , SaiDhiraj Amuru , Kiran Kumar Kuchi

The automatic classification of medical time series signals, such as electroencephalogram (EEG) and electrocardiogram (ECG), plays a pivotal role in clinical decision support and early detection of diseases. Although Transformer based…

Machine Learning · Computer Science 2025-09-22 Ming Hu , Jianfu Yin , Mingyu Dou , Yuqi Wang , Ruochen Dang , Siyi Liang , Feiyu Zhu , Cong Hu , Yao Wang , Bingliang Hu , Quan Wang

This paper proposes a simple and effective approach for automatic recognition of Cued Speech (CS), a visual communication tool that helps people with hearing impairment to understand spoken language with the help of hand gestures that can…

Computation and Language · Computer Science 2022-04-12 Sanjana Sankar , Denis Beautemps , Thomas Hueber

This paper proposes a neural network based speech separation method using spatially distributed microphones. Unlike with traditional microphone array settings, neither the number of microphones nor their spatial arrangement is known in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Dongmei Wang , Zhuo Chen , Takuya Yoshioka

A brain--machine interface (BMI) based on motor imagery (MI) enables the control of devices using brain signals while the subject imagines performing a movement. It plays a vital role in prosthesis control and motor rehabilitation. To…

Signal Processing · Electrical Eng. & Systems 2024-09-20 Xiaying Wang , Michael Hersche , Michele Magno , Luca Benini

The rapid development of auditory attention decoding (AAD) based on electroencephalography (EEG) signals offers the possibility EEG-driven target speaker extraction. However, how to effectively utilize the target-speaker common information…

Sound · Computer Science 2025-10-15 Youhao Si , Yuan Liao , Qiushi Han , Yuhang Yang , Rui Dai , Liya Huang

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

Electroencephalography (EEG) plays a vital role in detecting how brain responses to different stimulus. In this paper, we propose a novel Shallow-Deep Attention-based Network (SDANet) to classify the correct auditory stimulus evoking the…

Sound · Computer Science 2023-03-21 Fan Cui , Liyong Guo , Lang He , Jiyao Liu , ErCheng Pei , Yujun Wang , Dongmei Jiang

The classification of electroencephalography (EEG) signals is useful in a wide range of applications such as seizure detection/prediction, motor imagery classification, emotion classification and drug effects diagnosis, amongst others. With…

Signal Processing · Electrical Eng. & Systems 2022-09-05 Phoebe M Asquith , Hisham Ihshaish

In this paper, we propose a novel information theoretic model to interpret the entire "transmission chain" comprising stimulus generation, brain processing by the human subject, and the electroencephalograph (EEG) response measurements as a…

Information Theory · Computer Science 2015-09-15 Ketan Mehta , Jörg Kliewer

Research about brain activities involving spoken word production is considerably underdeveloped because of the undiscovered characteristics of speech artifacts, which contaminate electroencephalogram (EEG) signals and prevent the inspection…

Sound · Computer Science 2022-06-02 Holy Lovenia , Hiroki Tanaka , Sakriani Sakti , Ayu Purwarianti , Satoshi Nakamura