English
Related papers

Related papers: SHINE: Sequential Hierarchical Integration Network…

200 papers

We propose MEBM-Speech, a multi-scale enhanced neural decoder for speech activity detection from non-invasive magnetoencephalography (MEG) signals. Built upon the BrainMagic backbone, MEBM-Speech integrates three complementary temporal…

Sound · Computer Science 2026-03-04 Li Songyi , Zheng Linze , Liang Jinghua , Zhang Zifeng

LibriBrain represents the largest single-subject MEG dataset to date for speech decoding, with over 50 hours of recordings -- 5$\times$ larger than the next comparable dataset and 50$\times$ larger than most. This unprecedented `depth' of…

We propose a mixed deep neural network strategy, incorporating parallel combination of Convolutional (CNN) and Recurrent Neural Networks (RNN), cascaded with deep autoencoders and fully connected layers towards automatic identification of…

Machine Learning · Computer Science 2019-04-10 Pramit Saha , Sidney Fels

Decoding speech from non-invasive brain signals is challenging. For the LibriBrain 2025 Speech Detection task, we propose a novel two-step framework that bypasses direct reconstruction. First, a contrastive learning model retrieves the…

Sound · Computer Science 2026-05-14 Boda Xiao , Bo Wang , Heping Cheng

Non-invasive decoding of imagined speech remains challenging due to weak, distributed signals and limited labeled data. Our paper introduces an image-based approach that transforms magnetoencephalography (MEG) signals into time-frequency…

Computation and Language · Computer Science 2026-01-23 Soufiane Jhilal , Stéphanie Martin , Anne-Lise Giraud

Zero-shot cross-lingual information extraction(IE) aims at constructing an IE model for some low-resource target languages, given annotations exclusively in some rich-resource languages. Recent studies based on language-universal features…

Computation and Language · Computer Science 2023-05-23 Jun-Yu Ma , Jia-Chen Gu , Zhen-Hua Ling , Quan Liu , Cong Liu , Guoping Hu

Current EEG/MEG-to-text decoding systems suffer from three key limitations: (1) reliance on teacher-forcing methods, which compromises robustness during inference, (2) sensitivity to session-specific noise, hindering generalization across…

Artificial Intelligence · Computer Science 2025-08-06 Jilong Li , Zhenxi Song , Jiaqi Wang , Meishan Zhang , Honghai Liu , Min Zhang , Zhiguo Zhang

Interpreting neural activity through meaningful latent representations remains a complex and evolving challenge at the intersection of neuroscience and artificial intelligence. We investigate the potential of multimodal foundation models to…

Computation and Language · Computer Science 2025-04-22 Yijun Liu

Understanding how the brain responds to sensory inputs is challenging: brain recordings are partial, noisy, and high dimensional; they vary across sessions and subjects and they capture highly nonlinear dynamics. These challenges have led…

Neurons and Cognition · Quantitative Biology 2022-10-03 Omar Chehab , Alexandre Defossez , Jean-Christophe Loiseau , Alexandre Gramfort , Jean-Remi King

Electroencephalography (EEG) plays a crucial role in brain-computer interfaces (BCIs) and neurological diagnostics, but its real-world deployment faces challenges due to noise artifacts, missing data, and high annotation costs. We introduce…

Signal Processing · Electrical Eng. & Systems 2025-10-24 Meghna Roy Chowdhury , Yi Ding , Shreyas Sen

Decoding speech-related information from non-invasive MEG is a key step toward scalable brain-computer interfaces. We present compact Conformer-based decoders on the LibriBrain 2025 PNPL benchmark for two core tasks: Speech Detection and…

Computation and Language · Computer Science 2026-02-11 Xabier de Zuazo , Ibon Saratxaga , Eva Navas

Visual decoding from electroencephalography (EEG) has emerged as a highly promising avenue for non-invasive brain-computer interfaces (BCIs). Existing EEG-based decoding methods predominantly align brain signals with the final-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jingyi Tang , Shuai Jiang , Fei Su , Zhicheng Zhao

Understanding and decoding brain activity into visual representations is a fundamental challenge at the intersection of neuroscience and artificial intelligence. While EEG visual decoding has shown promise due to its non-invasive, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Minxu Liu , Donghai Guan , Chuhang Zheng , Chunwei Tian , Jie Wen , Qi Zhu

Silent speech decoding, which performs unvocalized human speech recognition from electroencephalography/electromyography (EEG/EMG), increases accessibility for speech-impaired humans. However, data collection is difficult and performed…

Quantitative Methods · Quantitative Biology 2025-06-18 Masakazu Inoue , Motoshige Sato , Kenichi Tomeoka , Nathania Nah , Eri Hatakeyama , Kai Arulkumaran , Ilya Horiguchi , Shuntaro Sasai

Decoding language from neural signals holds considerable theoretical and practical importance. Previous research has indicated the feasibility of decoding text or speech from invasive neural signals. However, when using non-invasive neural…

Human-Computer Interaction · Computer Science 2023-09-15 Bo Wang , Xiran Xu , Longxiang Zhang , Boda Xiao , Xihong Wu , Jing Chen

Speech-related Brain Computer Interfaces (BCI) aim primarily at finding an alternative vocal communication pathway for people with speaking disabilities. As a step towards full decoding of imagined speech from active thoughts, we present a…

Machine Learning · Computer Science 2019-04-10 Pramit Saha , Muhammad Abdul-Mageed , Sidney Fels

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

Short text classification is a fundamental task in natural language processing. It is hard due to the lack of context information and labeled data in practice. In this paper, we propose a new method called SHINE, which is based on graph…

Computation and Language · Computer Science 2021-11-02 Yaqing Wang , Song Wang , Quanming Yao , Dejing Dou

In this paper we demonstrate speech synthesis using different electroencephalography (EEG) feature sets recently introduced in [1]. We make use of a recurrent neural network (RNN) regression model to predict acoustic features directly from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Gautam Krishna , Co Tran , Yan Han , Mason Carnahan

The electroencephalography (EEG) signals recorded in parallel with speech are used to perform isolated and continuous speech recognition. During speaking process, one also hears his or her own speech and this speech perception is also…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-03 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik
‹ Prev 1 2 3 10 Next ›