English
Related papers

Related papers: SHINE: Sequential Hierarchical Integration Network…

200 papers

This thesis delves into the world of non-invasive electrophysiological brain signals like electroencephalography (EEG) and magnetoencephalography (MEG), focusing on modelling and decoding such data. The research aims to investigate what…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Richard Csaky

Decoding imagined speech engages complex neural processes that are difficult to interpret due to uncertainty in timing and the limited availability of imagined-response datasets. In this study, we present a Magnetoencephalography (MEG)…

Signal Processing · Electrical Eng. & Systems 2025-12-04 Maryam Maghsoudi , Mohsen Rezaeizadeh , Shihab Shamma

Machine learning techniques have enabled researchers to leverage neuroimaging data to decode speech from brain activity, with some amazing recent successes achieved by applications built using invasive devices. However, research requiring…

Machine Learning · Computer Science 2024-10-29 Jeremiah Ridge , Oiwi Parker Jones

Brain source imaging is an important method for noninvasively characterizing brain activity using Electroencephalogram (EEG) or Magnetoencephalography (MEG) recordings. Traditional EEG/MEG Source Imaging (ESI) methods usually assume that…

Applications · Statistics 2019-06-07 Feng Liu , Li Wang , Yifei Lou , Rencang Li , Patrick Purdon

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

In the Edge Inference (EI) paradigm, where a Deep Neural Network (DNN) is split across the transceivers to wirelessly communicate goal-defined features in solving a computational task, the wireless medium has been commonly treated as a…

Machine Learning · Computer Science 2025-04-03 Kyriakos Stylianopoulos , Paolo Di Lorenzo , George C. Alexandropoulos

Decoding continuous language from neural signals remains a significant challenge in the intersection of neuroscience and artificial intelligence. We introduce Neuro2Semantic, a novel framework that reconstructs the semantic content of…

Computation and Language · Computer Science 2025-06-03 Siavash Shams , Richard Antonello , Gavin Mischler , Stephan Bickel , Ashesh Mehta , Nima Mesgarani

Electroencephalography (EEG) plays a vital role in detecting how brain responses to different stimulus. In this paper, we propose a novel Shallow-Deep Attention-based Network (SDANet) to classify the correct auditory stimulus evoking the…

Sound · Computer Science 2023-03-21 Fan Cui , Liyong Guo , Lang He , Jiyao Liu , ErCheng Pei , Yujun Wang , Dongmei Jiang

Decoding brain activity into natural language is a major challenge in AI with important applications in assistive communication, neurotechnology, and human-computer interaction. Most existing Brain-Computer Interface (BCI) approaches rely…

Machine Learning · Computer Science 2026-03-19 Akshaj Murhekar , Christina Liu , Abhijit Mishra , Shounak Roychowdhury , Jacek Gwizdka

We propose MEBM-Phoneme, a multi-scale enhanced neural decoder for phoneme classification from non-invasive magnetoencephalography (MEG) signals. Built upon the BrainMagic backbone, MEBM-Phoneme integrates a short-term multi-scale…

Sound · Computer Science 2026-03-04 Liang Jinghua , Zhang Zifeng , Li Songyi , Zheng Linze

Objective. When a person listens to continuous speech, a corresponding response is elicited in the brain and can be recorded using electroencephalography (EEG). Linear models are presently used to relate the EEG recording to the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-19 Corentin Puffay , Bernd Accou , Lies Bollens , Mohammad Jalilpour Monesi , Jonas Vanthornhout , Hugo Van hamme , Tom Francart

This study examines the efficacy of various neural network (NN) models in interpreting mental constructs via electroencephalogram (EEG) signals. Through the assessment of 16 prevalent NN models and their variants across four brain-computer…

Neurons and Cognition · Quantitative Biology 2023-09-26 Xia Chen , Xiangbin Teng , Han Chen , Yafeng Pan , Philipp Geyer

The "MEG-MASC" dataset provides a curated set of raw magnetoencephalography (MEG) recordings of 27 English speakers who listened to two hours of naturalistic stories. Each participant performed two identical sessions, involving listening to…

Quantitative Methods · Quantitative Biology 2022-08-25 Laura Gwilliams , Graham Flick , Alec Marantz , Liina Pylkkanen , David Poeppel , Jean-Remi King

Brain-computer interfaces (BCI) offer numerous human-centered application possibilities, particularly affecting people with neurological disorders. Text or speech decoding from brain activities is a relevant domain that could augment the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-10 Jihwan Lee , Tiantian Feng , Aditya Kommineni , Sudarsana Reddy Kadiri , Shrikanth Narayanan

Heterogeneous information networks(HINs) become popular in recent years for its strong capability of modelling objects with abundant information using explicit network structure. Network embedding has been proved as an effective method to…

Machine Learning · Computer Science 2021-04-12 Xinyi Zhang , Lihui Chen

Speech-related Brain Computer Interface (BCI) technologies provide effective vocal communication strategies for controlling devices through speech commands interpreted from brain signals. In order to infer imagined speech from active…

Machine Learning · Computer Science 2019-04-12 Pramit Saha , Muhammad Abdul-Mageed , Sidney Fels

Brain-computer interface (BCI) speech decoding has emerged as a promising tool for assisting individuals with speech impairments. In this context, the integration of electroencephalography (EEG) and electromyography (EMG) signals offers…

Sound · Computer Science 2025-11-17 Yifan Zhuang , Calvin Huang , Zepeng Yu , Yongjie Zou , Jiawei Ju

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Mike Thornton , Danilo Mandic , Tobias Reichenbach

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contrastive CLIP loss to…

Sound · Computer Science 2025-11-10 Quentin Auster , Kateryna Shapovalenko , Chuang Ma , Demaio Sun

Decoding imagined speech from non-invasive brain recordings is challenging because imagined datasets are scarce and difficult to align temporally across subjects and sessions In this work, we propose a new approach to the decoding of…

Machine Learning · Computer Science 2026-05-11 Maryam Maghsoudi , Shihab Shamma