English
Related papers

Related papers: Functional Connectivity of Imagined Speech and Vis…

200 papers

This study investigated the dynamic connectivity patterns between EEG and fMRI modalities, contributing to our understanding of brain network interactions. By employing a comprehensive approach that integrated static and dynamic analyses of…

Machine Learning · Computer Science 2024-12-02 Guiran Liu , Binrong Zhu

Silent speech interfaces have been recently proposed as a way to enable communication when the acoustic signal is not available. This introduces the need to build visual speech recognition systems for silent and whispered speech. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Stavros Petridis , Jie Shen , Doruk Cetin , Maja Pantic

We introduce a method that takes advantage of high-quality pretrained multimodal representations to explore fine-grained semantic networks in the human brain. Previous studies have documented evidence of functional localization in the…

Artificial Intelligence · Computer Science 2023-06-07 Cory Efird , Alex Murphy , Joel Zylberberg , Alona Fyshe

Speech-related Brain Computer Interface (BCI) technologies provide effective vocal communication strategies for controlling devices through speech commands interpreted from brain signals. In order to infer imagined speech from active…

Machine Learning · Computer Science 2019-04-12 Pramit Saha , Muhammad Abdul-Mageed , Sidney Fels

Decoding imagined speech engages complex neural processes that are difficult to interpret due to uncertainty in timing and the limited availability of imagined-response datasets. In this study, we present a Magnetoencephalography (MEG)…

Signal Processing · Electrical Eng. & Systems 2025-12-04 Maryam Maghsoudi , Mohsen Rezaeizadeh , Shihab Shamma

We applied detrended fluctuation analysis, power spectral density, and eigenanalysis of detrended cross-correlations to investigate fMRI data representing a diurnal variation of working memory in four visual tasks: two verbal and two…

A fundamental question in neurolinguistics concerns the brain regions involved in syntactic and semantic processing during speech comprehension, both at the lexical (word processing) and supra-lexical levels (sentence and discourse…

Computation and Language · Computer Science 2023-03-01 Alexandre Pasquiou , Yair Lakretz , Bertrand Thirion , Christophe Pallier

Speech impairments due to cerebral lesions and degenerative disorders can be devastating. For humans with severe speech deficits, imagined speech in the brain-computer interface has been a promising hope for reconstructing the neural…

Neurons and Cognition · Quantitative Biology 2022-04-18 Keon-Woo Lee , Dae-Hyeok Lee , Sung-Jin Kim , Seong-Whan Lee

Brain-computer interface uses brain signals to control external devices without actual control behavior. Recently, speech imagery has been studied for direct communication using language. Speech imagery uses brain signals generated when the…

Human-Computer Interaction · Computer Science 2020-12-08 Byeong-Hoo Lee , Byeong-Hee Kwon , Do-Yeun Lee , Ji-Hoon Jeong

Brain decoding techniques are essential for understanding the neurocognitive system. Although numerous methods have been introduced in this field, accurately aligning complex external stimuli with brain activities remains a formidable…

Neurons and Cognition · Quantitative Biology 2024-07-16 Heng Huang , Lin Zhao , Zihao Wu , Xiaowei Yu , Jing Zhang , Xintao Hu , Dajiang Zhu , Tianming Liu

Dynamic networks have been increasingly used to characterize brain connectivity that varies during resting and task states. In such characterizations, a connectivity network is typically measured at each time point for a subject over a…

Methodology · Statistics 2023-03-23 Maoyu Zhang , Biao Cai , Wenlin Dai , Dehan Kong , Hongyu Zhao , Jingfei Zhang

Non-invasive decoding of imagined speech remains challenging due to weak, distributed signals and limited labeled data. Our paper introduces an image-based approach that transforms magnetoencephalography (MEG) signals into time-frequency…

Computation and Language · Computer Science 2026-01-23 Soufiane Jhilal , Stéphanie Martin , Anne-Lise Giraud

Human speech production encompasses multiple modes such as perceived, overt, whispered, and imagined, each reflecting distinct neural mechanisms. Among these, theta-band synchrony has been closely associated with language processing,…

Computation and Language · Computer Science 2025-11-12 Jung-Sun Lee , Ha-Na Jo , Eunyeong Ko

The use of Automatic speech recognition (ASR) interfaces have become increasingly popular in daily life for use in interaction and control of electronic devices. The interfaces currently being used are not feasible for a variety of users…

Signal Processing · Electrical Eng. & Systems 2022-03-30 Ayush Tripathi

Quantitative modeling of human brain activity based on language representations has been actively studied in systems neuroscience. However, previous studies examined word-level representation, and little is known about whether we could…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Eri Matsuo , Ichiro Kobayashi , Shinji Nishimoto , Satoshi Nishida , Hideki Asoh

Despite known differences between reading and listening in the brain, recent work has shown that text-based language models predict both text-evoked and speech-evoked brain activity to an impressive degree. This poses the question of what…

Computation and Language · Computer Science 2024-06-18 Subba Reddy Oota , Emin Çelik , Fatma Deniz , Mariya Toneva

We investigated the relationship among neural representations of vocalized, mimed, and imagined speech recorded using publicly available stereotactic EEG recordings. Most prior studies have focused on decoding speech responses within each…

Sound · Computer Science 2026-02-27 Maryam Maghsoudi , Rupesh Chillale , Shihab A. Shamma

In the coming decade, artificial intelligence systems will continue to improve and revolutionise every industry and facet of human life. Designing effective, seamless and symbiotic communication paradigms between humans and AI agents is…

Human-Computer Interaction · Computer Science 2024-08-13 Suyi Zhang , Ekram Alam , Jack Baber , Francesca Bianco , Edward Turner , Maysam Chamanzar , Hamid Dehghani

Resting-state brain functional connectivity quantifies the synchrony between activity patterns of different brain regions. In functional magnetic resonance imaging (fMRI), each region comprises a set of spatially contiguous voxels at which…

Methodology · Statistics 2025-11-07 Ruobin Liu , Chao Zhang , Chau Tran , Sophie Achard , Wendy Meiring , Alexander Petersen

It is widely accepted that information derived from analyzing speech (the acoustic signal) and language production (words and sentences) serves as a useful window into the health of an individual's cognitive ability. In fact, most…

Computation and Language · Computer Science 2019-11-06 Rohit Voleti , Julie M. Liss , Visar Berisha