English
Related papers

Related papers: A Pre-trained Framework for Multilingual Brain Dec…

200 papers

Brain-Computer Interface (BCI) is a powerful communication tool between users and systems, which enhances the capability of the human brain in communicating and interacting with the environment directly. Advances in neuroscience and…

Signal Processing · Electrical Eng. & Systems 2020-01-31 Xiaotong Gu , Zehong Cao , Alireza Jolfaei , Peng Xu , Dongrui Wu , Tzyy-Ping Jung , Chin-Teng Lin

Having a rich multimodal inner language is an important component of human intelligence that enables several necessary core cognitive functions such as multimodal prediction, translation, and generation. Building upon the Conscious Turing…

Artificial Intelligence · Computer Science 2022-07-08 Paul Pu Liang

Modeling the interplay between external stimuli and internal neural representations is a pivotal research area for Brain-Computer Interfaces (BCIs). A major limitation of prior work is the prevailing paradigm of specialized, single-task…

Artificial Intelligence · Computer Science 2026-05-29 Yizhuo Lu , Changde Du , Qingyu Shi , Hang Chen , Jie Peng , Liuyun Jiang , Shuangchen Zhao , Huiguang He

Neural encoding and decoding, which aim to characterize the relationship between stimuli and brain activities, have emerged as an important area in cognitive neuroscience. Traditional encoding models, which focus on feature extraction and…

Neurons and Cognition · Quantitative Biology 2019-08-26 Hao Wu , Ziyu Zhu , Jiayi Wang , Nanning Zheng , Badong Chen

Previous studies have shown that it is possible to map brain activation data of subjects viewing images onto the feature representation space of not only vision models (modality-specific decoding) but also language models (cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mitja Nikolaus , Milad Mozafari , Nicholas Asher , Leila Reddy , Rufin VanRullen

Semantic encoders and decoders for digital semantic communication (SC) often struggle to adapt to variations in unpredictable channel environments and diverse system designs. To address these challenges, this paper proposes a novel…

Signal Processing · Electrical Eng. & Systems 2025-03-20 Yongjeong Oh , Joohyuk Park , Jinho Choi , Jihong Park , Yo-Seb Jeon

Brain-computer interfaces (BCIs) are moving rapidly from laboratory research into clinical, edge, and real-world settings. Under ISO/IEC 8663:2025, a BCI is a direct communication link between central nervous system activity and external…

Artificial Intelligence · Computer Science 2026-05-13 Lei Sun , Xiuqing Mao , Shuai Zhang , Qingyu Zeng , Min Zhao , Jiyuan Li , Wenle Dong

Brain activity translation into human language delivers the capability to revolutionize machine-human interaction while providing communication support to people with speech disability. Electronic decoding reaches a certain level of…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Mostafa El Gedawy , Omnia Nabil , Omar Mamdouh , Mahmoud Nady , Nour Alhuda Adel , Ahmed Fares

Neural language modeling (LM) has led to significant improvements in several applications, including Automatic Speech Recognition. However, they typically require large amounts of training data, which is not available for many domains and…

Computation and Language · Computer Science 2019-06-05 Navid Rekabsaz , Nikolaos Pappas , James Henderson , Banriskhem K. Khonglah , Srikanth Madikeri

The dispute of how the human brain represents conceptual knowledge has been argued in many scientific fields. Brain imaging studies have shown that the spatial patterns of neural activation in the brain are correlated with thinking about…

Neurons and Cognition · Quantitative Biology 2018-06-15 Subba Reddy Oota , Naresh Manwani , Bapi Raju S

A Brain-Computer Interface (BCI) acquires brain signals, analyzes and translates them into commands that are relayed to actuation devices for carrying out desired actions. With the widespread connectivity of everyday devices realized by the…

Human-Computer Interaction · Computer Science 2018-10-24 Xiang Zhang , Lina Yao , Shuai Zhang , Salil S. Kanhere , Quan Z. Sheng , Yunhao Liu

Deep learning has recently enabled the decoding of language from the neural activity of a few participants with electrodes implanted inside their brain. However, reliably decoding words from non-invasive recordings remains an open…

Signal Processing · Electrical Eng. & Systems 2024-12-25 Stéphane d'Ascoli , Corentin Bel , Jérémy Rapin , Hubert Banville , Yohann Benchetrit , Christophe Pallier , Jean-Rémi King

Decoding continuous speech from intracortical recordings is a central challenge for brain-computer interfaces (BCIs), with transformative potential for individuals with conditions that impair their ability to speak. While recent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Tommaso Boccato , Michal Olak , Matteo Ferrante

Intracranial recordings have opened a unique opportunity to simultaneously measure activity across multiregional networks in the human brain. Recent works have focused on developing transformer-based neurofoundation models of such…

Machine Learning · Computer Science 2025-12-16 Lucine L. Oganesian , Saba Hashemi , Maryam M. Shanechi

Multilingual training of neural machine translation (NMT) systems has led to impressive accuracy improvements on low-resource languages. However, there are still significant challenges in efficiently learning word representations in the…

Computation and Language · Computer Science 2019-02-12 Xinyi Wang , Hieu Pham , Philip Arthur , Graham Neubig

Hemispheric strokes impair motor control in contralateral body parts, necessitating effective rehabilitation strategies. Motor Imagery-based Brain-Computer Interfaces (MI-BCIs) promote neuroplasticity, aiding the recovery of motor…

Signal Processing · Electrical Eng. & Systems 2025-01-06 Praveen K. Parashiva , Sagila Gangadaran , A. P. Vinod

Unveiling visual semantics from neural signals such as EEG, MEG, and fMRI remains a fundamental challenge due to subject variability and the entangled nature of visual features. Existing approaches primarily align neural activity directly…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Zehui Feng , Chenqi Zhang , Mingru Wang , Minuo Wei , Shiwei Cheng , Cuntai Guan , Ting Han

Can artificial intelligence unlock the secrets of the human brain? How do the inner mechanisms of deep learning models relate to our neural circuits? Is it possible to enhance AI by tapping into the power of brain recordings? These…

Neurons and Cognition · Quantitative Biology 2024-12-31 Subba Reddy Oota , Zijiao Chen , Manish Gupta , Raju S. Bapi , Gael Jobard , Frederic Alexandre , Xavier Hinaut

A new approach for implementing number of expressions, emotions and, actions to operate objects through the thoughts of brain using a Non-Invasive Brain Computing Interface (BCI) technique has been proposed. In this paper a survey on brain…

Human-Computer Interaction · Computer Science 2013-02-13 M. Rajyalakshmi , T. Kameswara Rao , T. V. Prasad

Brain-computer interfaces (BCIs) decode recorded neural signals from the brain and/or stimulate the brain with encoded neural signals. BCIs span both hardware and software and have a wide range of applications in restorative medicine, from…

Software Engineering · Computer Science 2022-03-22 Cailin Winston , Caleb Winston , Chloe N Winston , Claris Winston , Cleah Winston , Rajesh PN Rao , René Just