English
Related papers

Related papers: MAD: Multi-Alignment MEG-to-Text Decoding

200 papers

We propose a fusion approach that combines features from simultaneously recorded electroencephalographic (EEG) and magnetoencephalographic (MEG) signals to improve classification performances in motor imagery-based brain-computer interfaces…

Decoding visual semantic representations from human brain activity is a significant challenge. While recent zero-shot decoding approaches have improved performance by leveraging aligned image-text datasets, they overlook a fundamental…

Neurons and Cognition · Quantitative Biology 2026-01-21 Zhengdi Zhang , Hao Zhang , Wenjun Xia

Brain Computer Interface (BCI) can help patients of neuromuscular diseases restore parts of the movement and communication abilities that they have lost. Most of BCIs rely on mapping brain activities to device instructions, but limited…

Human-Computer Interaction · Computer Science 2017-05-23 Kang Wang , Xueqian Wang , Gang Li

Magnetoencephalography (MEG) enables the study of brain activity by recording the magnetic fields generated by neural currents and has become an important technique for neuroscientists in research and clinical settings. Unlike the…

Decoding visual information from electroencephalography (EEG) has recently achieved promising results, primarily focusing on reconstructing two-dimensional (2D) images from brain activity. However, the reconstruction of three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

Decoding the attended speaker in a multi-speaker environment from electroencephalography (EEG) has attracted growing interest in recent years, with neuro-steered hearing devices as a driver application. Current approaches typically rely on…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Yuanyuan Yao , Simon Geirnaert , Tinne Tuytelaars , Alexander Bertrand

The past few years have seen remarkable progress in the decoding of speech from brain activity, primarily driven by large single-subject datasets. However, due to individual variation, such as anatomy, and differences in task design and…

Machine Learning · Computer Science 2025-06-03 Dulhan Jayalath , Gilad Landau , Brendan Shillingford , Mark Woolrich , Oiwi Parker Jones

Brain-computer interfaces (BCIs) offer a pathway to restore communication for individuals with severe motor or speech impairments. Imagined handwriting provides an intuitive paradigm for character-level neural decoding, bridging the gap…

Signal Processing · Electrical Eng. & Systems 2025-10-24 Ovishake Sen , Raghav Soni , Darpan Virmani , Akshar Parekh , Patrick Lehman , Sarthak Jena , Adithi Katikhaneni , Adam Khalifa , Baibhab Chatterjee

Brain-computer interfaces have promising medical and scientific applications for aiding speech and studying the brain. In this work, we propose an information-based evaluation metric for brain-to-text decoders. Using this metric, we examine…

Computation and Language · Computer Science 2024-05-24 Richard Antonello , Nihita Sarma , Jerry Tang , Jiaru Song , Alexander Huth

In non-invasive neural language decoding, results can be inflated by sources that are not stimulus-evoked neural evidence: decoder priors, embedding-based metrics, and non-neural structural nuisances such as signal duration. The…

Machine Learning · Computer Science 2026-05-26 Xinyu Zhang , Sichao Liu , Runhao Lu , Alexandra Woolgar , Lihui Wang

EEG-based neural decoding requires large-scale benchmark datasets. Paired brain-language data across speaking, listening, and reading modalities are essential for aligning neural activity with the semantic representation of large language…

Signal Processing · Electrical Eng. & Systems 2025-08-07 Sitong Chen , Beiqianyi Li , Cuilin He , Dongyang Li , Mingyang Wu , Xinke Shen , Song Wang , Xuetao Wei , Xindi Wang , Haiyan Wu , Quanying Liu

Electrocardiogram (ECG) plays a foundational role in modern cardiovascular care, enabling non-invasive diagnosis of arrhythmias, myocardial ischemia, and conduction disorders. While machine learning has achieved expert-level performance in…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Deyun Zhang , Xiang Lan , Shijia Geng , Qinghao Zhao , Sumei Fan , Mengling Feng , Shenda Hong

Decoding speech from non-invasive brain signals, such as electroencephalography (EEG), has the potential to advance brain-computer interfaces (BCIs), with applications in silent communication and assistive technologies for individuals with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-30 Terrance Yu-Hao Chen , Yulin Chen , Pontus Soederhaell , Sadrishya Agrawal , Kateryna Shapovalenko

Electroencephalography (EEG) is one of the most common signals used to capture the electrical activity of the brain, and the decoding of EEG, to acquire the user intents, has been at the forefront of brain-computer/machine interfaces…

Machine Learning · Computer Science 2025-07-04 Haodong Zhang , Hongqi Li

Recent advances in deep learning have had a methodological and practical impact on brain-computer interface research. Among the various deep network architectures, convolutional neural networks have been well suited for…

Signal Processing · Electrical Eng. & Systems 2020-03-06 Wonjun Ko , Eunjin Jeon , Seungwoo Jeong , Heung-Il Suk

Intracranial language brain-computer interfaces (BCIs) are a promising route for restoring communication in people with severe motor and speech impairments, but clinical translation remains limited by fragmented evidence and unresolved…

Neurons and Cognition · Quantitative Biology 2026-03-17 Dongyi He , Wai Ting Siok , Nizhuan Wang

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

Electroencephalography (EEG) is a fundamental modality for cognitive state monitoring in brain-computer interfaces (BCIs). However, it is highly susceptible to intrinsic signal errors and human-induced labeling errors, which lead to label…

Machine Learning · Computer Science 2025-12-15 Hyo-Jeong Jang , Hye-Bin Shin , Seong-Whan Lee

This study introduces a pioneering approach in brain-computer interface (BCI) technology, featuring our novel concept of complex visual imagery for non-invasive electroencephalography (EEG)-based communication. Complex visual imagery, as…

Human-Computer Interaction · Computer Science 2025-11-20 Byoung-Hee Kwon

Decoding text stimuli from cognitive signals (e.g. fMRI) enhances our understanding of the human language system, paving the way for building versatile Brain-Computer Interface. However, existing studies largely focus on decoding individual…

Signal Processing · Electrical Eng. & Systems 2023-07-12 Nuwa Xi , Sendong Zhao , Haochun Wang , Chi Liu , Bing Qin , Ting Liu