English
Related papers

Related papers: Visual Decoding and Reconstruction via EEG Embeddi…

200 papers

Decoding language from neural signals holds considerable theoretical and practical importance. Previous research has indicated the feasibility of decoding text or speech from invasive neural signals. However, when using non-invasive neural…

Human-Computer Interaction · Computer Science 2023-09-15 Bo Wang , Xiran Xu , Longxiang Zhang , Boda Xiao , Xihong Wu , Jing Chen

Effectively learning the temporal dynamics in electroencephalogram (EEG) signals is challenging yet essential for decoding brain activities using brain-computer interfaces (BCIs). Although Transformers are popular for their long-term…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Yi Ding , Yong Li , Hao Sun , Rui Liu , Chengxuan Tong , Chenyu Liu , Xinliang Zhou , Cuntai Guan

Visual stimuli reconstruction from EEG remains challenging due to fidelity loss and representation shift. We propose CognitionCapturerPro, an enhanced framework that integrates EEG with multi-modal priors (images, text, depth, and edges)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kaifan Zhang , Lihuo He , Junjie Ke , Yuqi Ji , Lukun Wu , Lizi Wang , Xinbo Gao

The large volume of electroencephalograph (EEG) data produced by brain-computer interface (BCI) systems presents challenges for rapid transmission over bandwidth-limited channels in Internet of Things (IoT) networks. To address the issue,…

Signal Processing · Electrical Eng. & Systems 2025-03-14 Xin Zhu , Hongyi Pan , Ahmet Enis Cetin

Foundation models for EEG analysis are still in their infancy, limited by two key challenges: (1) variability across datasets caused by differences in recording devices and configurations, and (2) the low signal-to-noise ratio (SNR) of EEG,…

Machine Learning · Computer Science 2025-11-13 Navid Mohammadi Foumani , Soheila Ghane , Nam Nguyen , Mahsa Salehi , Geoffrey I. Webb , Geoffrey Mackellar

Reconstructing seeing images from fMRI recordings is an absorbing research area in neuroscience and provides a potential brain-reading technology. The challenge lies in that visual encoding in brain is highly complex and not fully revealed.…

Neural and Evolutionary Computing · Computer Science 2021-01-29 Tao Fang , Yu Qi , Gang Pan

Electroencephalography (EEG) is an invaluable tool in neuroscience, offering insights into brain activity with high temporal resolution. Recent advancements in machine learning and generative modeling have catalyzed the application of EEG…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yashvir Sabharwal , Balaji Rama

Capturing dynamic spatiotemporal neural activity is essential for understanding large-scale brain mechanisms. Functional magnetic resonance imaging (fMRI) provides high-resolution cortical representations that form a strong basis for…

Image and Video Processing · Electrical Eng. & Systems 2026-04-01 Wanying Qu , Jianxiong Gao , Wei Wang , Yanwei Fu

Aiming to reconstruct visual stimuli from brain signals, brain decoding has recently made significant progress using functional magnetic resonance imaging (fMRI). However, it still has challenging issues such as substantial individual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Shuai Jiang , Zhu Meng , Haiwen Li , Delong Liu , Fei Su , Zhicheng Zhao

Subject-agnostic brain decoding, which aims to reconstruct continuous visual experiences from fMRI without subject-specific training, holds great potential for clinical applications. However, this direction remains underexplored due to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Jingyu Lu , Haonan Wang , Qixiang Zhang , Xiaomeng Li

While capable of segregating visual data, humans take time to examine a single piece, let alone thousands or millions of samples. The deep learning models efficiently process sizeable information with the help of modern-day computing.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Alankrit Mishra , Nikhil Raj , Garima Bajwa

Previous research has demonstrated the potential of using pre-trained language models for decoding open vocabulary Electroencephalography (EEG) signals captured through a non-invasive Brain-Computer Interface (BCI). However, the impact of…

Signal Processing · Electrical Eng. & Systems 2024-08-13 Hamza Amrani , Daniela Micucci , Paolo Napoletano

Objective: The strengths of Electrical Impedance Tomography (EIT) are its capability of imaging the internal body by using a noninvasive, radiation safe technique, and the absence of known hazards. In this paper we introduce a novel idea of…

Signal Processing · Electrical Eng. & Systems 2022-03-08 Sebastien Martin

While electroencephalogram (EEG) has been a crucial tool for monitoring the brain and diagnosing neurological disorders (e.g., epilepsy), learning meaningful representations from raw EEG signals remains challenging due to limited…

Machine Learning · Computer Science 2025-09-03 Jia Hong Puah , Sim Kuan Goh , Ziwei Zhang , Zixuan Ye , Chow Khuen Chan , Kheng Seang Lim , Si Lei Fong , Kok Sin Woon , Cuntai Guan

Electroencephalography (EEG) provides real-time insights into brain activity and supports diverse applications in neuroscience. While EEG foundation models (EFMs) have emerged to address the scalability issues of task-specific models,…

Machine Learning · Computer Science 2026-05-12 Jingying Ma , Feng Wu , Qika Lin , Yucheng Xing , Chenyu Liu , Ziyu Jia , Mengling Feng

The task of Electroencephalogram (EEG) analysis is paramount to the development of Brain-Computer Interfaces (BCIs). However, to reach the goal of developing robust, useful BCIs depends heavily on the speed and the accuracy at which BCIs…

Signal Processing · Electrical Eng. & Systems 2024-08-08 Eric Modesitt , Haicheng Yin , Williams Huang Wang , Brian Lu

Speech Brain Computer Interfaces (BCIs) offer promising solutions to people with severe paralysis unable to communicate. A number of recent studies have demonstrated convincing reconstruction of intelligible speech from surface…

Electroencephalography (EEG) has become one of the key modalities underpinning brain-computer interfaces (BCIs) due to its high temporal resolution, rapid responsiveness, non-invasiveness, low cost, and portability. However, EEG signals are…

Neurons and Cognition · Quantitative Biology 2026-04-17 Yihang Dong , Changhong Jing , Shuqiang Wang

Accurate decoding of lower-limb motion from EEG signals is essential for advancing brain-computer interface (BCI) applications in movement intent recognition and control. This study presents NeuroDyGait, a two-stage, phase-aware EEG-to-gait…

Signal Processing · Electrical Eng. & Systems 2026-02-13 Xi Fu , Weibang Jiang , Rui Liu , Gernot R. Müller-Putz , Cuntai Guan

Can we directly visualize what we imagine in our brain together with what we describe? The inherent nature of human perception reveals that, when we think, our body can combine language description and build a vivid picture in our brain.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Ling Wang , Chen Wu , Lin Wang