English
Related papers

Related papers: Perceptogram: Reconstructing Visual Percepts and P…

200 papers

While electroencephalogram (EEG) has been a crucial tool for monitoring the brain and diagnosing neurological disorders (e.g., epilepsy), learning meaningful representations from raw EEG signals remains challenging due to limited…

Machine Learning · Computer Science 2025-09-03 Jia Hong Puah , Sim Kuan Goh , Ziwei Zhang , Zixuan Ye , Chow Khuen Chan , Kheng Seang Lim , Si Lei Fong , Kok Sin Woon , Cuntai Guan

Decoding visual information from electroencephalography (EEG) signals remains a fundamental challenge in brain-computer interfaces and medical rehabilitation. Existing EEG visual decoding methods mainly focus on learning a single global EEG…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiang Gao , Hui Tian , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

Analyzing and reconstructing visual stimuli from brain signals effectively advances the understanding of human visual system. However, the EEG signals are complex and contain significant noise. This leads to substantial limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Honghao Fu , Zhiqi Shen , Jing Jih Chin , Hao Wang

Recent studies demonstrate the use of a two-stage supervised framework to generate images that depict human perception to visual stimuli from EEG, referring to EEG-visual reconstruction. They are, however, unable to reproduce the exact…

Multimedia · Computer Science 2022-08-19 Zesheng Ye , Lina Yao , Yu Zhang , Sylvia Gustin

Human's perception of the visual world is shaped by the stereo processing of 3D information. Understanding how the brain perceives and processes 3D visual stimuli in the real world has been a longstanding endeavor in neuroscience. Towards…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zhanqiang Guo , Jiamin Wu , Yonghao Song , Jiahui Bu , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song

EEG-based brain-computer interfaces (BCIs) have shown promise in various applications, such as motor imagery and cognitive state monitoring. However, decoding visual representations from EEG signals remains a significant challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Tariq Mehmood , Hamza Ahmad , Muhammad Haroon Shakeel , Murtaza Taj

Neural decoding from electroencephalography (EEG) remains fundamentally limited by poor generalization to unseen subjects, driven by high inter-subject variability and the lack of large-scale datasets to model it effectively. Existing…

Machine Learning · Computer Science 2025-11-25 Mengchun Zhang , Kateryna Shapovalenko , Yucheng Shao , Eddie Guo , Parusha Pradhan

A significant challenge in the electroencephalogram EEG lies in the fact that current data representations involve multiple electrode signals, resulting in data redundancy and dominant lead information. However extensive research conducted…

Signal Processing · Electrical Eng. & Systems 2024-07-31 Huyen Ngo , Khoi Do , Duong Nguyen , Viet Dung Nguyen , Lan Dang

Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode…

Computation and Language · Computer Science 2024-08-12 Jinzhao Zhou , Yiqun Duan , Ziyi Zhao , Yu-Cheng Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

Pretrained generative models have opened new frontiers in brain decoding by enabling the synthesis of realistic texts and images from non-invasive brain recordings. However, the reliability of such outputs remains questionable--whether they…

Computation and Language · Computer Science 2025-05-26 Xiaozhao Liu , Dinggang Shen , Xihui Liu

Deep networks for electroencephalogram (EEG) decoding are often only trained to solve one specific task, such as pathology or age decoding. A more general task-agnostic approach is to train deep networks to match a (clinical) EEG recording…

Computation and Language · Computer Science 2025-07-30 Tidiane Camaret Ndir , Robin Tibor Schirrmeister , Tonio Ball

Decoding natural language from non-invasive electroencephalography (EEG) remains fundamentally limited by low signal-to-noise ratio and restricted information bandwidth. This raises a fundamental question regarding whether sentence-level…

Computation and Language · Computer Science 2026-04-21 Xiaoli Yang , Huiyuan Tian , Yurui Li , Jianyu Zhang , Shijian Li , Gang Pan

Visual stimuli reconstruction from EEG remains challenging due to fidelity loss and representation shift. We propose CognitionCapturerPro, an enhanced framework that integrates EEG with multi-modal priors (images, text, depth, and edges)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kaifan Zhang , Lihuo He , Junjie Ke , Yuqi Ji , Lukun Wu , Lizi Wang , Xinbo Gao

Visual decoding from electroencephalography (EEG) has emerged as a highly promising avenue for non-invasive brain-computer interfaces (BCIs). Existing EEG-based decoding methods predominantly align brain signals with the final-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jingyi Tang , Shuai Jiang , Fei Su , Zhicheng Zhao

Vision encoders are increasingly used in modern applications, from vision-only models to multimodal systems such as vision-language models. Despite their remarkable success, it remains unclear how these architectures represent features…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Eduard Allakhverdov , Dmitrii Tarasov , Elizaveta Goncharova , Andrey Kuznetsov

We present a brain-to-image system that decodes visual stimuli from EEG signals recorded during natural image viewing. Our system addresses two tasks: (1) EEG-to-image retrieval, which ranks the correct stimulus image among 200 candidates…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chi Kit Wong , Yan Liu , Haowen Yan

Decoding visual information from electroencephalography (EEG) has recently achieved promising results, primarily focusing on reconstructing two-dimensional (2D) images from brain activity. However, the reconstruction of three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

Decoding neural activity into human-interpretable representations is a key research direction in brain-computer interfaces (BCIs) and computational neuroscience. Recent progress in machine learning and generative AI has driven growing…

Artificial Intelligence · Computer Science 2025-12-02 Shreya Shukla , Jose Torres , Akshaj Murhekar , Christina Liu , Abhijit Mishra , Jacek Gwizdka , Shounak Roychowdhury

In this work, we delve into the EEG classification task in the domain of visual brain decoding via two frameworks, involving two different learning paradigms. Considering the spatio-temporal nature of EEG data, one of our frameworks is…

Human-Computer Interaction · Computer Science 2024-08-12 Akanksha Sharma , Jyoti Nigam , Abhishek Rathore , Arnav Bhavsar

Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. We introduce a tri-modal contrastive…

Machine Learning · Computer Science 2026-05-26 Zexuan Chen , Sichao Liu , Runhao Lu , Huichao Qi , Alexandra Woolgar , Xi Vincent Wang , Lihui Wang