English
Related papers

Related papers: MindAlign: Bridging EEG, Vision, and Language for …

200 papers

Zero-shot EEG-to-image retrieval aims to decode perceived visual content from electroencephalography (EEG) by aligning neural responses with pretrained visual representations, providing a promising route toward scalable visual neural…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lin Jiang , Qingshan She , Jiale Xu , Haiqi Xu , Duanpo Wu , Zhenzhong Kuang

In this work, we delve into the EEG classification task in the domain of visual brain decoding via two frameworks, involving two different learning paradigms. Considering the spatio-temporal nature of EEG data, one of our frameworks is…

Human-Computer Interaction · Computer Science 2024-08-12 Akanksha Sharma , Jyoti Nigam , Abhishek Rathore , Arnav Bhavsar

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

Analyzing and reconstructing visual stimuli from brain signals effectively advances the understanding of human visual system. However, the EEG signals are complex and contain significant noise. This leads to substantial limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Honghao Fu , Zhiqi Shen , Jing Jih Chin , Hao Wang

EEG-based visual neural decoding aims to align neural responses with visual stimuli for tasks such as image retrieval. However, limited paired data and a fundamental mismatch between high-fidelity digital images and biological visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jingtao Liu , Peiliang Gong , Chuhang Zheng , Yiheng Liu , Qi Zhu

We present a brain-to-image system that decodes visual stimuli from EEG signals recorded during natural image viewing. Our system addresses two tasks: (1) EEG-to-image retrieval, which ranks the correct stimulus image among 200 candidates…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chi Kit Wong , Yan Liu , Haowen Yan

Decoding the human brain has been a hallmark of neuroscientists and Artificial Intelligence researchers alike. Reconstruction of visual images from brain Electroencephalography (EEG) signals has garnered a lot of interest due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Prajwal Singh , Dwip Dalal , Gautam Vashishtha , Krishna Miyapuram , Shanmuganathan Raman

Understanding how the human brain encodes and processes external visual stimuli has been a fundamental challenge in neuroscience. With advancements in artificial intelligence, sophisticated visual decoding architectures have achieved…

Human-Computer Interaction · Computer Science 2025-07-22 Jiahua Tang , Song Wang , Jiachen Zou , Chen Wei , Quanying Liu

Decoding visual features from EEG signals is a central challenge in neuroscience, with cross-modal alignment as the dominant approach. We argue that the relationship between visual and brain modalities is fundamentally asymmetric,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Lukun Wu , Jie Li , Ziqi Ren , Kaifan Zhang , Xinbo Gao

Visual stimuli reconstruction from EEG remains challenging due to fidelity loss and representation shift. We propose CognitionCapturerPro, an enhanced framework that integrates EEG with multi-modal priors (images, text, depth, and edges)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kaifan Zhang , Lihuo He , Junjie Ke , Yuqi Ji , Lukun Wu , Lizi Wang , Xinbo Gao

Decoding visual experience from brain signals offers exciting possibilities for neuroscience and interpretable AI. While EEG is accessible and temporally precise, its limitations in spatial detail hinder image reconstruction. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Arshak Rezvani , Ali Akbari , Kosar Sanjar Arani , Maryam Mirian , Emad Arasteh , Martin J. McKeown

Deciphering language from brain activity is a crucial task in brain-computer interface (BCI) research. Non-invasive cerebral signaling techniques including electroencephalography (EEG) and magnetoencephalography (MEG) are becoming…

Computation and Language · Computer Science 2025-12-29 Yiqian Yang , Hyejeong Jo , Yiqun Duan , Qiang Zhang , Jinni Zhou , Xuming Hu , Won Hee Lee , Renjing Xu , Hui Xiong

Seeing is believing, however, the underlying mechanism of how human visual perceptions are intertwined with our cognitions is still a mystery. Thanks to the recent advances in both neuroscience and artificial intelligence, we have been able…

Image and Video Processing · Electrical Eng. & Systems 2023-08-17 Yu-Ting Lan , Kan Ren , Yansen Wang , Wei-Long Zheng , Dongsheng Li , Bao-Liang Lu , Lili Qiu

The ability to perceive and recognize objects is fundamental for the interaction with the external environment. Studies that investigate them and their relationship with brain activity changes have been increasing due to the possible…

Signal Processing · Electrical Eng. & Systems 2020-08-31 Jenifer Kalafatovich , Minji Lee , Seong-Whan Lee

We propose EEG2TEXT-CN, which, to the best of our knowledge, represents one of the earliest open-vocabulary EEG-to-text generation frameworks tailored for Chinese. Built on a biologically grounded EEG encoder (NICE-EEG) and a compact…

Computation and Language · Computer Science 2025-07-09 Jacky Tai-Yu Lu , Jung Chiang , Chi-Sheng Chen , Anna Nai-Yun Tung , Hsiang Wei Hu , Yuan Chiao Cheng

Current EEG/MEG-to-text decoding systems suffer from three key limitations: (1) reliance on teacher-forcing methods, which compromises robustness during inference, (2) sensitivity to session-specific noise, hindering generalization across…

Artificial Intelligence · Computer Science 2025-08-06 Jilong Li , Zhenxi Song , Jiaqi Wang , Meishan Zhang , Honghai Liu , Min Zhang , Zhiguo Zhang

Sleep stage classification based on electroencephalography (EEG) is fundamental for assessing sleep quality and diagnosing sleep-related disorders. However, most traditional machine learning methods rely heavily on prior knowledge and…

Artificial Intelligence · Computer Science 2025-11-25 Xihe Qiu , Gengchen Ma , Haoyu Wang , Chen Zhan , Xiaoyu Tan , Shuo Li

Reconstructing dynamic visual stimuli from brain EEG recordings is challenging due to the non-stationary and noisy nature of EEG signals and the limited availability of EEG-video datasets. Prior work has largely focused on static image…

Human-Computer Interaction · Computer Science 2025-09-23 Prajwal Singh , Anupam Sharma , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

Decoding visual representations from human brain activity has emerged as a thriving research domain, particularly in the context of brain-computer interfaces. Our study presents an innovative method that employs to classify and reconstruct…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Matteo Ferrante , Tommaso Boccato , Stefano Bargione , Nicola Toschi