English
Related papers

Related papers: Towards Neural Foundation Models for Vision: Align…

200 papers

Decoding visual information from electroencephalography (EEG) signals remains a fundamental challenge in brain-computer interfaces and medical rehabilitation. Existing EEG visual decoding methods mainly focus on learning a single global EEG…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiang Gao , Hui Tian , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

The reconstruction of 3D objects from brain signals has gained significant attention in brain-computer interface (BCI) research. Current research predominantly utilizes functional magnetic resonance imaging (fMRI) for 3D reconstruction…

Graphics · Computer Science 2025-05-06 Xia Deng , Shen Chen , Jiale Zhou , Lei Li

Encoding models have been used to assess how the human brain represents concepts in language and vision. While language and vision rely on similar concept representations, current encoding models are typically trained and tested on brain…

Computation and Language · Computer Science 2023-05-23 Jerry Tang , Meng Du , Vy A. Vo , Vasudev Lal , Alexander G. Huth

Continuous electroencephalography (EEG) is routinely used in neurocritical care to monitor seizures and other harmful brain activity, including rhythmic and periodic patterns that are clinically significant. Although deep learning methods…

Human-Computer Interaction · Computer Science 2026-01-05 Argha Kamal Samanta , Deepak Mewada , Monalisa Sarma , Debasis Samanta

Decoding images from non-invasive electroencephalographic (EEG) signals has been a grand challenge in understanding how the human brain process visual information in real-world scenarios. To cope with the issues of signal-to-noise ratio and…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Chi-Sheng Chen , Chun-Shu Wei

Decoding visual experience from brain signals offers exciting possibilities for neuroscience and interpretable AI. While EEG is accessible and temporally precise, its limitations in spatial detail hinder image reconstruction. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Arshak Rezvani , Ali Akbari , Kosar Sanjar Arani , Maryam Mirian , Emad Arasteh , Martin J. McKeown

Electroencephalogram (EEG) signals have attracted significant attention from researchers due to their non-invasive nature and high temporal sensitivity in decoding visual stimuli. However, most recent studies have focused solely on the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Kaifan Zhang , Lihuo He , Xin Jiang , Wen Lu , Di Wang , Xinbo Gao

Localizing neuronal activity in the brain, both in time and in space, is a central challenge to advance the understanding of brain function. Because of the inability of any single neuroimaging techniques to cover all aspects at once, there…

Neurons and Cognition · Quantitative Biology 2013-07-09 Yaroslav O. Halchenko , Michael Hanke , James V. Haxby , Stephen Jose Hanson , Christoph S. Herrmann

Decoding visual information from time-resolved brain recordings, such as EEG and MEG, plays a pivotal role in real-time brain-computer interfaces. However, existing approaches primarily focus on direct brain-image feature alignment and are…

Human-Computer Interaction · Computer Science 2025-11-12 Chengjian Xu , Yonghao Song , Zelin Liao , Haochuan Zhang , Qiong Wang , Qingqing Zheng

Despite advancements in artificial intelligence, object recognition models still lag behind in emulating visual information processing in human brains. Recent studies have highlighted the potential of using neural data to mimic brain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Zitong Lu , Yile Wang , Julie D. Golomb

Decoding visual stimuli from neural recordings is a critical challenge in the development of brain-computer interfaces (BCIs). Although recent EEG-based decoding approaches have made progress in tasks such as visual classification,…

Human-Computer Interaction · Computer Science 2024-12-31 Dongyang Li , Haoyang Qin , Mingyang Wu , Jiahua Tang , Yuang Cao , Chen Wei , Quanying Liu

Visual stimuli reconstruction from EEG remains challenging due to fidelity loss and representation shift. We propose CognitionCapturerPro, an enhanced framework that integrates EEG with multi-modal priors (images, text, depth, and edges)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kaifan Zhang , Lihuo He , Junjie Ke , Yuqi Ji , Lukun Wu , Lizi Wang , Xinbo Gao

Electroencephalography (EEG) and magnetoencephalography (MEG) play important and complementary roles in non-invasive brain-computer interface (BCI) decoding. However, compared to the low cost and portability of EEG, MEG is more expensive…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Zhuo Li , Shuqiang Wang

Electroencephalography (EEG) is an invaluable tool in neuroscience, offering insights into brain activity with high temporal resolution. Recent advancements in machine learning and generative modeling have catalyzed the application of EEG…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yashvir Sabharwal , Balaji Rama

Neural decoding, the process of understanding how brain activity corresponds to different stimuli, has been a primary objective in cognitive sciences. Over the past three decades, advances in functional Magnetic Resonance Imaging (fMRI) and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yanchen Wang , Adam Turnbull , Tiange Xiang , Yunlong Xu , Sa Zhou , Adnan Masoud , Shekoofeh Azizi , Feng Vankee Lin , Ehsan Adeli

Decoding neurophysiological signals into language is of great research interest within brain-computer interface (BCI) applications. Electroencephalography (EEG), known for its non-invasiveness, ease of use, and cost-effectiveness, has been…

Quantitative Methods · Quantitative Biology 2024-09-26 Yitian Tao , Yan Liang , Luoyu Wang , Yongqing Li , Qing Yang , Han Zhang

Electroencephalography (EEG) stands as a crucial tool in neuroscientific research and clinical diagnostics, providing valuable insights into the electrical activities of the brain. Traditional EEG signal processing techniques, predominantly…

Neurons and Cognition · Quantitative Biology 2024-01-12 Aryan Govil , Eric Yao , Christina R. Borao

In this work, we propose an innovative framework that integrates EEG, image, and text data, aiming to decode visual neural representations from low signal-to-noise ratio EEG signals. Specifically, we introduce text modality to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Kaili sun , Xingyu Miao , Bing Zhai , Haoran Duan , Yang Long

This thesis delves into the world of non-invasive electrophysiological brain signals like electroencephalography (EEG) and magnetoencephalography (MEG), focusing on modelling and decoding such data. The research aims to investigate what…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Richard Csaky

Addressing the question of visualising human mind could help us to find regions that are associated with observed cognition and responsible for expressing the elusive mental image, leading to a better understanding of cognitive function.…

Neurons and Cognition · Quantitative Biology 2021-02-11 Pan Wang , Rui Zhou , Shuo Wang , Ling Li , Wenjia Bai , Jialu Fan , Chunlin Li , Peter Childs , Yike Guo