English
Related papers

Related papers: Alljoined1 -- A dataset for EEG-to-Image decoding

200 papers

Decoding visual experience from brain signals offers exciting possibilities for neuroscience and interpretable AI. While EEG is accessible and temporally precise, its limitations in spatial detail hinder image reconstruction. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Arshak Rezvani , Ali Akbari , Kosar Sanjar Arani , Maryam Mirian , Emad Arasteh , Martin J. McKeown

Emotion is an intricate physiological response that plays a crucial role in how we respond and cooperate with others in our daily affairs. Numerous experiments have been evolved to recognize emotion, however still require exploration to…

Human-Computer Interaction · Computer Science 2023-11-20 Danastan Tasaouf Mridula , Abu Ahmed Ferdaus , Tanmoy Sarkar Pias

Most research decoding brain signals into images, often using them as priors for generative models, has focused only on visual content. This overlooks the brain's natural ability to integrate auditory and visual information, for instance,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Jianxiong Gao , Yichang Liu , Baofeng Yang , Jianfeng Feng , Yanwei Fu

Reconstructions of visual perception from brain activity have improved tremendously, but the practical utility of such methods has been limited. This is because such models are trained independently per subject where each subject requires…

Classifying EEG data is integral to the performance of Brain Computer Interfaces (BCI) and their applications. However, external noise often obstructs EEG data due to its biological nature and complex data collection process. Especially…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Eric Modesitt , Ruiqi Yang , Qi Liu

Decoding images from non-invasive electroencephalographic (EEG) signals has been a grand challenge in understanding how the human brain process visual information in real-world scenarios. To cope with the issues of signal-to-noise ratio and…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Chi-Sheng Chen , Chun-Shu Wei

The incorporation of neuroimaging techniques such as electroenchephalography (EEG) and functional near-infrared spectroscopy (fNIRS) has provided new opportunities for the analysis of dynamic brain processes involved in cognitive and motor…

Neurons and Cognition · Quantitative Biology 2026-03-25 Zaineb Ajra , Grégoire Vergotte , Stéphane Perrey , Lilian Evra , Simon Pla , Gérard Dray , Jacky Montmain , Binbin Xu

Cognitive brain imaging is accumulating datasets about the neural substrate of many different mental processes. Yet, most studies are based on few subjects and have low statistical power. Analyzing data across studies could bring more…

Machine Learning · Statistics 2021-05-20 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

Decoding visual stimuli from neural population activity is crucial for understanding the brain and for applications in brain-machine interfaces. However, such biological data is often scarce, particularly in primates or humans, where…

Machine Learning · Computer Science 2025-10-24 Jan Sobotka , Luca Baroni , Ján Antolík

Decoding visual information from electroencephalography (EEG) has recently achieved promising results, primarily focusing on reconstructing two-dimensional (2D) images from brain activity. However, the reconstruction of three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

EEG-based neural decoding requires large-scale benchmark datasets. Paired brain-language data across speaking, listening, and reading modalities are essential for aligning neural activity with the semantic representation of large language…

Signal Processing · Electrical Eng. & Systems 2025-08-07 Sitong Chen , Beiqianyi Li , Cuilin He , Dongyang Li , Mingyang Wu , Xinke Shen , Song Wang , Xuetao Wei , Xindi Wang , Haiyan Wu , Quanying Liu

Information retrieval from brain responses to auditory and visual stimuli has shown success through classification of song names and image classes presented to participants while recording EEG signals. Information retrieval in the form of…

Sound · Computer Science 2022-07-29 Adolfo G. Ramirez-Aristizabal , Chris Kello

Deep learning based neural decoding from stereotactic electroencephalography (sEEG) would likely benefit from scaling up both dataset and model size. To achieve this, combining data across multiple subjects is crucial. However, in sEEG…

Robust decoding and classification of brain patterns measured with electroencephalography (EEG) remains a major challenge for real-world (i.e. outside scientific lab and medical facilities) brain-computer interface (BCI) applications due to…

Neurons and Cognition · Quantitative Biology 2025-12-03 Paul Barbaste , Olivier Oullier , Xavier Vasques

Visual stimuli reconstruction from EEG remains challenging due to fidelity loss and representation shift. We propose CognitionCapturerPro, an enhanced framework that integrates EEG with multi-modal priors (images, text, depth, and edges)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kaifan Zhang , Lihuo He , Junjie Ke , Yuqi Ji , Lukun Wu , Lizi Wang , Xinbo Gao

Electroencephalography (EEG) signals reflect activities on certain brain areas. Effective classification of time-varying EEG signals is still challenging. First, EEG signal processing and feature engineering are time-consuming and highly…

Human-Computer Interaction · Computer Science 2019-08-27 Xiang Zhang , Lina Yao , Xianzhi Wang , Wenjie Zhang , Shuai Zhang , Yunhao Liu

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

To be practical for real-life applications, models for brain-computer interfaces must be easily and quickly deployable on new subjects, effective on affordable scanning hardware, and small enough to run locally on accessible computing…

Neurons and Cognition · Quantitative Biology 2026-02-12 Reese Kneeland , Wangshu Jiang , Ugo Bruzadin Nunes , Paul Steven Scotti , Arnaud Delorme , Jonathan Xu

Decoding visual information from electroencephalography (EEG) signals remains a fundamental challenge in brain-computer interfaces and medical rehabilitation. Existing EEG visual decoding methods mainly focus on learning a single global EEG…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiang Gao , Hui Tian , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

Over recent decades, neuroimaging tools, particularly electroencephalography (EEG), have revolutionized our understanding of the brain and its functions. EEG is extensively used in traditional brain-computer interface (BCI) systems due to…

Neurons and Cognition · Quantitative Biology 2026-05-12 Zaineb Ajra , Binbin Xu , Gérard Dray , Jacky Montmain , Stéphane Perrey