English
Related papers

Related papers: Brain-to-Image Retrieval and Reconstruction via Mu…

200 papers

Reconstructing human dynamic visual perception from electroencephalography (EEG) signals is of great research significance since EEG's non-invasiveness and high temporal resolution. However, EEG-to-video reconstruction remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Tian-Yi Zhou , Xuan-Hao Liu , Bao-Liang Lu , Wei-Long Zheng

To be practical for real-life applications, models for brain-computer interfaces must be easily and quickly deployable on new subjects, effective on affordable scanning hardware, and small enough to run locally on accessible computing…

Neurons and Cognition · Quantitative Biology 2026-02-12 Reese Kneeland , Wangshu Jiang , Ugo Bruzadin Nunes , Paul Steven Scotti , Arnaud Delorme , Jonathan Xu

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

This paper presents an accurate and robust embedded motor-imagery brain-computer interface (MI-BCI). The proposed novel model, based on EEGNet, matches the requirements of memory footprint and computational resources of low-power…

Signal Processing · Electrical Eng. & Systems 2023-01-18 Xiaying Wang , Michael Hersche , Batuhan Tömekce , Burak Kaya , Michele Magno , Luca Benini

Deep networks for electroencephalogram (EEG) decoding are often only trained to solve one specific task, such as pathology or age decoding. A more general task-agnostic approach is to train deep networks to match a (clinical) EEG recording…

Computation and Language · Computer Science 2025-07-30 Tidiane Camaret Ndir , Robin Tibor Schirrmeister , Tonio Ball

Reconstructing dynamic visual stimuli from brain EEG recordings is challenging due to the non-stationary and noisy nature of EEG signals and the limited availability of EEG-video datasets. Prior work has largely focused on static image…

Human-Computer Interaction · Computer Science 2025-09-23 Prajwal Singh , Anupam Sharma , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

Current expressive avatar systems rely heavily on visual cues, failing when faces are occluded or when emotions remain internal. We present Mind-to-Face, the first framework that decodes non-invasive electroencephalogram (EEG) signals…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Haolin Xiong , Tianwen Fu , Pratusha Bhuvana Prasad , Yunxuan Cai , Haiwei Chen , Wenbin Teng , Hanyuan Xiao , Yajie Zhao

In this work, we delve into the EEG classification task in the domain of visual brain decoding via two frameworks, involving two different learning paradigms. Considering the spatio-temporal nature of EEG data, one of our frameworks is…

Human-Computer Interaction · Computer Science 2024-08-12 Akanksha Sharma , Jyoti Nigam , Abhishek Rathore , Arnav Bhavsar

This study examines the efficacy of various neural network (NN) models in interpreting mental constructs via electroencephalogram (EEG) signals. Through the assessment of 16 prevalent NN models and their variants across four brain-computer…

Neurons and Cognition · Quantitative Biology 2023-09-26 Xia Chen , Xiangbin Teng , Han Chen , Yafeng Pan , Philipp Geyer

Visual neural decoding aims to extract and interpret original visual experiences directly from human brain activity. Recent studies have demonstrated the feasibility of decoding visual semantic categories from electroencephalography (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hongzhou Chen , Lianghua He , Yihang Liu , Longzhen Yang , Shaohua Shang , MengChu Zhou

Due to the low signal-to-noise ratio and limited resolution of functional MRI data, and the high complexity of natural images, reconstructing a visual stimulus from human brain fMRI measurements is a challenging task. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zijin Gu , Keith Jamison , Amy Kuceyeski , Mert Sabuncu

EEG-based visual neural decoding aims to align neural responses with visual stimuli for tasks such as image retrieval. However, limited paired data and a fundamental mismatch between high-fidelity digital images and biological visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jingtao Liu , Peiliang Gong , Chuhang Zheng , Yiheng Liu , Qi Zhu

Recently, electroencephalography (EEG) signals have been actively incorporated to decode brain activity to visual or textual stimuli and achieve object recognition in multi-modal AI. Accordingly, endeavors have been focused on building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Xu Zheng , Ling Wang , Kanghao Chen , Yuanhuiyi Lyu , Jiazhou Zhou , Lin Wang

The new perspective in visual classification aims to decode the feature representation of visual objects from human brain activities. Recording electroencephalogram (EEG) from the brain cortex has been seen as a prevalent approach to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Xianglin Zheng , Zehong Cao , Quan Bai

In this study, a novel open-source brain-computer interface (BCI) platform was developed to decode scalp electroencephalography (EEG) signals associated with sustained attention. The EEG signal collection was conducted using a wireless…

Signal Processing · Electrical Eng. & Systems 2024-05-08 Maryam Norouzi , Mohammad Zaeri Amirani , Yalda Shahriari , Reza Abiri

Brain-to-Image reconstruction aims to recover visual stimuli perceived by humans from brain activity. However, the reconstructed visual stimuli often missing details and semantic inconsistencies, which may be attributed to insufficient…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Runze Xia , Shuo Feng , Renzhi Wang , Congchi Yin , Xuyun Wen , Piji Li

The reconstruction of images observed by subjects from fMRI data collected during visual stimuli has made strong progress in the past decade, thanks to the availability of extensive fMRI datasets and advancements in generative models for…

In this article we present the results of our research related to the study of correlations between specific visual stimulation and the elicited brain's electro-physiological response collected by EEG sensors from a group of participants.…

Machine Learning · Computer Science 2017-08-04 Iaroslav Omelianenko

Decoding visual information from electroencephalography (EEG) signals remains a fundamental challenge in brain-computer interfaces and medical rehabilitation. Existing EEG visual decoding methods mainly focus on learning a single global EEG…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiang Gao , Hui Tian , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

Electroencephalogram (EEG)-based Brain-Computer Interfaces (BCIs) have garnered significant interest across various domains, including rehabilitation and robotics. Despite advancements in neural network-based EEG decoding, maintaining…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Sizhen Bian , Pixi Kang , Julian Moosmann , Mengxi Liu , Pietro Bonazzi , Roman Rosipal , Michele Magno