English
Related papers

Related papers: Mapping EEG Signals to Visual Stimuli: A Deep Lear…

200 papers

A fundamental challenge in neuroscience is to understand what structure in the world is represented in spatially distributed patterns of neural activity from multiple single-trial measurements. This is often accomplished by learning a…

Neural and Evolutionary Computing · Computer Science 2020-07-01 Jesse A. Livezey , Kristofer E. Bouchard , Edward F. Chang

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

Background: Building visual encoding models to accurately predict visual responses is a central challenge for current vision-based brain-machine interface techniques. To achieve high prediction accuracy on neural signals, visual encoding…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Chi Zhang , Kai Qiao , Linyuan Wang , Li Tong , Guoen Hu , Ruyuan Zhang , Bin Yan

Most deep learning-based acoustic scene classification (ASC) approaches identify scenes based on acoustic features converted from audio clips containing mixed information entangled by polyphonic audio events (AEs). However, these approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-09 Yuanbo Hou , Siyang Song , Chuang Yu , Wenwu Wang , Dick Botteldooren

There is a correlation between adjacent channels of electroencephalogram (EEG), and how to represent this correlation is an issue that is currently being explored. In addition, due to inter-individual differences in EEG signals, this…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Jie Jiao , Meiyan Xu , Qingqing Chen , Hefan Zhou , Wangliang Zhou

The purpose of this work is to investigate the soundness and utility of a neural network-based approach as a framework for exploring the impact of image enhancement techniques on visual cortex activation. In a preliminary study, we prepare…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Valentyn Piskovskyi , Riccardo Chimisso , Sabrina Patania , Tom Foulsham , Giuseppe Vizzari , Dimitri Ognibene

Investigating the mapping between visual stimuli and neural responses in the visual cortex contributes to a deeper understanding of biological visual processing mechanisms. Most existing studies characterize this mapping by training models…

Computational Engineering, Finance, and Science · Computer Science 2025-12-01 Xing Gao , Dazhong Rong , Qinming He

Advances in neuroscience and artificial intelligence have enabled preliminary decoding of brain activity. However, despite the progress, the interpretability of neural representations remains limited. A significant challenge arises from the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Hasib Aslam , Muhammad Talal Faiz , Muhammad Imran Malik

Cross-subject variability in EEG degrades performance of current deep learning models, limiting the development of brain-computer interface (BCI). This paper proposes ISAM-MTL, which is a multi-task learning (MTL) EEG classification model…

Neural and Evolutionary Computing · Computer Science 2025-01-31 Junyan Li , Bin Hu , Zhi-Hong Guan

Due to the lack of large-scale datasets, the prevailing approach in visual sentiment analysis is to leverage models trained for object classification in large datasets like ImageNet. However, objects are sentiment neutral which hinders the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Ziad Al-Halah , Andrew Aitken , Wenzhe Shi , Jose Caballero

The brain-computer interface (BCI) establishes a non-muscle channel that enables direct communication between the human body and an external device. Electroencephalography (EEG) is a popular non-invasive technique for recording brain…

Machine Learning · Computer Science 2026-02-23 Jamal Hwaidi , Mohamed Chahine Ghanem

Recent advances in brain-inspired artificial intelligence have sought to align neural signals with visual semantics using multimodal models such as CLIP. However, existing methods often treat CLIP as a static feature extractor, overlooking…

Information Retrieval · Computer Science 2025-11-13 Jiyuan Wang , Li Zhang , Haipeng Lin , Qile Liu , Gan Huang , Ziyu Li , Zhen Liang , Xia Wu

Deep neural networks can be effective means to automatically classify aerial images but is easy to overfit to the training data. It is critical for trained neural networks to be robust to variations that exist between training and test…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Jiayun Wang , Patrick Virtue , Stella X. Yu

Decoding visual representations from human brain activity has emerged as a thriving research domain, particularly in the context of brain-computer interfaces. Our study presents an innovative method that employs to classify and reconstruct…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Matteo Ferrante , Tommaso Boccato , Stefano Bargione , Nicola Toschi

This study introduces a WaveNet-based deep learning model designed to automate the classification of intracranial electroencephalography (iEEG) signals into physiological activity, pathological (epileptic) activity, power-line noise, and…

Machine Learning · Computer Science 2026-01-14 Casper van Laar , Khubaib Ahmed

Decoding visual features from EEG signals is a central challenge in neuroscience, with cross-modal alignment as the dominant approach. We argue that the relationship between visual and brain modalities is fundamentally asymmetric,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Lukun Wu , Jie Li , Ziqi Ren , Kaifan Zhang , Xinbo Gao

A deep neural network has been successfully applied to an electroencephalogram (EEG)-based brain-computer interface. However, in most studies, the correlation between EEG channels and inter-region relationships are not well utilized,…

Human-Computer Interaction · Computer Science 2021-12-15 Hyung-Ju Ahn , Dae-Hyeok Lee

Zero-shot EEG-to-image retrieval aims to decode perceived visual content from electroencephalography (EEG) by aligning neural responses with pretrained visual representations, providing a promising route toward scalable visual neural…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lin Jiang , Qingshan She , Jiale Xu , Haiqi Xu , Duanpo Wu , Zhenzhong Kuang

Objective: To evaluate the impact on Electroencephalography (EEG) classification of different kinds of attention mechanisms in Deep Learning (DL) models. Methods: We compared three attention-enhanced DL models, the brand-new InstaGATs, an…

Signal Processing · Electrical Eng. & Systems 2020-12-03 Giulia Cisotto , Alessio Zanga , Joanna Chlebus , Italo Zoppis , Sara Manzoni , Urszula Markowska-Kaczmar

EEG signals have been reported to be informative and reliable for emotion recognition in recent years. However, the inter-subject variability of emotion-related EEG signals still poses a great challenge for the practical applications of…

Human-Computer Interaction · Computer Science 2022-04-07 Xinke Shen , Xianggen Liu , Xin Hu , Dan Zhang , Sen Song