English
Related papers

Related papers: Subject-Aware Multi-Granularity Alignment for Zero…

200 papers

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

Reconstructing visual stimuli from EEG signals is a crucial step in realizing brain-computer interfaces. In this paper, we propose a transformer-based EEG signal encoder integrating the Discrete Wavelet Transform (DWT) and the gating…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Enshang Zhang , Zhicheng Zhang , Takashi Hanakawa

Working memory (WM), denoting the information temporally stored in the mind, is a fundamental research topic in the field of human cognition. Electroencephalograph (EEG), which can monitor the electrical activity of the brain, has been…

Machine Learning · Computer Science 2024-12-03 Junfu Chen , Sirui Li , Dechang Pi

EEG-based visual decoding aims to establish a mapping between neural signals and visual semantics. However, it remains constrained by the dual challenges of severe information granularity mismatch and the low signal-to-noise ratio (SNR) of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Fan Yin , Chuhang Zheng , Peiliang Gong , Donghai Guan , Qi Zhu

EEG signals capture brain activity with high temporal and low spatial resolution, supporting applications such as neurological diagnosis, cognitive monitoring, and brain-computer interfaces. However, effective analysis is hindered by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Amirabbas Hojjati , Lu Li , Ibrahim Hameed , Anis Yazidi , Pedro G. Lind , Rabindra Khadka

Electrocardiograms (ECGs) are among the most widely used diagnostic tools for cardiovascular diseases, and a large amount of ECG data worldwide appears only in image form. However, most existing automated ECG analysis methods rely on access…

Machine Learning · Computer Science 2026-04-03 Hung Manh Pham , Jialu Tang , Aaqib Saeed , Dong Ma , Bin Zhu , Pan Zhou

This paper focuses on EEG-based visual recognition, aiming to predict the visual object class observed by a subject based on his/her EEG signals. One of the main challenges is the large variation between signals from different subjects. It…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Pilhyeon Lee , Sunhee Hwang , Seogkyu Jeon , Hyeran Byun

The electroencephalogram (EEG) is a powerful method to understand how the brain processes speech. Linear models have recently been replaced for this purpose with deep neural networks and yield promising results. In related EEG…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-25 Lies Bollens , Tom Francart , Hugo Van Hamme

Due to the scarcity of annotated data and the substantial computational costs of model, conventional tuning methods in medical image segmentation face critical challenges. Current approaches to adapting pretrained models, including…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Chenlin Xu , Lei Zhang , Lituan Wang , Xinyu Pu , Pengfei Ma , Guangwu Qian , Zizhou Wang , Yan Wang

Decoding the human brain has been a hallmark of neuroscientists and Artificial Intelligence researchers alike. Reconstruction of visual images from brain Electroencephalography (EEG) signals has garnered a lot of interest due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Prajwal Singh , Dwip Dalal , Gautam Vashishtha , Krishna Miyapuram , Shanmuganathan Raman

Electroencephalography (EEG) is an objective tool for emotion recognition and shows promising performance. However, the label scarcity problem is a main challenge in this field, which limits the wide application of EEG-based emotion…

Signal Processing · Electrical Eng. & Systems 2024-09-02 Rushuang Zhou , Weishan Ye , Zhiguo Zhang , Yanyang Luo , Li Zhang , Linling Li , Gan Huang , Yining Dong , Yuan-Ting Zhang , Zhen Liang

Motor imagery (MI) classification based on electroencephalogram (EEG) is a widely-used technique in non-invasive brain-computer interface (BCI) systems. Since EEG recordings suffer from heterogeneity across subjects and labeled data…

Signal Processing · Electrical Eng. & Systems 2024-02-16 Shadi Sartipi , Mujdat Cetin

Decoding visual information from time-resolved brain recordings, such as EEG and MEG, plays a pivotal role in real-time brain-computer interfaces. However, existing approaches primarily focus on direct brain-image feature alignment and are…

Human-Computer Interaction · Computer Science 2025-11-12 Chengjian Xu , Yonghao Song , Zelin Liao , Haochuan Zhang , Qiong Wang , Qingqing Zheng

Recently, substantial progress has been made in the area of Brain-Computer Interface (BCI) using modern machine learning techniques to decode and interpret brain signals. While Electroencephalography (EEG) has provided a non-invasive method…

Signal Processing · Electrical Eng. & Systems 2020-10-26 Nik Khadijah Nik Aznan , Amir Atapour-Abarghouei , Stephen Bonner , Jason D. Connolly , Toby P. Breckon

Electroencephalography signals (EEGs) contain rich multi-scale information crucial for understanding brain states, with potential applications in diagnosing and advancing the drug development landscape. However, extracting meaningful…

Machine Learning · Computer Science 2025-09-26 D. Darankoum , C. Habermacher , J. Volle , S. Grudinin

While the Segment Anything Model (SAM) excels in semantic segmentation for general-purpose images, its performance significantly deteriorates when applied to medical images, primarily attributable to insufficient representation of medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yiming Zhang , Tianang Leng , Kun Han , Xiaohui Xie

Zero-Shot Learning (ZSL) is achieved via aligning the semantic relationships between the global image feature vector and the corresponding class semantic descriptions. However, using the global features to represent fine-grained images may…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Yunlong Yu , Zhong Ji , Yanwei Fu , Jichang Guo , Yanwei Pang , Zhongfei Zhang

We present a novel graph-based learning of EEG representations with gradient alignment (GEEGA) that leverages multi-domain information to learn EEG representations for brain-computer interfaces. Our model leverages graph convolutional…

Human-Computer Interaction · Computer Science 2025-12-09 Prithila Angkan , Amin Jalali , Paul Hungler , Ali Etemad

Zero-shot recognition aims to classify an image by selecting the most compatible label description from a set of candidate classes without any task-specific supervision. In fine-grained settings, however, the relevant evidence often lies in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Junyi Hu , Qiji Zhou , Lei Zhang , Yue Zhang

Electroencephalography (EEG) signal decoding is a key technology that translates brain activity into executable commands, laying the foundation for direct brain-machine interfacing and intelligent interaction. To address the inherent…

Machine Learning · Computer Science 2026-01-05 Xiangrui Cai , Shaocheng Ma , Lei Cao , Jie Li , Tianyu Liu , Yilin Dong