English
Related papers

Related papers: Towards Neural Foundation Models for Vision: Align…

200 papers

Current electroencephalogram (EEG) decoding models are typically trained on small numbers of subjects performing a single task. Here, we introduce a large-scale, code-submission-based competition comprising two challenges. First, the…

Modelling the complex spatiotemporal patterns of large-scale brain dynamics is crucial for neuroscience, but traditional methods fail to capture the rich structure in modalities such as magnetoencephalography (MEG). Recent advances in deep…

Machine Learning · Computer Science 2025-10-22 Rukuang Huang , Sungjun Cho , Chetan Gohil , Oiwi Parker Jones , Mark Woolrich

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

Deep networks for electroencephalogram (EEG) decoding are often only trained to solve one specific task, such as pathology or age decoding. A more general task-agnostic approach is to train deep networks to match a (clinical) EEG recording…

Computation and Language · Computer Science 2025-07-30 Tidiane Camaret Ndir , Robin Tibor Schirrmeister , Tonio Ball

Decoding visual images from brain activity has significant potential for advancing brain-computer interaction and enhancing the understanding of human perception. Recent approaches align the representation spaces of images and brain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Nona Rajabi , Antônio H. Ribeiro , Miguel Vasco , Farzaneh Taleb , Mårten Björkman , Danica Kragic

Understanding neural responses to visual stimuli remains challenging due to the inherent complexity of brain representations and the modality gap between neural data and visual inputs. Existing methods, mainly based on reducing neural…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Weihang You , Hanqi Jiang , Yi Pan , Junhao Chen , Tianming Liu , Fei Dou

Human visual reconstruction aims to reconstruct fine-grained visual stimuli based on subject-provided descriptions and corresponding neural signals. As a widely adopted modality, Electroencephalography (EEG) captures rich visual cognition…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Zhijian Gong , Tianren Yao , Wenjia Dong , Xueyuan Xu

Electroencephalography (EEG) is a vital tool to measure and record brain activity in neuroscience and clinical applications, yet its potential is constrained by signal heterogeneity, low signal-to-noise ratios, and limited labeled datasets.…

Machine Learning · Computer Science 2024-09-20 Enze Shi , Kui Zhao , Qilong Yuan , Jiaqi Wang , Huawen Hu , Sigang Yu , Shu Zhang

Most previous studies integrate cognitive language processing signals (e.g., eye-tracking or EEG data) into neural models of natural language processing (NLP) just by directly concatenating word embeddings with cognitive features, ignoring…

Computation and Language · Computer Science 2023-11-15 Yuqi Ren , Deyi Xiong

Electroencephalography (EEG) is shown to be a valuable data source for evaluating subjects' mental states. However, the interpretation of multi-modal EEG signals is challenging, as they suffer from poor signal-to-noise-ratio, are highly…

Signal Processing · Electrical Eng. & Systems 2022-04-19 David Bethge , Philipp Hallgarten , Ozan Özdenizci , Ralf Mikut , Albrecht Schmidt , Tobias Grosse-Puppendahl

Electroencephalography (EEG) provides real-time insights into brain activity and supports diverse applications in neuroscience. While EEG foundation models (EFMs) have emerged to address the scalability issues of task-specific models,…

Machine Learning · Computer Science 2026-05-12 Jingying Ma , Feng Wu , Qika Lin , Yucheng Xing , Chenyu Liu , Ziyu Jia , Mengling Feng

Exploring brain activity in relation to visual perception provides insights into the biological representation of the world. While functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) have enabled effective image…

Multimedia · Computer Science 2025-12-17 Shuqi Zhu , Ziyi Ye , Qingyao Ai , Yiqun Liu

Decoding visual neural representations from Electroencephalography (EEG) signals remains a formidable challenge due to their high-dimensional, noisy, and non-Euclidean nature. In this work, we propose a Spatial-Functional Awareness…

Artificial Intelligence · Computer Science 2025-10-10 Yueming Sun , Long Yang

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Peirong Liu , Oula Puonti , Xiaoling Hu , Karthik Gopinath , Annabel Sorby-Adams , Daniel C. Alexander , W. Taylor Kimberly , Juan E. Iglesias

A core goal of functional neuroimaging is to study how the environment is processed in the brain. The mainstream paradigm involves concurrently measuring a broad spectrum of brain responses to a small set of environmental features…

Neurons and Cognition · Quantitative Biology 2021-06-14 Pedro F. da Costa , Rianne Haartsen , Elena Throm , Luke Mason , Anna Gui , Robert Leech , Emily J. H. Jones

In this work, we study the problem of cross-subject motor imagery (MI) decoding from electroencephalography (EEG) data. Multi-subject EEG datasets present several kinds of domain shifts due to various inter-individual differences (e.g.…

Signal Processing · Electrical Eng. & Systems 2024-02-22 Georgios Zoumpourlis , Ioannis Patras

We propose a fusion approach that combines features from simultaneously recorded electroencephalographic (EEG) and magnetoencephalographic (MEG) signals to improve classification performances in motor imagery-based brain-computer interfaces…

In this work, we delve into the EEG classification task in the domain of visual brain decoding via two frameworks, involving two different learning paradigms. Considering the spatio-temporal nature of EEG data, one of our frameworks is…

Human-Computer Interaction · Computer Science 2024-08-12 Akanksha Sharma , Jyoti Nigam , Abhishek Rathore , Arnav Bhavsar

PLEASE READ AND CITE THE REVISED VERSION at Human Brain Mapping: http://onlinelibrary.wiley.com/doi/10.1002/hbm.23730/full Code available here: https://github.com/robintibor/braindecode

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov
‹ Prev 1 3 4 5 6 7 10 Next ›