English
Related papers

Related papers: See Through Their Minds: Learning Transferable Neu…

200 papers

Understanding how the human brain encodes and processes external visual stimuli has been a fundamental challenge in neuroscience. With advancements in artificial intelligence, sophisticated visual decoding architectures have achieved…

Human-Computer Interaction · Computer Science 2025-07-22 Jiahua Tang , Song Wang , Jiachen Zou , Chen Wei , Quanying Liu

Deep convolutional neural networks (DCNNs) have demonstrated excellent performance in object recognition and have been found to share some similarities with brain visual processing. However, the substantial gap between DCNNs and human…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Zitong Lu , Yile Wang

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

When it comes to the classification of brain signals in real-life applications, the training and the prediction data are often described by different distributions. Furthermore, diverse data sets, e.g., recorded from various subjects or…

Decoding visual experiences from human brain activity remains a central challenge at the intersection of neuroscience, neuroimaging, and artificial intelligence. A critical obstacle is the inherent variability of cortical responses: neural…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Jingyang Huo , Yikai Wang , Yanwei Fu , Jianfeng Feng

Magnetic resonance imaging (MRI) is extensively used for diagnosis and image-guided therapeutics. Due to hardware, physical and physiological limitations, acquisition of high-resolution MRI data takes long scan time at high system cost, and…

Medical Physics · Physics 2018-10-17 Qing Lyu , Chenyu You , Hongming Shan , Ge Wang

Exploring the mysteries of the human brain is a long-term research topic in neuroscience. With the help of deep learning, decoding visual information from human brain activity fMRI has achieved promising performance. However, these decoding…

Neurons and Cognition · Quantitative Biology 2024-09-04 Guangyin Bao , Duoqian Miao

Magnetic resonance imaging (MRI) is indispensable for diagnosing and planning treatment in various medical conditions due to its ability to produce multi-series images that reveal different tissue characteristics. However, integrating these…

Image and Video Processing · Electrical Eng. & Systems 2024-12-11 Churan Wang , Fei Gao , Lijun Yan , Siwen Wang , Yizhou Yu , Yizhou Wang

Self-supervised learning has greatly facilitated medical image analysis by suppressing the training data requirement for real-world applications. Current paradigms predominantly rely on self-supervision within uni-modal image data, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Shaohao Rui , Lingzhi Chen , Zhenyu Tang , Lilong Wang , Mianxin Liu , Shaoting Zhang , Xiaosong Wang

Understanding how the brain represents visual information is a fundamental challenge in neuroscience and artificial intelligence. While AI-driven decoding of neural data has provided insights into the human visual system, integrating…

Neural and Evolutionary Computing · Computer Science 2025-10-07 Dongyang Li , Haoyang Qin , Mingyang Wu , Chen Wei , Quanying Liu

Brain encoding and decoding aims to understand the relationship between external stimuli and brain activities, and is a fundamental problem in neuroscience. In this article, we study latent embedding alignment for brain encoding and…

Methodology · Statistics 2026-03-24 Shuoxun Xu , Zhanhao Yan , Lexin Li

Representation learning is a widely adopted framework for learning in data-scarce environments, aiming to extract common features from related tasks. While centralized approaches have been extensively studied, decentralized methods remain…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

Electroencephalography (EEG) decoding is a challenging task due to the limited availability of labelled data. While transfer learning is a promising technique to address this challenge, it assumes that transferable data domains and task are…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Bruno Aristimunha , Raphael Y. de Camargo , Walter H. Lopez Pinaya , Sylvain Chevallier , Alexandre Gramfort , Cedric Rommel

The brain is a highly complex organ that manages many important tasks, including movement, memory and thinking. Brain-related conditions, like tumors and degenerative disorders, can be hard to diagnose and treat. Magnetic Resonance Imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Shuvashis Sarker , Shamim Rahim Refat , Faika Fairuj Preotee , Shifat Islam , Tashreef Muhammad , Mohammad Ashraful Hoque

Enabling effective brain-computer interfaces requires understanding how the human brain encodes stimuli across modalities such as visual, language (or text), etc. Brain encoding aims at constructing fMRI brain activity given a stimulus.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Subba Reddy Oota , Jashn Arora , Vijay Rowtula , Manish Gupta , Raju S. Bapi

Recent neuroimaging studies that focus on predicting brain disorders via modern machine learning approaches commonly include a single modality and rely on supervised over-parameterized models.However, a single modality provides only a…

The application of deep learning (DL) models to the decoding of cognitive states from whole-brain functional Magnetic Resonance Imaging (fMRI) data is often hindered by the small sample size and high dimensionality of these datasets.…

Image and Video Processing · Electrical Eng. & Systems 2019-07-04 Armin W. Thomas , Klaus-Robert Müller , Wojciech Samek

Neurophysiological decoding, fundamental to advancing brain-computer interface (BCI) technologies, has significantly benefited from recent advances in deep learning. However, existing decoding approaches largely remain constrained to…

Signal Processing · Electrical Eng. & Systems 2025-08-07 Di Wu , Yifei Jia , Siyuan Li , Shiqi Zhao , Jie Yang , Mohamad Sawan

Large-scale pre-trained Vision-Language Models (VLMs) have become essential for transfer learning across diverse tasks. However, adapting these models with limited few-shot data often leads to overfitting, diminishing their performance on…

Machine Learning · Computer Science 2025-03-27 Yuncheng Guo , Xiaodong Gu

In recent studies on MRI reconstruction, advances have shown significant promise for further accelerating the MRI acquisition. Most state-of-the-art methods require a large amount of fully-sampled data to optimise reconstruction models,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-04 Junwei Yang , Pietro Liò