English
Related papers

Related papers: Multi-task Collaborative Pre-training and Individu…

200 papers

Research efforts for visual decoding from fMRI signals have attracted considerable attention in research community. Still multi-subject fMRI decoding with one model has been considered intractable due to the drastic variations in fMRI…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Inhwa Han , Jaayeon Lee , Jong Chul Ye

Machine Learning (ML) is increasingly being used for computer aided diagnosis of brain related disorders based on structural magnetic resonance imaging (MRI) data. Most of such work employs biologically and medically meaningful hand-crafted…

Machine Learning · Computer Science 2018-05-04 Ayush Jaiswal , Dong Guo , Cauligi S. Raghavendra , Paul Thompson

In this work we introduce a self-supervised pretraining framework for transformers on functional Magnetic Resonance Imaging (fMRI) data. First, we pretrain our architecture on two self-supervised tasks simultaneously to teach the model a…

Machine Learning · Computer Science 2023-05-17 Sean Paulsen , Michael Casey

Multi-modal MRIs are widely used in neuroimaging applications since different MR sequences provide complementary information about brain structures. Recent works have suggested that multi-modal deep learning analysis can benefit from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Jiahong Ouyang , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao , Greg Zaharchuk

Multi-site MRI studies often suffer from site-specific variations arising from differences in methodology, hardware, and acquisition protocols, thereby compromising accuracy and reliability in clinical AI/ML tasks. We present PRISM…

Image and Video Processing · Electrical Eng. & Systems 2024-11-12 Sarang Galada , Tanurima Halder , Kunal Deo , Ram P Krish , Kshitij Jadhav

Reconstructing visual stimulus (image) only from human brain activity measured with functional Magnetic Resonance Imaging (fMRI) is a significant and meaningful task in Human-AI collaboration. However, the inconsistent distribution and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Ziqi Ren , Jie Li , Xuetong Xue , Xin Li , Fan Yang , Zhicheng Jiao , Xinbo Gao

The connection between brain activity and corresponding visual stimuli is crucial in comprehending the human brain. While deep generative models have exhibited advancement in recovering brain recordings by generating images conditioned on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xuelin Qian , Yikai Wang , Yanwei Fu , Xinwei Sun , Xiangyang Xue , Jianfeng Feng

Current fMRI foundation models primarily rely on a limited range of brain states and mismatched pretraining tasks, restricting their ability to learn generalized representations across diverse brain states. We present \textit{Brain-DiT}, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Junfeng Xia , Wenhao Ye , Xuanye Pan , Xinke Shen , Mo Wang , Quanying Liu

Understanding how large-scale functional brain networks reorganize during cognitive decline remains a central challenge in neuroimaging. While recent self-supervised models have shown promise for learning representations from resting-state…

Machine Learning · Computer Science 2026-03-03 Karanpartap Singh , Adam Turnbull , Mohammad Abbasi , Kilian Pohl , Feng Vankee Lin , Ehsan Adeli

Deep convolutional neural networks (DCNNs) have demonstrated excellent performance in object recognition and have been found to share some similarities with brain visual processing. However, the substantial gap between DCNNs and human…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Zitong Lu , Yile Wang

Brain tumor segmentation is often based on multiple magnetic resonance imaging (MRI). However, in clinical practice, certain modalities of MRI may be missing, which presents a more difficult scenario. To cope with this challenge, Knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Tianyi Liu , Zhaorui Tan , Muyin Chen , Xi Yang , Haochuan Jiang , Kaizhu Huang

Functional connectivity (FC) derived from resting-state fMRI plays a critical role in personalized predictions such as age and cognitive performance. However, applying foundation models(FM) to fMRI data remains challenging due to its high…

Neurons and Cognition · Quantitative Biology 2025-08-26 Yanwen Wang , Xinglin Zhao , Yijin Song , Xiaobo Liu , Yanrong Hao , Rui Cao , Xin Wen

Recently, deep neural networks have greatly advanced undersampled Magnetic Resonance Image (MRI) reconstruction, wherein most studies follow the one-anatomy-one-network fashion, i.e., each expert network is trained and evaluated for a…

Image and Video Processing · Electrical Eng. & Systems 2022-06-17 Jiangpeng Yan , Chenghui Yu , Hanbo Chen , Zhe Xu , Junzhou Huang , Xiu Li , Jianhua Yao

A fundamental challenge in embodied AI is verifying if agents build internal models of spatial structure or merely learn to mimic task-specific expert trajectories. This is critical as foundational approaches rooted in action-centric tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jinzhou Tang , Sidi Liu , Waikit Xiu , Weixing Chen , Keze Wang

Reconstructing visual stimuli from human brain activity (e.g., fMRI) bridges neuroscience and computer vision by decoding neural representations. However, existing methods often overlook critical brain structure-function relationships,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Sijin Yu , Zijiao Chen , Wenxuan Wu , Shengxian Chen , Zhongliang Liu , Jingxin Nie , Xiaofen Xing , Xiangmin Xu , Xin Zhang

The scarcity of annotated medical images is a major bottleneck in developing learning models for medical image analysis. Hence, recent studies have focused on pretrained models with fewer annotation requirements that can be fine-tuned for…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jonghun Kim , Mansu Kim , Hyunjin Park

Deciphering how visual stimuli are transformed into cortical responses is a fundamental challenge in computational neuroscience. This visual-to-neural mapping is inherently a one-to-many relationship, as identical visual inputs reliably…

Machine Learning · Computer Science 2025-11-04 Weijian Mai , Jiamin Wu , Yu Zhu , Zhouheng Yao , Dongzhan Zhou , Andrew F. Luo , Qihao Zheng , Wanli Ouyang , Chunfeng Song

Alzheimer's disease is a progressive neurodegenerative disorder in which mild cognitive impairment (MCI) marks a critical transition between aging and dementia. Neuroimaging modalities, such as structural MRI, provide biomarkers of this…

Machine Learning · Computer Science 2026-03-02 Vrushank Ahire , Yogesh Kumar , Anouck Girard , M. A. Ganaie

Magnetic Resonance Imaging (MRI) is a principal diagnostic approach used in the field of radiology to create images of the anatomical and physiological structure of patients. MRI is the prevalent medical imaging practice to find…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Yusuf Brima , Mossadek Hossain Kamal Tushar , Upama Kabir , Tariqul Islam

In large-scale distributed scenarios, increasingly complex tasks demand more intelligent collaboration across networks, requiring the joint extraction of structural representations from data samples. However, conventional task-specific…

Machine Learning · Computer Science 2026-04-21 Zhuojun Tian , Chaouki Ben Issaid , Mehdi Bennis