English
Related papers

Related papers: A Foundation Model for Brain MRI with Dynamic Moda…

200 papers

Brain-computer interfaces (BCIs) with speech decoding from brain recordings have broad application potential in fields such as clinical rehabilitation and cognitive neuroscience. However, current decoding methods remain limited to…

Neurons and Cognition · Quantitative Biology 2025-06-05 Yi Guo , Yihang Dong , Michael Kwok-Po Ng , Shuqiang Wang

The development of foundation models for functional magnetic resonance imaging (fMRI) time series holds significant promise for predicting phenotypes related to disease and cognition. Current models, however, are often trained using a…

Machine Learning · Computer Science 2026-03-03 Sam Gijsen , Marc-Andre Schulz , Kerstin Ritter

Structural magnetic resonance imaging (sMRI) provides accurate estimates of the brain's structural organization and learning invariant brain representations from sMRI is an enduring issue in neuroscience. Previous deep representation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ning Jiang , Gongshu Wang , Tianyi Yan

Brain decoding aims to reconstruct visual perception of human subject from fMRI signals, which is crucial for understanding brain's perception mechanisms. Existing methods are confined to the single-subject paradigm due to substantial brain…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Yuqin Dai , Zhouheng Yao , Chunfeng Song , Qihao Zheng , Weijian Mai , Kunyu Peng , Shuai Lu , Wanli Ouyang , Jian Yang , Jiamin Wu

Most existing federated learning (FL) methods for medical image analysis only considered intramodal heterogeneity, limiting their applicability to multimodal imaging applications. In practice, some FL participants may possess only a subset…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hong Liu , Dong Wei , Qian Dai , Xian Wu , Yefeng Zheng , Liansheng Wang

Many functional and structural neuroimaging studies call for accurate morphometric segmentation of different brain structures starting from image intensity values of MRI scans. Current automatic (multi-) atlas-based segmentation strategies…

Image and Video Processing · Electrical Eng. & Systems 2019-09-27 Dennis Bontempi , Sergio Benini , Alberto Signoroni , Michele Svanera , Lars Muckli

The analysis of Magnetic Resonance Imaging (MRI) sequences enables clinical professionals to monitor the progression of a brain tumor. As the interest for automatizing brain volume MRI analysis increases, it becomes convenient to have each…

Image and Video Processing · Electrical Eng. & Systems 2021-06-08 Jean Pablo Vieira de Mello , Thiago M. Paixão , Rodrigo Berriel , Mauricio Reyes , Claudine Badue , Alberto F. De Souza , Thiago Oliveira-Santos

While humans excel at continual learning (CL), deep neural networks (DNNs) exhibit catastrophic forgetting. A salient feature of the brain that allows effective CL is that it utilizes multiple modalities for learning and inference, which is…

Machine Learning · Computer Science 2024-05-07 Fahad Sarfraz , Bahram Zonooz , Elahe Arani

Deep-learning-based brain magnetic resonance imaging (MRI) reconstruction methods have the potential to accelerate the MRI acquisition process. Nevertheless, the scientific community lacks appropriate benchmarks to assess MRI reconstruction…

Detection of various lesions in brain MRI is clinically critical, but challenging due to the diversity of lesions and variability in imaging conditions. Current unsupervised learning methods detect anomalies mainly through reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Tao Yang , Xiuying Wang , Hao Liu , Guanzhong Gong , Lian-Ming Wu , Yu-Ping Wang , Lisheng Wang

Anomaly detection in MRI is of high clinical value in imaging and diagnosis. Unsupervised methods for anomaly detection provide interesting formulations based on reconstruction or latent embedding, offering a way to observe properties…

Image and Video Processing · Electrical Eng. & Systems 2022-11-29 Ayantika Das , Arun Palla , Keerthi Ram , Mohanasankar Sivaprakasam

The emergence of foundation models in neuroimaging is driven by the increasing availability of large-scale and heterogeneous brain imaging datasets. Recent advances in self-supervised learning, particularly reconstruction-based objectives,…

Machine Learning · Computer Science 2025-11-04 Ruthwik Reddy Doodipala , Pankaj Pandey , Carolina Torres Rojas , Manob Jyoti Saikia , Ranganatha Sitaram

In this study we focus on the problem of joint learning of multiple differential networks with function Magnetic Resonance Imaging (fMRI) data sets from multiple research centers. As the research centers may use different scanners and…

Methodology · Statistics 2021-06-08 Hao Chen , Ying Guo , Yong He , Dong Liu , Lei Liu , Xiao-Hua Zhou

Automation of brain tumor segmentation in 3D magnetic resonance images (MRIs) is key to assess the diagnostic and treatment of the disease. In recent years, convolutional neural networks (CNNs) have shown improved results in the task.…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Laura Mora Ballestar , Veronica Vilaplana

Segmentation is one of the most important tasks in MRI medical image analysis and is often the first and the most critical step in many clinical applications. In brain MRI analysis, head segmentation is commonly used for measuring and…

Image and Video Processing · Electrical Eng. & Systems 2022-08-11 Haleh Akrami , Wenhui Cui , Anand A Joshi , Richard M. Leahy

In this work, we propose a simple transformer-based baseline for multimodal molecular representation learning, integrating three distinct modalities: SMILES strings, 2D graph representations, and 3D conformers of molecules. A key aspect of…

Machine Learning · Computer Science 2024-10-25 Andrei Manolache , Dragos Tantaru , Mathias Niepert

Brain decoding techniques are essential for understanding the neurocognitive system. Although numerous methods have been introduced in this field, accurately aligning complex external stimuli with brain activities remains a formidable…

Neurons and Cognition · Quantitative Biology 2024-07-16 Heng Huang , Lin Zhao , Zihao Wu , Xiaowei Yu , Jing Zhang , Xintao Hu , Dajiang Zhu , Tianming Liu

Machine learning using transformers has shown great potential in medical imaging, but its real-world applicability remains limited due to the scarcity of annotated data. In this study, we propose a practical framework for the few-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Mengyu Li , Guoyao Shen , Chad W. Farris , Xin Zhang

Semi-supervised learning (SSL) has become a promising direction for medical image segmentation, enabling models to learn from limited labeled data alongside abundant unlabeled samples. However, existing SSL approaches for multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Tien-Dat Chung , Ba-Thinh Lam , Thanh-Huy Nguyen , Thien Nguyen , Nguyen Lan Vi Vu , Hoang-Loc Cao , Phat Kim Huynh , Min Xu

Brain tumor detection can make the difference between life and death. Recently, deep learning-based brain tumor detection techniques have gained attention due to their higher performance. However, obtaining the expected performance of such…

Image and Video Processing · Electrical Eng. & Systems 2022-02-22 Wessam M. Salama , Ahmed Shokry