English
Related papers

Related papers: A Foundation Model for Brain MRI with Dynamic Moda…

200 papers

Brain decoding is a key neuroscience field that reconstructs the visual stimuli from brain activity with fMRI, which helps illuminate how the brain represents the world. fMRI-to-image reconstruction has achieved impressive progress by…

Neurons and Cognition · Quantitative Biology 2025-10-27 Guoying Sun , Weiyu Guo , Tong Shao , Yang Yang , Haijin Zeng , Jie Liu , Jingyong Su

Gliomas are one of the most prevalent types of primary brain tumours, accounting for more than 30\% of all cases and they develop from the glial stem or progenitor cells. In theory, the majority of brain tumours could well be identified…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Reza Azad , Nika Khosravi , Dorit Merhof

Accurate medical image segmentation commonly requires effective learning of the complementary information from multimodal data. However, in clinical practice, we often encounter the problem of missing imaging modalities. We tackle this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Cheng Chen , Qi Dou , Yueming Jin , Hao Chen , Jing Qin , Pheng-Ann Heng

This paper presents a simple and effective generalization method for magnetic resonance imaging (MRI) segmentation when data is collected from multiple MRI scanning sites and as a consequence is affected by (site-)domain shifts. We propose…

Image and Video Processing · Electrical Eng. & Systems 2019-10-23 Shahab Aslani , Vittorio Murino , Michael Dayan , Roger Tam , Diego Sona , Ghassan Hamarneh

Objective: This paper investigates how generative models, trained on ground-truth images, can be used \changes{as} priors for inverse problems, penalizing reconstructions far from images the generator can produce. The aim is that learned…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Margaret Duff , Ivor J. A. Simpson , Matthias J. Ehrhardt , Neill D. F. Campbell

Deep learning (DL) models for segmenting various anatomical structures have achieved great success via a static DL model that is trained in a single source domain. Yet, the static DL model is likely to perform poorly in a continually…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Xiaofeng Liu , Helen A. Shih , Fangxu Xing , Emiliano Santarnecchi , Georges El Fakhri , Jonghye Woo

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Brain encoding models aim to predict brain voxel-wise responses to stimuli images, replicating brain signals captured by neuroimaging techniques. There is a large volume of publicly available data, but training a comprehensive brain…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Huzheng Yang , Jianbo Shi , James Gee

Traditional model-based image reconstruction (MBIR) methods combine forward and noise models with simple object priors. Recent application of deep learning methods for image reconstruction provides a successful data-driven approach to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-22 Ling Chen , Zhishen Huang , Yong Long , Saiprasad Ravishankar

Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly. Accurate identification of the type and grade of tumor in the early stages plays an important role in choosing a precise…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Dunyuan Xu , Xi Wang , Jinyue Cai , Pheng-Ann Heng

Real-time decoding of target variables from multiple simultaneously recorded neural time-series modalities, such as discrete spiking activity and continuous field potentials, is important across various neuroscience applications. However, a…

Machine Learning · Computer Science 2025-12-16 Eray Erturk , Maryam M. Shanechi

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

Objective. Standard Magnetic Resonance Imaging (MRI) reconstruction pipelines discard phase information captured during acquisition, despite evidence that it encodes tissue properties relevant to tumor diagnosis. Current machine learning…

Image and Video Processing · Electrical Eng. & Systems 2026-04-17 Marco Schlimbach , Moritz Rempe , Jessica Mnischek , Lukas T. Rotkopf , Jens Weingarten , Jens Kleesiek , Kevin Kröninger

Vision foundation models like DINOv2 demonstrate remarkable potential in medical imaging despite their origin in natural image domains. However, their design inherently works best for uni-modal image analysis, limiting their effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Viktoria Ehm , Anke Meyer-Baese , Jan C. Peeken , Daniel Rueckert , Benedikt Wiestler

Deep learning-based brain tumor segmentation (BTS) models for multi-modal MRI images have seen significant advancements in recent years. However, a common problem in practice is the unavailability of some modalities due to varying scanning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Weide Liu , Jingwen Hou , Xiaoyang Zhong , Huijing Zhan , Jun Cheng , Yuming Fang , Guanghui Yue

Magnetic resonance imaging (MRI) acquisition, reconstruction, and segmentation are usually processed independently in the conventional practice of MRI workflow. It is easy to notice that there are significant relevances among these tasks…

Image and Video Processing · Electrical Eng. & Systems 2021-05-17 Zhiwen Wang , Wenjun Xia , Zexin Lu , Yongqiang Huang , Yan Liu , Hu Chen , Jiliu Zhou , Yi Zhang

Multimodal representation learning has demonstrated remarkable potential in enabling models to process and integrate diverse data modalities, such as text and images, for improved understanding and performance. While the medical domain can…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Shuvendu Roy , Franklin Ogidi , Ali Etemad , Elham Dolatabadi , Arash Afkanpour

The development of foundation models for brain MRI depends critically on the scale, diversity, and consistency of available data, yet systematic assessments of these factors remain scarce. In this study, we analyze 54 publicly accessible…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Minh Sao Khue Luu , Margaret V. Benedichuk , Ekaterina I. Roppert , Roman M. Kenzhin , Bair N. Tuchinov

Clinical MRI encompasses diverse imaging protocols--spanning anatomical targets (cardiac, brain, knee), contrasts (T1, T2, mapping), sampling patterns (Cartesian, radial, spiral, kt-space), and acceleration factors--yet current deep…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Puyang Wang , Pengfei Guo , Keyi Chai , Jinyuan Zhou , Daguang Xu , Shanshan Jiang

Brain foundation models (BFMs) have emerged as a transformative paradigm in computational neuroscience, offering a revolutionary framework for processing diverse neural signals across different brain-related tasks. These models leverage…

Machine Learning · Computer Science 2025-07-22 Xinliang Zhou , Chenyu Liu , Zhisheng Chen , Kun Wang , Yi Ding , Ziyu Jia , Qingsong Wen