English
Related papers

Related papers: Learning neuroimaging models from health system-sc…

200 papers

This paper explores training medical vision-language models (VLMs) -- where the visual and language inputs are embedded into a common space -- with a particular focus on scenarios where training data is limited, as is often the case in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Rhydian Windsor , Amir Jamaludin , Timor Kadir , Andrew Zisserman

Magnetic Resonance Imaging is a critical imaging modality in clinical diagnosis and research, yet its complexity and heterogeneity hinder scalable, generalizable machine learning. Although foundation models have revolutionized language and…

Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Iryna Hartsock , Ghulam Rasool

The widespread use of Magnetic Resonance Imaging (MRI) in combination with deep learning shows promise for many high-impact automated diagnostic and prognostic tools. However, training new models requires large amounts of labeled data, a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-24 Haoyu Dong , Yuwen Chen , Hanxue Gu , Nicholas Konz , Yaqian Chen , Qihang Li , Maciej A. Mazurowski

Multimodal language models (MLMs) show promise for clinical decision support and diagnostic reasoning, raising the prospect of end-to-end automated medical image interpretation. However, clinicians are highly selective in adopting AI tools;…

Artificial Intelligence · Computer Science 2025-08-06 Mahtab Bigverdi , Wisdom Ikezogwo , Kevin Zhang , Hyewon Jeong , Mingyu Lu , Sungjae Cho , Linda Shapiro , Ranjay Krishna

The automatic diagnosis of Parkinson's disease is in high clinical demand due to its prevalence and the importance of targeted treatment. Current clinical practice often relies on diagnostic biomarkers in QSM and NM-MRI images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Ding Shaodong , Liu Ziyang , Zhou Yijun , Liu Tao

Vision-Language Models (VLMs) facilitate medical visual question answering (MedVQA) by jointly interpreting images and text. However, existing models typically depend on large architectures and closed-set answers, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Jiayan Yang , Zhuoyu Wu , Wenqi Fang

Despite significant advancements in Large Vision-Language Models (LVLMs)' capabilities, existing pixel-grounding models operate in single-image settings, limiting their ability to perform detailed, fine-grained comparisons across multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Muntasir Wahed , Kiet A. Nguyen , Adheesh Sunil Juvekar , Xinzhuo Li , Xiaona Zhou , Vedant Shah , Tianjiao Yu , Pinar Yanardag , Ismini Lourentzou

Machine learning methods exploiting multi-parametric biomarkers, especially based on neuroimaging, have huge potential to improve early diagnosis of dementia and to predict which individuals are at-risk of developing dementia. To benchmark…

Machine Learning · Computer Science 2022-02-21 Esther E. Bron , Stefan Klein , Annika Reinke , Janne M. Papma , Lena Maier-Hein , Daniel C. Alexander , Neil P. Oxtoby

Functional magnetic resonance imaging (fMRI) is a powerful tool for investigating human brain function. However, the high cost of data acquisition and the inherent subjectivity of psychiatric rating scales often lead to datasets with small…

Machine Learning · Computer Science 2026-05-29 Jiyao Wang , Peiyu Duan , Nicha C. Dvornek , Lawrence H. Staib , Denis Sukhodolsky , Pamela Ventola , James S. Duncan

This paper presents a comprehensive and quality collection of functional human brain network data for potential research in the intersection of neuroscience, machine learning, and graph analytics. Anatomical and functional MRI images have…

Multimodal neuroimaging analysis often involves complex, modality-specific preprocessing workflows that require careful configuration, quality control, and coordination across heterogeneous toolchains. Beyond preprocessing, downstream…

Artificial Intelligence · Computer Science 2026-05-08 Lujia Zhong , Yihao Xia , Jianwei Zhang , Shuo huang , Jiaxin Yue , Mingyang Xia , Yonggang Shi

Inevitable domain and task discrepancies in real-world scenarios can impair the generalization performance of the pre-trained deep models for medical data. Therefore, we audaciously propose that we should build a general-purpose medical AI…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Huahui Yi , Ziyuan Qin , Qicheng Lao , Wei Xu , Zekun Jiang , Dequan Wang , Shaoting Zhang , Kang Li

We present VisionFM, a foundation model pre-trained with 3.4 million ophthalmic images from 560,457 individuals, covering a broad range of ophthalmic diseases, modalities, imaging devices, and demography. After pre-training, VisionFM…

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Large language models (LLMs) offer a promising pre-screening tool, improving early disease detection and providing enhanced healthcare access for underprivileged communities. The early diagnosis of various diseases continues to be a…

Artificial Intelligence · Computer Science 2025-04-10 Umakanta Maharana , Sarthak Verma , Avarna Agarwal , Prakashini Mruthyunjaya , Dwarikanath Mahapatra , Sakir Ahmed , Murari Mandal

While traditional computer vision models have historically struggled to generalize to endoscopic domains, the emergence of foundation models has shown promising cross-domain performance. In this work, we present the first large-scale study…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Leon Mayer , Tim Rädsch , Dominik Michael , Lucas Luttner , Amine Yamlahi , Evangelia Christodoulou , Patrick Godau , Marcel Knopp , Annika Reinke , Fiona Kolbinger , Lena Maier-Hein

What has happened in machine learning lately, and what does it mean for the future of medical image analysis? Machine learning has witnessed a tremendous amount of attention over the last few years. The current boom started around 2009 when…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Alexander Selvikvåg Lundervold , Arvid Lundervold

While brain-inspired artificial intelligence(AI) has demonstrated promising results, current understanding of the parallels between artificial neural networks (ANNs) and human brain processing remains limited: (1) unimodal ANN studies fail…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Yudan Ren , Xinlong Wang , Kexin Wang , Tian Xia , Zihan Ma , Zhaowei Li , Xiangrong Bi , Xiao Li , Xiaowei He

Objectives: The objectives of this narrative review are to summarize the current state of AI applications in neuroimaging for early Alzheimer's disease (AD) prediction and to highlight the potential of AI techniques in improving early AD…

Machine Learning · Computer Science 2024-06-27 Thorsten Rudroff , Oona Rainio , Riku Klén