English
Related papers

Related papers: Large-scale Multi-sequence Pretraining for General…

200 papers

Recent advances in deep learning have led to robust automated tools for segmentation of abdominal computed tomography (CT). Meanwhile, segmentation of magnetic resonance imaging (MRI) is substantially more challenging due to the inherent…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Deepa Krishnaswamy , Cosmin Ciausu , Steve Pieper , Ron Kikinis , Benjamin Billot , Andrey Fedorov

Designing protein sequences that fold into a target 3-D structure, termed as the inverse folding problem, is central to protein engineering. However, it remains challenging due to the vast sequence space and the importance of local…

Quantitative Methods · Quantitative Biology 2026-03-17 Sazan Mahbub , Souvik Kundu , Eric P. Xing

Purpose: To accelerate MRI acquisition by incorporating the previous scans of a subject during reconstruction. Although longitudinal imaging constitutes much of clinical MRI, leveraging previous scans is challenging due to the complex…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Yonatan Urman , Zachary Shah , Ashwin Kumar , Bruno P. Soares , Kawin Setsompop

Statistical shape modeling (SSM) is an enabling quantitative tool to study anatomical shapes in various medical applications. However, directly using 3D images in these applications still has a long way to go. Recent deep learning methods…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Abu Zahid Bin Aziz , Jadie Adams , Shireen Elhabian

Visual instruction tuning adapts pre-trained Multimodal Large Language Models (MLLMs) to follow human instructions for real-world applications. However, the rapid growth of these datasets introduces significant redundancy, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Jinhe Bi , Aniri , Yifan Wang , Danqi Yan , Wenke Huang , Zengjie Jin , Xiaowen Ma , Sikuan Yan , Artur Hecker , Mang Ye , Xun Xiao , Hinrich Schuetze , Volker Tresp , Yunpu Ma

Magnetic Resonance Imaging (MRI) is a principal diagnostic approach used in the field of radiology to create images of the anatomical and physiological structure of patients. MRI is the prevalent medical imaging practice to find…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Yusuf Brima , Mossadek Hossain Kamal Tushar , Upama Kabir , Tariqul Islam

Deep learning models trained with large amounts of data have become a recent and effective approach to predictive problem solving -- these have become known as "foundation models" as they can be used as fundamental tools for other…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 José Guilherme de Almeida , Nuno M. Rodrigues , Sara Silva , Nickolas Papanikolaou

The automatic identification of Magnetic Resonance Imaging (MRI) sequences can streamline clinical workflows by reducing the time radiologists spend manually sorting and identifying sequences, thereby enabling faster diagnosis and treatment…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Yuli Wang , Kritika Iyer , Sep Farhand , Yoshihisa Shinagawa

We introduce PRISM (Predictive Reasoning in Sequential Medicine), a transformer-based architecture designed to model the sequential progression of clinical decision-making processes. Unlike traditional approaches that rely on isolated…

Computation and Language · Computer Science 2025-06-16 Lionel Levine , John Santerre , Alex S. Young , T. Barry Levine , Francis Campion , Majid Sarrafzadeh

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

The quantity and quality of muscles are increasingly recognized as important predictors of health outcomes. While MRI offers a valuable modality for such assessments, obtaining precise quantitative measurements of musculature remains…

Recent advances in multi-modal Large Language Models (M-LLMs) have demonstrated a powerful ability to synthesize implicit information from disparate sources, including images and text. These resourceful data from social media also introduce…

Cryptography and Security · Computer Science 2025-11-11 Junhao Li , Jiahao Chen , Zhou Feng , Chunyi Zhou

Current fMRI foundation models primarily rely on a limited range of brain states and mismatched pretraining tasks, restricting their ability to learn generalized representations across diverse brain states. We present \textit{Brain-DiT}, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Junfeng Xia , Wenhao Ye , Xuanye Pan , Xinke Shen , Mo Wang , Quanying Liu

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

Clinical MRI encompasses diverse imaging protocols--spanning anatomical targets (cardiac, brain, knee), contrasts (T1, T2, mapping), sampling patterns (Cartesian, radial, spiral, kt-space), and acceleration factors--yet current deep…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Puyang Wang , Pengfei Guo , Keyi Chai , Jinyuan Zhou , Daguang Xu , Shanshan Jiang

Frontier artificial intelligence (AI) models, such as OpenAI's GPT-5 and Meta's DINOv3, have advanced rapidly through training on internet-scale public data, yet such systems lack access to private clinical data. Neuroimaging, in…

Magnetic resonance imaging (MRI) is a crucial tool to identify brain abnormalities in a wide range of neurological disorders. In focal epilepsy MRI is used to identify structural cerebral abnormalities. For covert lesions, machine learning…

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Salah Ghamizi , Georgia Kanli , Yu Deng , Magali Perquin , Olivier Keunen

The segmentation of lesions in Moderate to Severe Traumatic Brain Injury (msTBI) presents a significant challenge in neuroimaging due to the diverse characteristics of these lesions, which vary in size, shape, and distribution across brain…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Constantin Ulrich , Tassilo Wald , Fabian Isensee , Klaus H. Maier-Hein

Deep generative models have emerged as a transformative tool in medical imaging, offering substantial potential for synthetic data generation. However, recent empirical studies highlight a critical vulnerability: these models can memorize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Antonio Scardace , Lemuel Puglisi , Francesco Guarnera , Sebastiano Battiato , Daniele Ravì