English
Related papers

Related papers: Decipher-MR: A Vision-Language Foundation Model fo…

200 papers

We present a new approach for representing and reconstructing multidimensional magnetic resonance imaging (MRI) data. Our method builds on a novel, learned feature-based image representation that disentangles different types of features,…

Image and Video Processing · Electrical Eng. & Systems 2026-01-01 Ruiyang Zhao , Fan Lam

In this study, we aim to initiate the development of Radiology Foundation Model, termed as RadFM. We consider the construction of foundational models from three perspectives, namely, dataset construction, model design, and thorough…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Chaoyi Wu , Xiaoman Zhang , Ya Zhang , Yanfeng Wang , Weidi Xie

Vision-language models (VLMs) have shown promise in 2D medical image analysis, but extending them to 3D remains challenging due to the high computational demands of volumetric data and the difficulty of aligning 3D spatial features with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Yu Xin , Gorkem Can Ates , Kuang Gong , Wei Shao

Motion artifacts in Magnetic Resonance Imaging (MRI) are one of the frequently occurring artifacts due to patient movements during scanning. Motion is estimated to be present in approximately 30% of clinical MRI scans; however, motion has…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Zhifeng Chen , Kamlesh Pawar , Kh Tohidul Islam , Himashi Peiris , Gary Egan , Zhaolin Chen

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

While deep learning methods have achieved impressive success in many vision benchmarks, it remains difficult to understand and explain the representations and decisions of these models. Though vision models are typically trained on 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Benjamin Beilharz , Thomas S. A. Wallis

Recent advances in artificial intelligence have witnessed the emergence of large-scale deep learning models capable of interpreting and generating both textual and imaging data. Such models, typically referred to as foundation models, are…

The challenge of Multimodal Deformable Image Registration (MDIR) lies in the conversion and alignment of features between images of different modalities. Generative models (GMs) cannot retain the necessary information enough from the source…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Mingrui Ma , Weijie Wang , Jie Ning , Jianfeng He , Nicu Sebe , Bruno Lepri

Diffusion magnetic resonance imaging (dMRI) is a crucial non-invasive technique for exploring the microstructure of the living human brain. Traditional hand-crafted and model-based tissue microstructure reconstruction methods often require…

Image and Video Processing · Electrical Eng. & Systems 2025-02-26 Xinrui Ma , Jian Cheng , Wenxin Fan , Ruoyou Wu , Yongquan Ye , Shanshan Wang

Neuroimaging is a ubiquitous tool for evaluating patients with neurological diseases. The global demand for magnetic resonance imaging (MRI) studies has risen steadily, placing significant strain on health systems, prolonging turnaround…

Vision-language models have demonstrated impressive capabilities in generating 2D images under various conditions; however, the success of these models is largely enabled by extensive, readily available pretrained foundation models.…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Mohamed Mohamed , Brennan Nichyporuk , Douglas L. Arnold , Tal Arbel

The structure of grey matter has long been a key focus in neuroscience, as cell morphology varies by type and can be affected by neurological conditions. Understanding these variations is essential for studying brain function and disease.…

Biological Physics · Physics 2025-08-27 Charlie Aird-Rossiter , Hui Zhang , Daniel C. Alexander , Derek K. Jones , Marco Palombo

Decoding non-invasive brain recordings is pivotal for advancing our understanding of human cognition but faces challenges due to individual differences and complex neural signal representations. Traditional methods often require customized…

Neural and Evolutionary Computing · Computer Science 2024-10-15 Guobin Shen , Dongcheng Zhao , Xiang He , Linghao Feng , Yiting Dong , Jihang Wang , Qian Zhang , Yi Zeng

The integration of AI-assisted biomedical image analysis into clinical practice demands AI-generated findings that are not only accurate but also interpretable to clinicians. However, existing biomedical AI models generally lack the ability…

Deep learning technologies have dramatically reshaped the field of medical image registration over the past decade. The initial developments, such as regression-based and U-Net-based networks, established the foundation for deep learning in…

Image and Video Processing · Electrical Eng. & Systems 2024-11-04 Junyu Chen , Yihao Liu , Shuwen Wei , Zhangxing Bian , Shalini Subramanian , Aaron Carass , Jerry L. Prince , Yong Du

Deep learning underlies most modern approaches and tools in computer vision, including biomedical imaging. However, for interactive semantic segmentation (often called pixel classification in this context) and interactive object-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Carolin Teuber , Anwai Archit , Tobias Boothe , Peter Ditte , Jochen Rink , Constantin Pape

In modern medical diagnostics, magnetic resonance imaging (MRI) is an important technique that provides detailed insights into anatomical structures. In this paper, we present a comprehensive methodology focusing on streamlining the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-25 Siddharth Jha , Zichen Gui , Benjamin Delbos , Richard Moreau , Arnaud Leleve , Irene Cheng

Multimodal learning, especially large-scale multimodal pre-training, has developed rapidly over the past few years and led to the greatest advances in artificial intelligence (AI). Despite its effectiveness, understanding the underlying…

Neural and Evolutionary Computing · Computer Science 2022-08-18 Haoyu Lu , Qiongyi Zhou , Nanyi Fei , Zhiwu Lu , Mingyu Ding , Jingyuan Wen , Changde Du , Xin Zhao , Hao Sun , Huiguang He , Ji-Rong Wen

We introduce SparseVM, a method that registers clinical-quality 3D MR scans both faster and more accurately than previously possible. Deformable alignment, or registration, of clinical scans is a fundamental task for many clinical…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Kathleen M. Lewis , Natalia S. Rost , John Guttag , Adrian V. Dalca

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers to learn features…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jiong Wu , Kuang Gong