English
Related papers

Related papers: General Vision Encoder Features as Guidance in Med…

200 papers

Medical image analysis frequently encounters data scarcity challenges. Transfer learning has been effective in addressing this issue while conserving computational resources. The recent advent of foundational models like the DINOv2, which…

Image and Video Processing · Electrical Eng. & Systems 2024-02-14 Yuning Huang , Jingchen Zou , Lanxi Meng , Xin Yue , Qing Zhao , Jianqiang Li , Changwei Song , Gabriel Jimenez , Shaowu Li , Guanghui Fu

Medical vision foundational models are used for a wide variety of tasks, including medical image segmentation and registration. This work evaluates the ability of these models to predict disease progression using a simple linear probe. We…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Basar Demir , Soumitri Chattopadhyay , Thomas Hastings Greer , Boqi Chen , Marc Niethammer

Affine registration is indispensable in a comprehensive medical image registration pipeline. However, only a few studies focus on fast and robust affine registration algorithms. Most of these studies utilize convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Tony C. W. Mok , Albert C. S. Chung

Medical image registration is an essential topic in medical image analysis. In this paper, we propose a method for medical image registration using a pretrained large language model. We find that using the pretrained large language model to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Mingrui Ma , Yu Yang

Foundation models, pre-trained on large image datasets and capable of capturing rich feature representations, have recently shown potential for zero-shot image registration. However, their performance has mostly been tested in the context…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Hanxue Gu , Yaqian Chen , Nicholas Konz , Qihang Li , Maciej A. Mazurowski

Image registration is a fundamental task in medical image analysis. Deformations are often closely related to the morphological characteristics of tissues, making accurate feature extraction crucial. Recent weakly supervised methods improve…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yue He , Min Liu , Qinghao Liu , Jiazheng Wang , Yaonan Wang , Hang Zhang , Xiang Chen

Large foundation models, known for their strong zero-shot generalization capabilities, can be applied to a wide range of downstream tasks. However, developing foundation models for medical image segmentation poses a significant challenge…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Sihan Yang , Jiadong Feng , Xuande Mi , Haixia Bi , Hai Zhang , Jian Sun

Deep learning technologies have dramatically reshaped the field of medical image registration over the past decade. The initial developments, such as regression-based and U-Net-based networks, established the foundation for deep learning in…

Image and Video Processing · Electrical Eng. & Systems 2024-11-04 Junyu Chen , Yihao Liu , Shuwen Wei , Zhangxing Bian , Shalini Subramanian , Aaron Carass , Jerry L. Prince , Yong Du

In the last decade, research on artificial intelligence has seen rapid growth with deep learning models, especially in the field of medical image segmentation. Various studies demonstrated that these models have powerful prediction…

Image and Video Processing · Electrical Eng. & Systems 2022-02-14 Dominik Müller , Iñaki Soto-Rey , Frank Kramer

Using massive datasets, foundation models are large-scale, pre-trained models that perform a wide range of tasks. These models have shown consistently improved results with the introduction of new methods. It is crucial to analyze how these…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Mobina Mansoori , Sajjad Shahabodini , Farnoush Bayatmakou , Jamshid Abouei , Konstantinos N. Plataniotis , Arash Mohammadi

We propose a semantic similarity metric for image registration. Existing metrics like euclidean distance or normalized cross-correlation focus on aligning intensity values, giving difficulties with low intensity contrast or noise. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Steffen Czolbe , Oswin Krause , Aasa Feragen

Transformer, a model comprising attention-based encoder-decoder architecture, have gained prevalence in the field of natural language processing (NLP) and recently influenced the computer vision (CV) space. The similarities between computer…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Emerald U. Henry , Onyeka Emebob , Conrad Asotie Omonhinmin

Image registration is a critical component in the applications of various medical image analyses. In recent years, there has been a tremendous surge in the development of deep learning (DL)-based medical image registration models. This…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Subrato Bharati , M. Rubaiyat Hossain Mondal , Prajoy Podder , V. B. Surya Prasath

With recent advances in computing hardware and surges of deep-learning architectures, learning-based deep image registration methods have surpassed their traditional counterparts, in terms of metric performance and inference time. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Bin Duan , Ming Zhong , Yan Yan

We present deformable unsupervised medical image registration using a randomly-initialized deep convolutional neural network (CNN) as regularization prior. Conventional registration methods predict a transformation by minimizing…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

Image registration is fundamental in medical imaging applications, such as disease progression analysis or radiation therapy planning. The primary objective of image registration is to precisely capture the deformation between two or more…

Image and Video Processing · Electrical Eng. & Systems 2024-12-23 Anna Reithmeir , Veronika Spieker , Vasiliki Sideri-Lampretsa , Daniel Rueckert , Julia A. Schnabel , Veronika A. Zimmer

The remarkable performance of the Transformer architecture in natural language processing has recently also triggered broad interest in Computer Vision. Among other merits, Transformers are witnessed as capable of learning long-range…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Reza Azad , Amirhossein Kazerouni , Moein Heidari , Ehsan Khodapanah Aghdam , Amirali Molaei , Yiwei Jia , Abin Jose , Rijo Roy , Dorit Merhof

Vision foundation models like DINOv2 demonstrate remarkable potential in medical imaging despite their origin in natural image domains. However, their design inherently works best for uni-modal image analysis, limiting their effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Viktoria Ehm , Anke Meyer-Baese , Jan C. Peeken , Daniel Rueckert , Benedikt Wiestler

Recently, we have witnessed great progress in the field of medical imaging classification by adopting deep neural networks. However, the recent advanced models still require accessing sufficiently large and representative datasets for…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Haoliang Li , YuFei Wang , Renjie Wan , Shiqi Wang , Tie-Qiang Li , Alex C. Kot

Language-supervised pre-training has proven to be a valuable method for extracting semantically meaningful features from images, serving as a foundational element in multimodal systems within the computer vision and medical imaging domains.…