English
Related papers

Related papers: Toward Next-generation Medical Vision Backbones: M…

200 papers

Convolutional neural networks (CNNs) and vision transformers (ViTs) are widely employed for medical image segmentation, but they are still challenged by their intrinsic characteristics. CNNs are limited from capturing varying-scaled…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Jin Yang , Daniel S. Marcus , Aristeidis Sotiras

Deep learning models, specifically convolutional neural networks, have transformed the landscape of image classification by autonomously extracting features directly from raw pixel data. This article introduces an innovative image…

Image and Video Processing · Electrical Eng. & Systems 2024-12-19 Fatemeh Froughirad , Reza Bakhoda Eshtivani , Hamed Khajavi , Amir Rastgoo

Existing image-to-image transformation approaches primarily focus on synthesizing visually pleasing data. Generating images with correct identity labels is challenging yet much less explored. It is even more challenging to deal with image…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Wei Xiong , Yutong He , Yixuan Zhang , Wenhan Luo , Lin Ma , Jiebo Luo

Recent research has shown that CLIP models struggle with visual reasoning tasks that require grounding compositionality, understanding spatial relationships, or capturing fine-grained details. One natural hypothesis is that the CLIP vision…

Machine Learning · Computer Science 2025-07-23 Siting Li , Pang Wei Koh , Simon Shaolei Du

The deformable registration of images of different modalities, essential in many medical imaging applications, remains challenging. The main challenge is developing a robust measure for image overlap despite the compared images capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Joel Honkamaa , Pekka Marttinen

The application of deep learning-based architecture has seen a tremendous rise in recent years. For example, medical image classification using deep learning achieved breakthrough results. Convolutional Neural Networks (CNNs) are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Ganga Prasad Basyal , David Zeng , Bhaskar Pm Rimal

In the field of multi-organ medical image segmentation, recent methods frequently employ Transformers to capture long-range dependencies from image features. However, these methods overlook the high computational cost of Transformers and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Dayu Tan , Cheng Kong , Yansen Su , Hai Chen , Dongliang Yang , Junfeng Xia , Chunhou Zheng

Masked Image Modeling (MIM) has emerged as a promising method for deriving visual representations from unlabeled image data by predicting missing pixels from masked portions of images. It excels in region-aware learning and provides strong…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yibing Wei , Abhinav Gupta , Pedro Morgado

The integration of deep learning based systems in clinical practice is often impeded by challenges rooted in limited and heterogeneous medical datasets. In addition, the field has increasingly prioritized marginal performance gains on a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Sebastian Doerrich , Francesco Di Salvo , Julius Brockmann , Christian Ledig

While machine learning is currently transforming the field of histopathology, the domain lacks a comprehensive evaluation of state-of-the-art models based on essential but complementary quality requirements beyond a mere classification…

Image and Video Processing · Electrical Eng. & Systems 2023-05-11 Maximilian Springenberg , Annika Frommholz , Markus Wenzel , Eva Weicken , Jackie Ma , Nils Strodthoff

Medical image segmentation is a fundamental task for medical image analysis and surgical planning. In recent years, UNet-based networks have prevailed in the field of medical image segmentation. However, convolution-neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xin You , Junjun He , Jie Yang , Yun Gu

Vision transformers have been successfully applied to image recognition tasks due to their ability to capture long-range dependencies within an image. However, there are still gaps in both performance and computational cost between…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Jianyuan Guo , Kai Han , Han Wu , Yehui Tang , Xinghao Chen , Yunhe Wang , Chang Xu

Today, deep convolutional neural networks (CNNs) have demonstrated state of the art performance for supervised medical image segmentation, across various imaging modalities and tasks. Despite early success, segmentation networks may still…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Rosana El Jurdi , Caroline Petitjean , Paul Honeine , Veronika Cheplygina , Fahed Abdallah

Deformable image registration is a fundamental requirement for medical image analysis. Recently, transformers have been widely used in deep learning-based registration methods for their ability to capture long-range dependency via…

Image and Video Processing · Electrical Eng. & Systems 2024-12-25 Mingyuan Meng , Michael Fulham , Lei Bi , Jinman Kim

Deep models, such as convolutional neural networks (CNNs) and vision transformer (ViT), demonstrate remarkable performance in image classification. However, those deep models require large data to fine-tune, which is impractical in the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yihang Wu , Muhammad Owais , Reem Kateb , Ahmad Chaddad

Medical imaging plays a vital role in modern diagnostics; however, interpreting high-resolution radiological data remains time-consuming and susceptible to variability among clinicians. Traditional image processing techniques often lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Melika Filvantorkaman , Maral Filvan Torkaman

The pretrain-finetune paradigm is a classical pipeline in visual learning. Recent progress on unsupervised pretraining methods shows superior transfer performance to their supervised counterparts. This paper revisits this phenomenon and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yizhou Wang , Shixiang Tang , Feng Zhu , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

Training a deep convolutional neural network (CNN) from scratch is difficult because it requires a large amount of labeled training data and a great deal of expertise to ensure proper convergence. A promising alternative is to fine-tune a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-05 Nima Tajbakhsh , Jae Y. Shin , Suryakanth R. Gurudu , R. Todd Hurst , Christopher B. Kendall , Michael B. Gotway , Jianming Liang

Masked Image Modeling (MIM) achieves outstanding success in self-supervised representation learning. Unfortunately, MIM models typically have huge computational burden and slow learning process, which is an inevitable obstacle for their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Haoqing Wang , Yehui Tang , Yunhe Wang , Jianyuan Guo , Zhi-Hong Deng , Kai Han

Recent studies have underscored the capabilities of natural imaging foundation models to serve as powerful feature extractors, even in a zero-shot setting for medical imaging data. Most commonly, a shallow multi-layer perceptron (MLP) is…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Johannes Kiechle , Daniel M. Lang , Stefan M. Fischer , Lina Felsner , Jan C. Peeken , Julia A. Schnabel