English
Related papers

Related papers: Benchmarking transferability of SSL pretraining to…

200 papers

Masked image modeling has demonstrated great potential to eliminate the label-hungry problem of training large-scale vision Transformers, achieving impressive performance on various downstream tasks. In this work, we propose a unified view…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Zhiliang Peng , Li Dong , Hangbo Bao , Qixiang Ye , Furu Wei

Large-scale pre-trained models, such as Vision Foundation Models (VFMs), have demonstrated impressive performance across various downstream tasks by transferring generalized knowledge, especially when target data is limited. However, their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Pengchen Liang , Haishan Huang , Bin Pu , Jianguo Chen , Xiang Hua , Jing Zhang , Weibo Ma , Zhuangzhuang Chen , Yiwei Li , Qing Chang

Purpose: The scarcity of high-quality curated labeled medical training data remains one of the major limitations in applying artificial intelligence (AI) systems to breast cancer diagnosis. Deep models for mammogram analysis and mass (or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Han Chen , Anne L. Martel

This work proposes a semantic segmentation network that produces high-quality uncertainty estimates in a single forward pass. We exploit general representations from foundation models and unlabelled datasets through a Masked Image Modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 David S. W. Williams , Matthew Gadd , Paul Newman , Daniele De Martini

In the era of information explosion, efficiently leveraging large-scale unlabeled data while minimizing the reliance on high-quality pixel-level annotations remains a critical challenge in the field of medical imaging. Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Hongjie Zhu , Xiwei Liu , Rundong Xue , Zeyu Zhang , Yong Xu , Daji Ergu , Ying Cai , Yang Zhao

Segmenting tumors in histological images is vital for cancer diagnosis. While fully supervised models excel with pixel-level annotations, creating such annotations is labor-intensive and costly. Accurate histopathology image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yinsheng He , Xingyu Li , Roger J. Zemp

Pre-trained vision transformers have strong representation benefits to various downstream tasks. Recently, many parameter-efficient fine-tuning (PEFT) methods have been proposed, and their experiments demonstrate that tuning only 1\% extra…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Henry Hengyuan Zhao , Pichao Wang , Yuyang Zhao , Hao Luo , Fan Wang , Mike Zheng Shou

The limited availability of labeled data has driven advancements in semi-supervised learning for medical image segmentation. Modern large-scale models tailored for general segmentation, such as the Segment Anything Model (SAM), have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Kaiwen Huang , Tao Zhou , Huazhu Fu , Yizhe Zhang , Yi Zhou , Chen Gong , Dong Liang

Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yucheng Tang , Dong Yang , Wenqi Li , Holger Roth , Bennett Landman , Daguang Xu , Vishwesh Nath , Ali Hatamizadeh

Self-supervised learning (SSL) has rapidly emerged as a transformative approach in computer vision, enabling the extraction of rich feature representations from vast amounts of unlabeled data and reducing reliance on costly manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Nikolaos Giakoumoglou , Tania Stathaki , Athanasios Gkelias

MRI and CT are essential clinical cross-sectional imaging techniques for diagnosing complex conditions. However, large 3D datasets with annotations for deep learning are scarce. While methods like DINOv2 are encouraging for 2D image…

Image and Video Processing · Electrical Eng. & Systems 2025-07-10 Gustav Müller-Franzes , Firas Khader , Robert Siepmann , Tianyu Han , Jakob Nikolas Kather , Sven Nebelung , Daniel Truhn

Masked image modeling (MIM) methods typically operate in either raw pixel space (reconstructing masked patches) or latent feature space (aligning with a pre-trained teacher). We present MEDiC (Multi-objective Exploration of Distillation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Konstantinos Georgiou , Maofeng Tang , Hairong Qi

This study addresses the essential task of medical image segmentation, which involves the automatic identification and delineation of anatomical structures and pathological regions in medical images. Accurate segmentation is crucial in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Seyedeh Sahar Taheri Otaghsara , Reza Rahmanzadeh

Self-supervised learning (SSL) has achieved remarkable success across various speech-processing tasks. To enhance its efficiency, previous works often leverage the use of compression techniques. A notable recent attempt is DPHuBERT, which…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-27 Luca Zampierin , Ghouthi Boukli Hacene , Bac Nguyen , Mirco Ravanelli

Supervised deep learning methods have achieved considerable success in medical image analysis, owing to the availability of large-scale and well-annotated datasets. However, creating such datasets for whole slide images (WSIs) in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Hao Wang , Euijoon Ahn , Jinman Kim

Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 András Kalapos , Bálint Gyires-Tóth

The deployment of foundation models for medical imaging has demonstrated considerable success. However, their training overheads associated with downstream tasks remain substantial due to the size of the image encoders employed, and the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Chengxi Zeng , Yuxuan Jiang , Fan Zhang , Alberto Gambaruto , Tilo Burghardt

Segment Anything Model 2 (SAM 2), a prompt-driven foundation model extending SAM to both image and video domains, has shown superior zero-shot performance compared to its predecessor. Building on SAM's success in medical image segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Bin Xie , Hao Tang , Yan Yan , Gady Agam

The computer-assisted radiologic informative report is currently emerging in dental practice to facilitate dental care and reduce time consumption in manual panoramic radiographic interpretation. However, the amount of dental radiographs…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Amani Almalki , Longin Jan Latecki

Adapter based fine-tuning has been studied for improving the performance of SAM on downstream tasks. However, there is still a significant performance gap between fine-tuned SAMs and domain-specific models. To reduce the gap, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Yang Yu , Chen Xu , Kai Wang