English
Related papers

Related papers: Self-Supervised Pre-Training with Contrastive and …

200 papers

Deep learning is the state-of-the-art for medical imaging tasks, but requires large, labeled datasets. For risk prediction, large datasets are rare since they require both imaging and follow-up (e.g., diagnosis codes). However, the release…

Image and Video Processing · Electrical Eng. & Systems 2023-06-16 Yanru Chen , Michael T Lu , Vineet K Raghu

We investigate the utility of pretraining by contrastive self supervised learning on both natural-scene and medical imaging datasets when the unlabeled dataset size is small, or when the diversity within the unlabeled set does not lead to…

Image and Video Processing · Electrical Eng. & Systems 2021-09-07 Ozan Ciga , Tony Xu , Anne L. Martel

Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed…

Machine Learning · Computer Science 2023-09-07 Blake VanBerlo , Jesse Hoey , Alexander Wong

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Salma Haidar , José Oramas

Accurate tooth identification and segmentation in Cone Beam Computed Tomography (CBCT) dental images can significantly enhance the efficiency and precision of manual diagnoses performed by dentists. However, existing segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Pengyu Dai , Yafei Ou , Yuqiao Yang , Yang Liu , Yue Zhao

Deep learning has demonstrated significant improvements in medical image segmentation using a sufficiently large amount of training data with manual labels. Acquiring well-representative labels requires expert knowledge and exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Jinxi Xiang , Zhuowei Li , Wenji Wang , Qing Xia , Shaoting Zhang

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Self-supervised pretraining methods with masked prediction demonstrate remarkable within-dataset performance in skeleton-based action recognition. However, we show that, unlike contrastive learning approaches, they do not produce…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Soroush Mehraban , Mohammad Javad Rajabi , Andrea Iaboni , Babak Taati

Medical image segmentation is a fundamental and critical step in many image-guided clinical approaches. Recent success of deep learning-based segmentation methods usually relies on a large amount of labeled data, which is particularly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Rushi Jiao , Yichi Zhang , Le Ding , Rong Cai , Jicong Zhang

Self-supervised learning has emerged as a powerful tool for pretraining deep networks on unlabeled data, prior to transfer learning of target tasks with limited annotation. The relevance between the pretraining pretext and target tasks is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tianwei Zhang , Dong Wei , Mengmeng Zhu , Shi Gu , Yefeng Zheng

While transformers have surpassed convolutional neural networks (CNNs) in various computer vision tasks, microelectronics defect detection still largely relies on CNNs. We hypothesize that this gap is due to the fact that a) transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Nikolai Röhrich , Alwin Hoffmann , Richard Nordsieck , Emilio Zarbali , Alireza Javanmardi

Machine learning has revolutionized the modeling of clinical timeseries data. Using machine learning, a Deep Neural Network (DNN) can be automatically trained to learn a complex mapping of its input features for a desired task. This is…

Machine Learning · Computer Science 2024-10-15 Ryan King , Shivesh Kodali , Conrad Krueger , Tianbao Yang , Bobak J. Mortazavi

Segmentation is one of the most important tasks in the medical imaging pipeline as it influences a number of image-based decisions. To be effective, fully supervised segmentation approaches require large amounts of manually annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Tyler Ward , Aaron Moseley , Abdullah-Al-Zubaer Imran

Surgical data science is a new research field that aims to observe all aspects of the patient treatment process in order to provide the right assistance at the right time. Due to the breakthrough successes of deep learning-based solutions…

Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Hugo Figueiras , Helena Aidos , Nuno Cruz Garcia

We propose SparseContrast, a new framework that merges dynamic sparse attention with contrastive learning for medical imaging, with a focus on chest X-ray disease detection in low-data settings. Traditional contrastive learning methods rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Paarth Prasad , Ruchika Malhotra

Fundus photography is the primary method for retinal imaging and essential for diabetic retinopathy prevention. Automated segmentation of fundus photographs would improve the quality, capacity, and cost-effectiveness of eye care screening…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Jan Kukačka , Anja Zenz , Marcel Kollovieh , Dominik Jüstel , Vasilis Ntziachristos

Within the intensive care unit (ICU), a wealth of patient data, including clinical measurements and clinical notes, is readily available. This data is a valuable resource for comprehending patient health and informing medical decisions, but…

Machine Learning · Computer Science 2023-12-13 Ryan King , Tianbao Yang , Bobak Mortazavi

High annotation costs are a substantial bottleneck in applying modern deep learning architectures to clinically relevant medical use cases, substantiating the need for novel algorithms to learn from unlabeled data. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Aiham Taleb , Matthias Kirchler , Remo Monti , Christoph Lippert

A large labeled dataset is a key to the success of supervised deep learning, but for medical image segmentation, it is highly challenging to obtain sufficient annotated images for model training. In many scenarios, unannotated images are…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hao Zheng , Jun Han , Hongxiao Wang , Lin Yang , Zhuo Zhao , Chaoli Wang , Danny Z. Chen