中文
相关论文

相关论文: Self-Supervised Pre-Training with Contrastive and …

200 篇论文

Deep learning is the state-of-the-art for medical imaging tasks, but requires large, labeled datasets. For risk prediction, large datasets are rare since they require both imaging and follow-up (e.g., diagnosis codes). However, the release…

图像与视频处理 · 电气工程与系统科学 2023-06-16 Yanru Chen , Michael T Lu , Vineet K Raghu

We investigate the utility of pretraining by contrastive self supervised learning on both natural-scene and medical imaging datasets when the unlabeled dataset size is small, or when the diversity within the unlabeled set does not lead to…

图像与视频处理 · 电气工程与系统科学 2021-09-07 Ozan Ciga , Tony Xu , Anne L. Martel

Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed…

机器学习 · 计算机科学 2023-09-07 Blake VanBerlo , Jesse Hoey , Alexander Wong

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Salma Haidar , José Oramas

Accurate tooth identification and segmentation in Cone Beam Computed Tomography (CBCT) dental images can significantly enhance the efficiency and precision of manual diagnoses performed by dentists. However, existing segmentation methods…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Pengyu Dai , Yafei Ou , Yuqiao Yang , Yang Liu , Yue Zhao

Deep learning has demonstrated significant improvements in medical image segmentation using a sufficiently large amount of training data with manual labels. Acquiring well-representative labels requires expert knowledge and exhaustive…

计算机视觉与模式识别 · 计算机科学 2021-06-15 Jinxi Xiang , Zhuowei Li , Wenji Wang , Qing Xia , Shaoting Zhang

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Self-supervised pretraining methods with masked prediction demonstrate remarkable within-dataset performance in skeleton-based action recognition. However, we show that, unlike contrastive learning approaches, they do not produce…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Soroush Mehraban , Mohammad Javad Rajabi , Andrea Iaboni , Babak Taati

Medical image segmentation is a fundamental and critical step in many image-guided clinical approaches. Recent success of deep learning-based segmentation methods usually relies on a large amount of labeled data, which is particularly…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Rushi Jiao , Yichi Zhang , Le Ding , Rong Cai , Jicong Zhang

Self-supervised learning has emerged as a powerful tool for pretraining deep networks on unlabeled data, prior to transfer learning of target tasks with limited annotation. The relevance between the pretraining pretext and target tasks is…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Tianwei Zhang , Dong Wei , Mengmeng Zhu , Shi Gu , Yefeng Zheng

While transformers have surpassed convolutional neural networks (CNNs) in various computer vision tasks, microelectronics defect detection still largely relies on CNNs. We hypothesize that this gap is due to the fact that a) transformers…

计算机视觉与模式识别 · 计算机科学 2025-08-13 Nikolai Röhrich , Alwin Hoffmann , Richard Nordsieck , Emilio Zarbali , Alireza Javanmardi

Machine learning has revolutionized the modeling of clinical timeseries data. Using machine learning, a Deep Neural Network (DNN) can be automatically trained to learn a complex mapping of its input features for a desired task. This is…

机器学习 · 计算机科学 2024-10-15 Ryan King , Shivesh Kodali , Conrad Krueger , Tianbao Yang , Bobak J. Mortazavi

Segmentation is one of the most important tasks in the medical imaging pipeline as it influences a number of image-based decisions. To be effective, fully supervised segmentation approaches require large amounts of manually annotated…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Tyler Ward , Aaron Moseley , Abdullah-Al-Zubaer Imran

Surgical data science is a new research field that aims to observe all aspects of the patient treatment process in order to provide the right assistance at the right time. Due to the breakthrough successes of deep learning-based solutions…

Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been…

计算机视觉与模式识别 · 计算机科学 2024-02-23 Hugo Figueiras , Helena Aidos , Nuno Cruz Garcia

We propose SparseContrast, a new framework that merges dynamic sparse attention with contrastive learning for medical imaging, with a focus on chest X-ray disease detection in low-data settings. Traditional contrastive learning methods rely…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Paarth Prasad , Ruchika Malhotra

Fundus photography is the primary method for retinal imaging and essential for diabetic retinopathy prevention. Automated segmentation of fundus photographs would improve the quality, capacity, and cost-effectiveness of eye care screening…

图像与视频处理 · 电气工程与系统科学 2021-08-29 Jan Kukačka , Anja Zenz , Marcel Kollovieh , Dominik Jüstel , Vasilis Ntziachristos

Within the intensive care unit (ICU), a wealth of patient data, including clinical measurements and clinical notes, is readily available. This data is a valuable resource for comprehending patient health and informing medical decisions, but…

机器学习 · 计算机科学 2023-12-13 Ryan King , Tianbao Yang , Bobak Mortazavi

High annotation costs are a substantial bottleneck in applying modern deep learning architectures to clinically relevant medical use cases, substantiating the need for novel algorithms to learn from unlabeled data. In this work, we propose…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Aiham Taleb , Matthias Kirchler , Remo Monti , Christoph Lippert

A large labeled dataset is a key to the success of supervised deep learning, but for medical image segmentation, it is highly challenging to obtain sufficient annotated images for model training. In many scenarios, unannotated images are…

计算机视觉与模式识别 · 计算机科学 2021-07-13 Hao Zheng , Jun Han , Hongxiao Wang , Lin Yang , Zhuo Zhao , Chaoli Wang , Danny Z. Chen