中文
相关论文

相关论文: Contrastive Learning of Medical Visual Representat…

200 篇论文

Contrastive learning has proven effective for pre-training image models on unlabeled data with promising results for tasks such as medical image classification. Using paired text (like radiological reports) during pre-training improves the…

计算机视觉与模式识别 · 计算机科学 2023-03-08 Philip Müller , Georgios Kaissis , Congyu Zou , Daniel Rueckert

Medical image interpretation using deep learning has shown promise but often requires extensive expert-annotated datasets. To reduce this annotation burden, we develop an Image-Graph Contrastive Learning framework that pairs chest X-rays…

图像与视频处理 · 电气工程与系统科学 2024-05-17 Sameer Khanna , Daniel Michael , Marinka Zitnik , Pranav Rajpurkar

A key challenge in training neural networks for a given medical imaging task is often the difficulty of obtaining a sufficient number of manually labeled examples. In contrast, textual imaging reports, which are often readily available in…

机器学习 · 计算机科学 2022-01-31 Gongbo Liang , Connor Greenwell , Yu Zhang , Xiaoqin Wang , Ramakanth Kavuluru , Nathan Jacobs

Existing vision-text contrastive learning like CLIP aims to match the paired image and caption embeddings while pushing others apart, which improves representation transferability and supports zero-shot prediction. However, medical…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Zifeng Wang , Zhenbang Wu , Dinesh Agarwal , Jimeng Sun

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

计算机视觉与模式识别 · 计算机科学 2022-10-10 Zhenyuan Lu

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

Contrastive learning and self-supervised techniques have gained prevalence in computer vision for the past few years. It is essential for medical image analysis, which is often notorious for its lack of annotations. Most existing…

图像与视频处理 · 电气工程与系统科学 2022-03-07 Jun Li , Quan Quan , S. Kevin Zhou

Visual recognition is recently learned via either supervised learning on human-annotated image-label data or language-image contrastive learning with webly-crawled image-text pairs. While supervised learning may result in a more…

计算机视觉与模式识别 · 计算机科学 2022-04-08 Jianwei Yang , Chunyuan Li , Pengchuan Zhang , Bin Xiao , Ce Liu , Lu Yuan , Jianfeng Gao

Image-to-image translation aims to learn a mapping between different groups of visually distinguishable images. While recent methods have shown impressive ability to change even intricate appearance of images, they still rely on domain…

计算机视觉与模式识别 · 计算机科学 2021-05-10 Hanbit Lee , Jinseok Seol , Sang-goo Lee

Self-supervised contrastive learning between pairs of multiple views of the same image has been shown to successfully leverage unlabeled data to produce meaningful visual representations for both natural and medical images. However, there…

图像与视频处理 · 电气工程与系统科学 2021-10-19 Yen Nhi Truong Vu , Richard Wang , Niranjan Balachandar , Can Liu , Andrew Y. Ng , Pranav Rajpurkar

Recent self-supervised representation learning techniques have largely closed the gap between supervised and unsupervised learning on ImageNet classification. While the particulars of pretraining on ImageNet are now relatively well…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Elijah Cole , Xuan Yang , Kimberly Wilber , Oisin Mac Aodha , Serge Belongie

Understanding the severity of conditions shown in images in medical diagnosis is crucial, serving as a key guide for clinical assessment, treatment, as well as evaluating longitudinal progression. This paper proposes Con- PrO: a novel…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Hong Nguyen , Hoang Nguyen , Melinda Chang , Hieu Pham , Shrikanth Narayanan , Michael Pazzani

Unsupervised pre-training has been proven as an effective approach to boost various downstream tasks given limited labeled data. Among various methods, contrastive learning learns a discriminative representation by constructing positive and…

图像与视频处理 · 电气工程与系统科学 2022-02-17 Jizong Peng , Ping Wang , Marco Pedersoli , Christian Desrosiers

The de-facto approach to many vision tasks is to start from pretrained visual representations, typically learned via supervised training on ImageNet. Recent methods have explored unsupervised pretraining to scale to vast quantities of…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Karan Desai , Justin Johnson

Unsupervised image-to-image translation tasks aim to find a mapping between a source domain X and a target domain Y from unpaired training data. Contrastive learning for Unpaired image-to-image Translation (CUT) yields state-of-the-art…

计算机视觉与模式识别 · 计算机科学 2021-04-19 Junlin Han , Mehrdad Shoeiby , Lars Petersson , Mohammad Ali Armin

Contrastive language-image Pre-training (CLIP) [13] can leverage large datasets of unlabeled Image-Text pairs, which have demonstrated impressive performance in various downstream tasks. Given that annotating medical data is time-consuming…

图像与视频处理 · 电气工程与系统科学 2023-07-13 Yuhao Wang

Pre-trained models, e.g., from ImageNet, have proven to be effective in boosting the performance of many downstream applications. It is too demanding to acquire large-scale annotations to build such models for medical imaging. Meanwhile,…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Xiaosong Wang , Ziyue Xu , Leo Tam , Dong Yang , Daguang Xu

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Existing contrastive language-image pre-training aims to learn a joint representation by matching abundant image-text pairs. However, the number of image-text pairs in medical datasets is usually orders of magnitude smaller than that in…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Jiarun Liu , Hong-Yu Zhou , Cheng Li , Weijian Huang , Hao Yang , Yong Liang , Shanshan Wang
‹ 上一页 1 2 3 10 下一页 ›