中文
相关论文

相关论文: Contrastive Cross-Modal Pre-Training: A General St…

200 篇论文

Medical experts often manually segment images to obtain diagnostic statistics and discard the resulting annotations. We aim to train segmentation models to alleviate this burden, but constrained to the retained summary statistics (e.g., the…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Omkar Kulkarni , Edward Raff , Tim Oates

Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is…

计算机视觉与模式识别 · 计算机科学 2022-09-02 András Kalapos , Bálint Gyires-Tóth

The accuracy and robustness of image classification with supervised deep learning are dependent on the availability of large-scale, annotated training data. However, there is a paucity of annotated data available due to the complexity of…

计算机视觉与模式识别 · 计算机科学 2019-03-27 Euijoon Ahn , Ashnil Kumar , Dagan Feng , Michael Fulham , Jinman Kim

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed…

机器学习 · 计算机科学 2023-09-07 Blake VanBerlo , Jesse Hoey , Alexander Wong

Human observers can learn to recognize new categories of images from a handful of examples, yet doing so with artificial ones remains an open challenge. We hypothesize that data-efficient recognition is enabled by representations which make…

计算机视觉与模式识别 · 计算机科学 2020-07-02 Olivier J. Hénaff , Aravind Srinivas , Jeffrey De Fauw , Ali Razavi , Carl Doersch , S. M. Ali Eslami , Aaron van den Oord

Existing contrastive language-image pre-training aims to learn a joint representation by matching abundant image-text pairs. However, the number of image-text pairs in medical datasets is usually orders of magnitude smaller than that in…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Jiarun Liu , Hong-Yu Zhou , Cheng Li , Weijian Huang , Hao Yang , Yong Liang , Shanshan Wang

Noisy labels hurt deep learning-based supervised image classification performance as the models may overfit the noise and learn corrupted feature extractors. For natural image classification training with noisy labeled data, model…

图像与视频处理 · 电气工程与系统科学 2023-08-10 Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Cristian A. Linte

Training convolutional networks for semantic segmentation with strong (per-pixel) and weak (per-bounding-box) supervision requires a large amount of weakly labeled data. We propose two methods for selecting the most relevant data with weak…

计算机视觉与模式识别 · 计算机科学 2019-07-17 Panagiotis Meletis , Rob Romijnders , Gijs Dubbelman

In this paper, we present a label transfer model from texts to images for image classification tasks. The problem of image classification is often much more challenging than text classification. On one hand, labeled text data is more widely…

计算机视觉与模式识别 · 计算机科学 2017-03-23 Guo-Jun Qi , Wei Liu , Charu Aggarwal , Thomas Huang

Cross-modal attention mechanisms have been widely applied to the image-text matching task and have achieved remarkable improvements thanks to its capability of learning fine-grained relevance across different modalities. However, the…

计算机视觉与模式识别 · 计算机科学 2022-10-05 Yuxiao Chen , Jianbo Yuan , Long Zhao , Tianlang Chen , Rui Luo , Larry Davis , Dimitris N. Metaxas

Despite the remarkable performance of supervised medical image segmentation models, relying on a large amount of labeled data is impractical in real-world situations. Semi-supervised learning approaches aim to alleviate this challenge using…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Yunyao Lu , Yihang Wu , Ahmad Chaddad , Tareef Daqqaq , Reem Kateb

While image-text representation learning has become very popular in recent years, existing models tend to lack spatial awareness and have limited direct applicability for dense understanding tasks. For this reason, self-supervised…

Contrastive Language-Image Pretraining (CLIP) models are able to capture the semantic relationship of images and texts and have enabled a wide range of applications, from image retrieval to classification. These models are trained with…

计算机视觉与模式识别 · 计算机科学 2023-11-09 Calvin Metzger

Most existing graph-based semi-supervised hyperspectral image classification methods rely on superpixel partitioning techniques. However, they suffer from misclassification of certain pixels due to inaccuracies in superpixel boundaries,…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Yuqing Zhang , Qi Han , Ligeng Wang , Kai Cheng , Bo Wang , Kun Zhan

Medical image classification involves thresholding of labels that represent malignancy risk levels. Usually, a task defines a single threshold, and when developing computer-aided diagnosis tools, a single network is trained per such…

计算机视觉与模式识别 · 计算机科学 2018-11-22 Vadim Ratner , Yoel Shoshan , Tal Kachman

We investigate the effectiveness of a simple solution to the common problem of deep learning in medical image analysis with limited quantities of labeled training data. The underlying idea is to assign artificial labels to abundantly…

计算机视觉与模式识别 · 计算机科学 2019-01-28 Nima Tajbakhsh , Yufei Hu , Junli Cao , Xingjian Yan , Yi Xiao , Yong Lu , Jianming Liang , Demetri Terzopoulos , Xiaowei Ding

The emergence of Large Language Models (LLMs) presents unprecedented opportunities to revolutionize medical contrastive vision-language pre-training. In this paper, we show how LLMs can facilitate large-scale supervised pre-training,…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Yingtai Li , Haoran Lai , Xiaoqian Zhou , Shuai Ming , Wenxin Ma , Wei Wei , Shaohua Kevin Zhou

Many high-level skills that are required for computer vision tasks, such as parsing questions, comparing and contrasting semantics, and writing descriptions, are also required in other domains such as natural language processing. In this…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Sophia Gu , Christopher Clark , Aniruddha Kembhavi

One of the primary challenges limiting the applicability of deep learning is its susceptibility to learning spurious correlations rather than the underlying mechanisms of the task of interest. The resulting failure to generalise cannot be…

计算机视觉与模式识别 · 计算机科学 2020-04-21 Damien Teney , Ehsan Abbasnedjad , Anton van den Hengel