English
Related papers

Related papers: Image Captioning with Very Scarce Supervised Data:…

200 papers

Many promising applications of supervised machine learning face hurdles in the acquisition of labeled data in sufficient quantity and quality, creating an expensive bottleneck. To overcome such limitations, techniques that do not depend on…

Machine Learning · Computer Science 2023-03-14 Benedikt Boecking , Nicholas Roberts , Willie Neiswanger , Stefano Ermon , Frederic Sala , Artur Dubrawski

Unsupervised image retrieval aims to learn an efficient retrieval system without expensive data annotations, but most existing methods rely heavily on handcrafted feature descriptors or pre-trained feature extractors. To minimize human…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Guile Wu , Chao Zhang , Stephan Liwicki

A common classification task situation is where one has a large amount of data available for training, but only a small portion is annotated with class labels. The goal of semi-supervised training, in this context, is to improve…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Zijian Hu , Zhengyu Yang , Xuefeng Hu , Ram Nevatia

The lack of labeled data is a common challenge in speech classification tasks, particularly those requiring extensive subjective assessment, such as cognitive state classification. In this work, we propose a Semi-Supervised Learning (SSL)…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Yuanchao Li , Zixing Zhang , Jing Han , Peter Bell , Catherine Lai

While deep learning strategies achieve outstanding results in computer vision tasks, one issue remains: The current strategies rely heavily on a huge amount of labeled data. In many real-world problems, it is not feasible to create such an…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Lars Schmarje , Monty Santarossa , Simon-Martin Schröder , Reinhard Koch

We address the task of weakly-supervised few-shot image classification and segmentation, by leveraging a Vision Transformer (ViT) pretrained with self-supervision. Our proposed method takes token representations from the self-supervised ViT…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Dahyun Kang , Piotr Koniusz , Minsu Cho , Naila Murray

Semi-supervised image classification, leveraging pseudo supervision and consistency regularization, has demonstrated remarkable success. However, the ongoing challenge lies in fully exploiting the potential of unlabeled data. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Qi Han , Zhibo Tian , Chengwei Xia , Kun Zhan

In this paper, we present a novel cross-consistency based semi-supervised approach for semantic segmentation. Consistency training has proven to be a powerful semi-supervised learning framework for leveraging unlabeled data under the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Yassine Ouali , Céline Hudelot , Myriam Tami

Dataset pruning reduces the storage and training costs of deep learning by selecting an informative subset from a large dataset. However, most existing pruning methods require fully labeled data, which limits their applicability in…

Machine Learning · Computer Science 2026-05-25 Yeseul Cho , Baekrok Shin , Changmin Kang , Chulhee Yun

Diverse image captioning models aim to learn one-to-many mappings that are innate to cross-domain datasets, such as of images and texts. Current methods for this task are based on generative latent variable models, e.g. VAEs with structured…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Shweta Mahajan , Stefan Roth

Semi- and weakly-supervised learning have recently attracted considerable attention in the object detection literature since they can alleviate the cost of annotation needed to successfully train deep learning models. State-of-art…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Akhil Meethal , Marco Pedersoli , Zhongwen Zhu , Francisco Perdigon Romero , Eric Granger

This paper investigates the problem of image classification with limited or no annotations, but abundant unlabeled data. The setting exists in many tasks such as semi-supervised image classification, image clustering, and image retrieval.…

Computer Vision and Pattern Recognition · Computer Science 2016-02-05 Dengxin Dai , Luc Van Gool

Supervised learning in large discriminative models is a mainstay for modern computer vision. Such an approach necessitates investing in large-scale human-annotated datasets for achieving state-of-the-art results. In turn, the efficacy of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Liang-Chieh Chen , Raphael Gontijo Lopes , Bowen Cheng , Maxwell D. Collins , Ekin D. Cubuk , Barret Zoph , Hartwig Adam , Jonathon Shlens

We demonstrate, theoretically and empirically, that adversarial robustness can significantly benefit from semisupervised learning. Theoretically, we revisit the simple Gaussian model of Schmidt et al. that shows a sample complexity gap…

Machine Learning · Statistics 2022-01-14 Yair Carmon , Aditi Raghunathan , Ludwig Schmidt , Percy Liang , John C. Duchi

Existing weakly or semi-supervised semantic segmentation methods utilize image or box-level supervision to generate pseudo-labels for weakly labeled images. However, due to the lack of strong supervision, the generated pseudo-labels are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Md Amirul Islam , Matthew Kowal , Sen Jia , Konstantinos G. Derpanis , Neil D. B. Bruce

Treating texts as images, combining prompts with textual labels for prompt tuning, and leveraging the alignment properties of CLIP have been successfully applied in zero-shot multi-label image recognition. Nonetheless, relying solely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Haonan Xu , Dian Chao , Xiangyu Wu , Zhonghua Wan , Yang Yang

Recently, learning from vast unlabeled data, especially self-supervised learning, has been emerging and attracted widespread attention. Self-supervised learning followed by the supervised fine-tuning on a few labeled examples can…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Wentao Zhu , Hang Shang , Tingxun Lv , Chao Liao , Sen Yang , Ji Liu

Automatically generating a human-like description for a given image is a potential research in artificial intelligence, which has attracted a great of attention recently. Most of the existing attention methods explore the mapping…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Feicheng Huang , Zhixin Li , Haiyang Wei , Canlong Zhang , Huifang Ma

Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to achieve better performances in popular applications with few…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Bowen Tao , Lan Li , Xin-Chun Li , De-Chuan Zhan

This paper presents a novel approach for automatically generating image descriptions: visual detectors, language models, and multimodal similarity models learnt directly from a dataset of image captions. We use multiple instance learning to…

Computer Vision and Pattern Recognition · Computer Science 2016-02-22 Hao Fang , Saurabh Gupta , Forrest Iandola , Rupesh Srivastava , Li Deng , Piotr Dollár , Jianfeng Gao , Xiaodong He , Margaret Mitchell , John C. Platt , C. Lawrence Zitnick , Geoffrey Zweig