English
Related papers

Related papers: CRoF: CLIP-based Robust Few-shot Learning on Noisy…

200 papers

Treating texts as images, combining prompts with textual labels for prompt tuning, and leveraging the alignment properties of CLIP have been successfully applied in zero-shot multi-label image recognition. Nonetheless, relying solely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Haonan Xu , Dian Chao , Xiangyu Wu , Zhonghua Wan , Yang Yang

The Contrastive Language-Image Pre-Training (CLIP) model excels in few-shot learning by aligning visual and textual representations. Our study shows that template-sample similarity (TSS), defined as the resemblance between a text template…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Zhenyu Zhang , Guangyao Chen , Yixiong Zou , Zhimeng Huang , Yuhua Li

The development of deep learning based image representation learning (IRL) methods has attracted great attention for various image understanding problems. Most of these methods require the availability of a high quantity and quality of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Gencer Sumbul , Begüm Demir

As a promising solution of reducing annotation cost, training multi-label models with partial positive labels (MLR-PPL), in which merely few positive labels are known while other are missing, attracts increasing attention. Due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Tao Pu , Qianru Lao , Hefeng Wu , Tianshui Chen , Liang Lin

Contrastive Language-Image Pre-training (CLIP) models have shown significant potential, particularly in zero-shot classification across diverse distribution shifts. Building on existing evaluations of overall classification robustness, this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Weijie Tu , Weijian Deng , Tom Gedeon

Due to the existence of label noise in web images and the high memorization capacity of deep neural networks, training deep fine-grained (FG) models directly through web images tends to have an inferior recognition ability. In the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Zeren Sun , Xian-Sheng Hua , Yazhou Yao , Xiu-Shen Wei , Guosheng Hu , Jian Zhang

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

Sound · Computer Science 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

The aim of multi-label few-shot image classification (ML-FSIC) is to assign semantic labels to images, in settings where only a small number of training examples are available for each label. A key feature of the multi-label setting is that…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Kun Yan , Zied Bouraoui , Fangyun Wei , Chang Xu , Ping Wang , Shoaib Jameel , Steven Schockaert

Noisy labels damage the performance of deep networks. For robust learning, a prominent two-stage pipeline alternates between eliminating possible incorrect labels and semi-supervised training. However, discarding part of noisy labels could…

Machine Learning · Computer Science 2023-01-09 Mingcai Chen , Hao Cheng , Yuntao Du , Ming Xu , Wenyu Jiang , Chongjun Wang

Large-scale datasets have been pivotal to the advancements of deep learning models in recent years, but training on such large datasets invariably incurs substantial storage and computational overhead. Meanwhile, real-world datasets often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Suorong Yang , Peng Ye , Wanli Ouyang , Dongzhan Zhou , Furao Shen

Weakly supervised semantic segmentation (WSSS) with image-level labels is a challenging task. Mainstream approaches follow a multi-stage framework and suffer from high training costs. In this paper, we explore the potential of Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yuqi Lin , Minghao Chen , Wenxiao Wang , Boxi Wu , Ke Li , Binbin Lin , Haifeng Liu , Xiaofei He

Designing robust algorithms capable of training accurate neural networks on uncurated datasets from the web has been the subject of much research as it reduces the need for time consuming human labor. The focus of many previous research…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Paul Albert , Eric Arazo , Tarun Krishna , Noel E. O'Connor , Kevin McGuinness

Recent research on fine-tuning vision-language models has demonstrated impressive performance in various downstream tasks. However, the challenge of obtaining accurately labeled data in real-world applications poses a significant obstacle…

Machine Learning · Computer Science 2024-10-01 Tong Wei , Hao-Tian Li , Chun-Shu Li , Jiang-Xin Shi , Yu-Feng Li , Min-Ling Zhang

The development of accurate methods for multi-label classification (MLC) of remote sensing (RS) images is one of the most important research topics in RS. The MLC methods based on convolutional neural networks (CNNs) have shown strong…

Image and Video Processing · Electrical Eng. & Systems 2022-10-27 Ahmet Kerem Aksoy , Mahdyar Ravanbakhsh , Begüm Demir

We introduce a noisy channel approach for language model prompting in few-shot text classification. Instead of computing the likelihood of the label given the input (referred as direct models), channel models compute the conditional…

Computation and Language · Computer Science 2022-03-16 Sewon Min , Mike Lewis , Hannaneh Hajishirzi , Luke Zettlemoyer

Enhancing the alignment between text and image features in the CLIP model is a critical challenge in zero-shot industrial anomaly detection tasks. Recent studies predominantly utilize specific category prompts during pretraining, which can…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yanning Hou , Yanran Ruan , Junfa Li , Shanshan Wang , Jianfeng Qiu , Ke Xu

The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based meta-learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Xu Luo , Yuxuan Chen , Liangjian Wen , Lili Pan , Zenglin Xu

Contrastive Language-Image Pre-trained (CLIP) models have zero-shot ability of classifying an image belonging to "[CLASS]" by using similarity between the image and the prompt sentence "a [CONTEXT] of [CLASS]". Based on exhaustive text cues…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Xiaofeng Mao , Yuefeng Chen , Xiaojun Jia , Rong Zhang , Hui Xue , Zhao Li

Recently, deep learning models have been widely applied in program understanding tasks, and these models achieve state-of-the-art results on many benchmark datasets. A major challenge of deep learning for program understanding is that the…

Software Engineering · Computer Science 2024-01-02 Wenhan Wang , Yanzhou Li , Anran Li , Jian Zhang , Wei Ma , Yang Liu

Learning from noisy labels is an important and long-standing problem in machine learning for real applications. One of the main research lines focuses on learning a label corrector to purify potential noisy labels. However, these methods…

Machine Learning · Computer Science 2023-12-05 Jian Chen , Ruiyi Zhang , Tong Yu , Rohan Sharma , Zhiqiang Xu , Tong Sun , Changyou Chen