English
Related papers

Related papers: Improving Contrastive Learning on Imbalanced Seed …

200 papers

Negative sampling schemes enable efficient training given a large number of classes, by offering a means to approximate a computationally expensive loss function that takes all labels into account. In this paper, we present a new connection…

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Decentralized learning has been advocated and widely deployed to make efficient use of distributed datasets, with an extensive focus on supervised learning (SL) problems. Unfortunately, the majority of real-world data are unlabeled and can…

Machine Learning · Computer Science 2023-03-01 Lirui Wang , Kaiqing Zhang , Yunzhu Li , Yonglong Tian , Russ Tedrake

As an algorithmic framework for learning to learn, meta-learning provides a promising solution for few-shot text classification. However, most existing research fail to give enough attention to class labels. Traditional basic framework…

Computation and Language · Computer Science 2024-12-16 Guanghua Hou , Shuhui Cao , Deqiang Ouyang , Ning Wang

The aim of Active Learning is to select the most informative samples from an unlabelled set of data. This is useful in cases where the amount of data is large and labelling is expensive, such as in machine vision or medical imaging. Two…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Julien Combes , Alexandre Derville , Jean-François Coeurjolly

The pioneering method for unsupervised meta-learning, CACTUs, is a clustering-based approach with pseudo-labeling. This approach is model-agnostic and can be combined with supervised algorithms to learn from unlabeled data. However, it…

Machine Learning · Computer Science 2022-09-29 Xingping Dong , Jianbing Shen , Ling Shao

Long-tailed data is prevalent in real-world classification tasks and heavily relies on supervised information, which makes the annotation process exceptionally labor-intensive and time-consuming. Unfortunately, despite being a common…

Machine Learning · Computer Science 2024-12-04 Meng Wei , Zhongnian Li , Yong Zhou , Xinzheng Xu

The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real-world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long-tail distribution,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ziyu Jiang , Tianlong Chen , Bobak Mortazavi , Zhangyang Wang

We are interested in representation learning from labeled or unlabeled data. Inspired by recent success of self-supervised learning (SSL), we develop a non-contrastive representation learning method that can exploit additional knowledge.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Hamed Pirsiavash

Contrastive learning (CL) approaches have gained great recognition as a very successful subset of self-supervised learning (SSL) methods. SSL enables learning from unlabeled data, a crucial step in the advancement of deep learning,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Mohamed Hassan , Mohammad Wasil , Sebastian Houben

Recent work has uncovered the interesting (and somewhat surprising) finding that training models to be invariant to adversarial perturbations requires substantially larger datasets than those required for standard classification. This…

Machine Learning · Computer Science 2019-12-06 Jonathan Uesato , Jean-Baptiste Alayrac , Po-Sen Huang , Robert Stanforth , Alhussein Fawzi , Pushmeet Kohli

Many practical medical imaging scenarios include categories that are under-represented but still crucial. The relevance of image recognition models to real-world applications lies in their ability to generalize to these rare classes as well…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Daniya Najiha A. Kareem , Jean Lahoud , Mustansar Fiaz , Amandeep Kumar , Hisham Cholakkal

Dealing with severe class imbalance poses a major challenge for real-world applications, especially when the accurate classification and generalization of minority classes is of primary interest. In computer vision, learning from long…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Zidi Xiu , Junya Chen , Ricardo Henao , Benjamin Goldstein , Lawrence Carin , Chenyang Tao

Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and…

Machine Learning · Computer Science 2024-02-20 Huafeng Liu , Mengmeng Sheng , Zeren Sun , Yazhou Yao , Xian-Sheng Hua , Heng-Tao Shen

We propose a novel TACLE (TAsk and CLass-awarE) framework to address the relatively unexplored and challenging problem of exemplar-free semi-supervised class incremental learning. In this scenario, at each new task, the model has to learn…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jayateja Kalla , Rohit Kumar , Soma Biswas

As a fundamental visual attribute, image complexity significantly influences both human perception and the performance of computer vision models. However, accurately assessing and quantifying image complexity remains a challenging task. (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Shipeng Liu , Liang Zhao , Dengfeng Chen

Deep neural networks have demonstrated remarkable advancements in various fields using large, well-annotated datasets. However, real-world data often exhibit long-tailed distributions and label noise, significantly degrading generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Jae Soon Baik , In Young Yoon , Kun Hoon Kim , Jun Won Choi

In real-world applications, as data availability increases, obtaining labeled data for machine learning (ML) projects remains challenging due to the high costs and intensive efforts required for data annotation. Many ML projects,…

Machine Learning · Computer Science 2024-12-24 Ismail Hakki Karaman , Gulser Koksal , Levent Eriskin , Salih Salihoglu

This paper presents a novel positive and negative set selection strategy for contrastive learning of medical images based on labels that can be extracted from clinical data. In the medical field, there exists a variety of labels for data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Kiran Kokilepersaud , Stephanie Trejo Corona , Mohit Prabhushankar , Ghassan AlRegib , Charles Wykoff

Obtaining annotations for 3D medical images is expensive and time-consuming, despite its importance for automating segmentation tasks. Although multi-task learning is considered an effective method for training segmentation models using…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Junichiro Iwasawa , Yuichiro Hirano , Yohei Sugawara