English
Related papers

Related papers: Improving Multi-Label Contrastive Learning by Leve…

200 papers

The learning from imbalanced data is a deeply studied problem in standard classification and, in recent times, also in multilabel classification. A handful of multilabel resampling methods have been proposed in late years, aiming to balance…

Machine Learning · Computer Science 2018-02-15 Francisco Charte , Antonio J. Rivera , María J. del Jesus , Francisco Herrera

Obtaining annotations for 3D medical images is expensive and time-consuming, despite its importance for automating segmentation tasks. Although multi-task learning is considered an effective method for training segmentation models using…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Junichiro Iwasawa , Yuichiro Hirano , Yohei Sugawara

We present a new loss function called Distribution-Balanced Loss for the multi-label recognition problems that exhibit long-tailed class distributions. Compared to conventional single-label classification problem, multi-label recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Tong Wu , Qingqiu Huang , Ziwei Liu , Yu Wang , Dahua Lin

Multilabel classification is an emergent data mining task with a broad range of real world applications. Learning from imbalanced multilabel data is being deeply studied latterly, and several resampling methods have been proposed in the…

Machine Learning · Computer Science 2018-02-15 Francisco Charte , Antonio J. Rivera , María J. del Jesus , Francisco Herrera

This paper presents a novel positive and negative set selection strategy for contrastive learning of medical images based on labels that can be extracted from clinical data. In the medical field, there exists a variety of labels for data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Kiran Kokilepersaud , Stephanie Trejo Corona , Mohit Prabhushankar , Ghassan AlRegib , Charles Wykoff

Class distribution plays an important role in learning deep classifiers. When the proportion of each class in the test set differs from the training set, the performance of classification nets usually degrades. Such a label distribution…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Wenao Ma , Cheng Chen , Shuang Zheng , Jing Qin , Huimao Zhang , Qi Dou

Contrastive learning methods enforce label distance relationships in feature space to improve representation capability for regression models. However, these methods highly depend on label information to correctly recover ordinal…

Machine Learning · Computer Science 2025-12-11 Ce Wang , Weihang Dai , Hanru Bai , Xiaomeng Li

Label Distribution Learning (LDL) is a novel machine learning paradigm that assigns label distribution to each instance. Many LDL methods proposed to leverage label correlation in the learning process to solve the exponential-sized output…

Machine Learning · Computer Science 2023-08-04 Zhiqiang Kou jing wang yuheng jia xin geng

Negative sampling schemes enable efficient training given a large number of classes, by offering a means to approximate a computationally expensive loss function that takes all labels into account. In this paper, we present a new connection…

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully…

Artificial Intelligence · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

Multi-label class-incremental learning (MLCIL) is essential for real-world multi-label applications, allowing models to learn new labels while retaining previously learned knowledge continuously. However, recent MLCIL approaches can only…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Kaile Du , Yifan Zhou , Fan Lyu , Yuyang Li , Junzhou Xie , Yixi Shen , Fuyuan Hu , Guangcan Liu

Pre-training representations (a.k.a. foundation models) has recently become a prevalent learning paradigm, where one first pre-trains a representation using large-scale unlabeled data, and then learns simple predictors on top of the…

Machine Learning · Computer Science 2023-03-02 Zhenmei Shi , Jiefeng Chen , Kunyang Li , Jayaram Raghuram , Xi Wu , Yingyu Liang , Somesh Jha

The lack of labeled data is a key challenge for learning useful representation from time series data. However, an unsupervised representation framework that is capable of producing high quality representations could be of great value. It is…

Machine Learning · Statistics 2022-03-18 Kristoffer Wickstrøm , Michael Kampffmeyer , Karl Øyvind Mikalsen , Robert Jenssen

The success of deep learning methods in medical image segmentation tasks heavily depends on a large amount of labeled data to supervise the training. On the other hand, the annotation of biomedical images requires domain knowledge and can…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Xinrong Hu , Dewen Zeng , Xiaowei Xu , Yiyu Shi

Competitive methods for multi-label classification typically invest in learning labels together. To do so in a beneficial way, analysis of label dependence is often seen as a fundamental step, separate and prior to constructing a…

Machine Learning · Statistics 2017-07-19 Jesse Read , Jaakko Hollmén

Multi-label learning handles instances associated with multiple class labels. The original label space is a logical matrix with entries from the Boolean domain $\in \left \{ 0,1 \right \}$. Logical labels are not able to show the relative…

Machine Learning · Computer Science 2021-03-01 Ali Braytee , Wei Liu

It is well-known that exploiting label correlations is important to multi-label learning. Existing approaches either assume that the label correlations are global and shared by all instances; or that the label correlations are local and…

Machine Learning · Computer Science 2017-04-06 Yue Zhu , James T. Kwok , Zhi-Hua Zhou

Existing knowledge distillation methods typically work by imparting the knowledge of output logits or intermediate feature maps from the teacher network to the student network, which is very successful in multi-class single-label learning.…

Machine Learning · Computer Science 2025-06-02 Penghui Yang , Ming-Kun Xie , Chen-Chen Zong , Lei Feng , Gang Niu , Masashi Sugiyama , Sheng-Jun Huang

Recommender systems often struggle with long-tail distributions and limited item catalog exposure, where a small subset of popular items dominates recommendations. This challenge is especially critical in large-scale online retail settings…

Information Retrieval · Computer Science 2026-02-10 Vasileios Karlis , Ezgi Yıldırım , David Vos , Maarten de Rijke