English
Related papers

Related papers: Multi-Label Contrastive Learning : A Comprehensive…

200 papers

In recent years, multi-label classification has attracted a significant body of research, motivated by real-life applications, such as text classification and medical diagnoses. Although sparsely studied in this context, Learning Classifier…

Neural and Evolutionary Computing · Computer Science 2015-12-29 Fani A. Tzima , Miltiadis Allamanis , Alexandros Filotheou , Pericles A. Mitkas

Learning a discriminative semantic space using unlabelled and noisy data remains unaddressed in a multi-label setting. We present a contrastive self-supervised learning method which is robust to data noise, grounded in the domain of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Mehmet Can Yavuz , Berrin Yanikoglu

As an algorithmic framework for learning to learn, meta-learning provides a promising solution for few-shot text classification. However, most existing research fail to give enough attention to class labels. Traditional basic framework…

Computation and Language · Computer Science 2024-12-16 Guanghua Hou , Shuhui Cao , Deqiang Ouyang , Ning Wang

Contrastive learning and self-supervised techniques have gained prevalence in computer vision for the past few years. It is essential for medical image analysis, which is often notorious for its lack of annotations. Most existing…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Jun Li , Quan Quan , S. Kevin Zhou

Labels are costly and sometimes unreliable. Noisy label learning, semi-supervised learning, and contrastive learning are three different strategies for designing learning processes requiring less annotation cost. Semi-supervised learning…

Machine Learning · Computer Science 2021-11-24 Xin Zhang , Zixuan Liu , Kaiwen Xiao , Tian Shen , Junzhou Huang , Wei Yang , Dimitris Samaras , Xiao Han

Multi-label classification (MLC) is a prediction task where each sample can have more than one label. We propose a novel contrastive learning boosted multi-label prediction model based on a Gaussian mixture variational autoencoder…

Machine Learning · Computer Science 2022-06-13 Junwen Bai , Shufeng Kong , Carla P. Gomes

Supervised contrastive learning (SCL) frameworks treat each class as independent and thus consider all classes to be equally important. This neglects the common scenario in which label hierarchy exists, where fine-grained classes under the…

Machine Learning · Computer Science 2024-02-02 Ruixue Lian , William A. Sethares , Junjie Hu

Representation learning constitutes a pivotal cornerstone in contemporary deep learning paradigms, offering a conduit to elucidate distinctive features within the latent space and interpret the deep models. Nevertheless, the inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Siyuan Dai , Kai Ye , Kun Zhao , Ge Cui , Haoteng Tang , Liang Zhan

Multimodal multilabel classification (MMC) is a challenging task that aims to design a learning algorithm to handle two data sources, the image and text, and learn a comprehensive semantic feature presentation across the modalities. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yanming Guo

In multi-label classification, where a single example may be associated with several class labels at the same time, the ability to model dependencies between labels is considered crucial to effectively optimize non-decomposable evaluation…

Machine Learning · Computer Science 2021-06-23 Michael Rapp , Eneldo Loza Mencía , Johannes Fürnkranz , Eyke Hüllermeier

Compared with multi-class classification, multi-label classification that contains more than one class is more suitable in real life scenarios. Obtaining fully labeled high-quality datasets for multi-label classification problems, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Xin Zhang , Rabab Abdelfattah , Yuqi Song , Xiaofeng Wang

In neutrino physics, analyses often depend on large simulated datasets, making it essential for models to generalise effectively to real-world detector data. Contrastive learning, a well-established technique in deep learning, offers a…

High Energy Physics - Experiment · Physics 2025-05-23 Alex Wilkinson , Radi Radev , Saul Alonso-Monsalve

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

Contrastive learning has recently demonstrated superior performance to supervised learning, despite requiring no training labels. We explore how contrastive learning can be applied to hundreds of thousands of unlabeled Mars terrain images,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Isaac Ronald Ward , Charles Moore , Kai Pak , Jingdao Chen , Edwin Goh

Multi-label learning is concerned with the classification of data with multiple class labels. This is in contrast to the traditional classification problem where every data instance has a single label. Due to the exponential size of output…

Machine Learning · Computer Science 2018-12-27 Vikas Kumar , Arun K Pujari , Vineet Padmanabhan , Venkateswara Rao Kagita

Contrastive representation learning, which aims to learnthe shared information between different views of unlabeled data by maximizing the mutual information between them, has shown its powerful competence in self-supervised learning for…

Machine Learning · Computer Science 2024-08-21 Xuechu Yu

Multi-label learning deals with the classification problems where each instance can be assigned with multiple labels simultaneously. Conventional multi-label learning approaches mainly focus on exploiting label correlations. It is usually…

Machine Learning · Computer Science 2014-07-08 Xiangnan Kong , Zhaoming Wu , Li-Jia Li , Ruofei Zhang , Philip S. Yu , Hang Wu , Wei Fan

Self-training methods have proven to be effective in exploiting abundant unlabeled data in semi-supervised learning, particularly when labeled data is scarce. While many of these approaches rely on a cross-entropy loss function (CE), recent…

Machine Learning · Computer Science 2024-09-12 Aurelien Gauffre , Julien Horvat , Massih-Reza Amini

We tackle the cross-modal retrieval problem, where learning is only supervised by relevant multi-modal pairs in the data. Although the contrastive learning is the most popular approach for this task, it makes potentially wrong assumption…

Machine Learning · Computer Science 2022-10-13 Minyoung Kim

Self-supervised learning has emerged as a powerful way to pre-train generalizable machine learning models on large amounts of unlabeled data. It is particularly compelling in the music domain, where obtaining labeled data is time-consuming,…

Sound · Computer Science 2024-04-16 Gabriel Meseguer-Brocal , Dorian Desblancs , Romain Hennequin