English
Related papers

Related papers: Multi-label Contrastive Predictive Coding

200 papers

Model inversion, whose goal is to recover training data from a pre-trained model, has been recently proved feasible. However, existing inversion methods usually suffer from the mode collapse problem, where the synthesized instances are…

Artificial Intelligence · Computer Science 2021-05-19 Gongfan Fang , Jie Song , Xinchao Wang , Chengchao Shen , Xingen Wang , Mingli Song

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

Contrastive learning has shown outstanding performances in both supervised and unsupervised learning, and has recently been introduced to solve weakly supervised learning problems such as semi-supervised learning and noisy label learning.…

Machine Learning · Computer Science 2023-06-08 Jingyi Cui , Weiran Huang , Yifei Wang , Yisen Wang

Learning good representations is of crucial importance in deep learning. Mutual Information (MI) or similar measures of statistical dependence are promising tools for learning these representations in an unsupervised way. Even though the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-09 Mirco Ravanelli , Yoshua Bengio

Modeling label correlations has always played a pivotal role in multi-label image classification (MLC), attracting significant attention from researchers. However, recent studies have overemphasized co-occurrence relationships among labels,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 LeiLei Ma , Shuo Xu , MingKun Xie , Lei Wang , Dengdi Sun , Haifeng Zhao

Multi-label classification (MLC) is a generalization of standard classification where multiple labels may be assigned to a given sample. In the real world, it is more common to deal with noisy datasets than clean datasets, given how modern…

Machine Learning · Computer Science 2021-02-18 Wenting Zhao , Carla Gomes

We consider a collaborative learning setting where the goal of each agent is to improve their own model by leveraging the expertise of collaborators, in addition to their own training data. To facilitate the exchange of expertise among…

Machine Learning · Computer Science 2023-11-16 Dongyang Fan , Celestine Mendler-Dünner , Martin Jaggi

Class imbalance is an intrinsic characteristic of multi-label data. Most of the labels in multi-label data sets are associated with a small number of training examples, much smaller compared to the size of the data set. Class imbalance…

Machine Learning · Computer Science 2018-11-07 Bin Liu , Grigorios Tsoumakas

In this paper a high speed neural network classifier based on extreme learning machines for multi-label classification problem is proposed and dis-cussed. Multi-label classification is a superset of traditional binary and multi-class…

Machine Learning · Computer Science 2016-09-06 Meng Joo Er , Rajasekar Venkatesan , Ning Wang

Multi-instance learning (MIL) deals with objects represented as bags of instances and can predict instance labels from bag-level supervision. However, significant performance gaps exist between instance-level MIL algorithms and supervised…

Machine Learning · Computer Science 2022-10-06 Weijia Zhang , Xuanhui Zhang , Han-Wen Deng , Min-Ling Zhang

Explainable object recognition using vision-language models such as CLIP involves predicting accurate category labels supported by rationales that justify the decision-making process. Existing methods typically rely on prompt-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Ali Rasekh , Sepehr Kazemi Ranjbar , Simon Gottschalk

We investigate probabilistic decoupling of labels supplied for training, from the underlying classes for prediction. Decoupling enables an inference scheme general enough to implement many classification problems, including supervised,…

Machine Learning · Computer Science 2019-05-30 Jeppe Nørregaard , Lars Kai Hansen

Pseudo-labeling has emerged as a popular and effective approach for utilizing unlabeled data. However, in the context of semi-supervised multi-label learning (SSMLL), conventional pseudo-labeling methods encounter difficulties when dealing…

Machine Learning · Computer Science 2023-05-23 Ming-Kun Xie , Jia-Hao Xiao , Hao-Zhe Liu , Gang Niu , Masashi Sugiyama , Sheng-Jun Huang

Multi-label classification is a common challenge in various machine learning applications, where a single data instance can be associated with multiple classes simultaneously. The current paper proposes a novel tree-based method for…

Methodology · Statistics 2024-05-01 Chhavi Tyagi , Wenge Guo

Fine-grained classification involves dealing with datasets with larger number of classes with subtle differences between them. Guiding the model to focus on differentiating dimensions between these commonly confusable classes is key to…

Computation and Language · Computer Science 2021-09-14 Varsha Suresh , Desmond C. Ong

Estimating mutual information (MI) is a fundamental yet challenging task in data science and machine learning. This work proposes a new estimator for mutual information. Our main discovery is that a preliminary estimate of the data…

Machine Learning · Computer Science 2024-08-20 Yanzhi Chen , Zijing Ou , Adrian Weller , Yingzhen Li

The Maximum Mutual Information (MMI) criterion is different from the Least Error Rate (LER) criterion. It can reduce failing to report small probability events. This paper introduces the Channels Matching (CM) algorithm for the MMI…

Machine Learning · Computer Science 2019-01-30 Chenguang Lu

Learning from label proportions (LLP) is a weakly supervised setting for classification in which unlabeled training instances are grouped into bags, and each bag is annotated with the proportion of each class occurring in that bag. Prior…

Machine Learning · Statistics 2020-06-15 Clayton Scott , Jianxin Zhang

Contrastive learning is a discriminative approach that aims at grouping similar samples closer and diverse samples far from each other. It it an efficient technique to train an encoder generating distinguishable and informative…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Qing Chen , Jian Zhang

In this paper, we propose a novel approach for learning multi-label classifiers with the help of privileged information. Specifically, we use similarity constraints to capture the relationship between available information and privileged…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Shiyu Chen , Shangfei Wang , Tanfang Chen , Xiaoxiao Shi