English
Related papers

Related papers: Local Rademacher Complexity for Multi-label Learni…

200 papers

In recent years, multi-label classification has attracted a significant body of research, motivated by real-life applications, such as text classification and medical diagnoses. Although sparsely studied in this context, Learning Classifier…

Neural and Evolutionary Computing · Computer Science 2015-12-29 Fani A. Tzima , Miltiadis Allamanis , Alexandros Filotheou , Pericles A. Mitkas

Collecting labeled data is costly and thus a critical bottleneck in real-world classification tasks. To mitigate this problem, we propose a novel setting, namely learning from complementary labels for multi-class classification. A…

Machine Learning · Statistics 2017-11-15 Takashi Ishida , Gang Niu , Weihua Hu , Masashi Sugiyama

We study learning algorithms that seek to minimize the conditional value-at-risk (CVaR), when all the learner knows is that the losses incurred may be heavy-tailed. We begin by studying a general-purpose estimator of CVaR for potentially…

Machine Learning · Statistics 2020-06-04 Matthew J. Holland , El Mehdi Haress

In real-world applications, as data availability increases, obtaining labeled data for machine learning (ML) projects remains challenging due to the high costs and intensive efforts required for data annotation. Many ML projects,…

Machine Learning · Computer Science 2024-12-24 Ismail Hakki Karaman , Gulser Koksal , Levent Eriskin , Salih Salihoglu

The theoretical and empirical performance of Empirical Risk Minimization (ERM) often suffers when loss functions are poorly behaved with large Lipschitz moduli and spurious sharp minimizers. We propose and analyze a counterpart to ERM…

Optimization and Control · Mathematics 2021-07-08 Matthew Norton , Johannes O. Royset

Multi-label classification (MLC) is a supervised learning problem in which, contrary to standard multiclass classification, an instance can be associated with several class labels simultaneously. In this chapter, we advocate a rule-based…

Machine Learning · Computer Science 2020-12-09 Eneldo Loza Mencía , Johannes Fürnkranz , Eyke Hüllermeier , Michael Rapp

We propose a meta-learning method for learning from multiple noisy annotators. In many applications such as crowdsourcing services, labels for supervised learning are given by multiple annotators. Since the annotators have different skills…

Machine Learning · Computer Science 2025-06-13 Atsutoshi Kumagai , Tomoharu Iwata , Taishi Nishiyama , Yasutoshi Ida , Yasuhiro Fujiwara

Multilabel learning tackles the problem of associating a sample with multiple class labels. This work proposes a new ensemble method for managing multilabel classification: the core of the proposed approach combines a set of gated recurrent…

Machine Learning · Computer Science 2022-08-24 Loris Nanni , Alessandra Lumini , Alessandro Manfe , Riccardo Rampon , Sheryl Brahnam , Giorgio Venturin

In multi-label classification, an instance may be associated with a set of labels simultaneously. Recently, the research on multi-label classification has largely shifted its focus to the other end of the spectrum where the number of labels…

Machine Learning · Computer Science 2016-04-06 Li Li , Houfeng Wang

Recently, metric learning and similarity learning have attracted a large amount of interest. Many models and optimisation algorithms have been proposed. However, there is relatively little work on the generalization analysis of such…

Machine Learning · Computer Science 2013-03-19 Qiong Cao , Zheng-Chu Guo , Yiming Ying

In many estimation problems, e.g. linear and logistic regression, we wish to minimize an unknown objective given only unbiased samples of the objective function. Furthermore, we aim to achieve this using as few samples as possible. In the…

Machine Learning · Statistics 2015-02-26 Roy Frostig , Rong Ge , Sham M. Kakade , Aaron Sidford

Extreme multi-label classification (XMC) is the problem of finding the relevant labels for an input, from a very large universe of possible labels. We consider XMC in the setting where labels are available only for groups of samples - but…

Machine Learning · Computer Science 2020-04-02 Yanyao Shen , Hsiang-fu Yu , Sujay Sanghavi , Inderjit Dhillon

We investigate the mechanisms of self-distillation in multi-class classification, particularly in the context of linear probing with fixed feature extractors where traditional feature learning explanations do not apply. Our theoretical…

Machine Learning · Computer Science 2025-02-20 Hyeonsu Jeong , Hye Won Chung

Multi-label learning has attracted the attention of the machine learning community. The problem conversion method Binary Relevance converts a familiar single label into a multi-label algorithm. The binary relevance method is widely used…

Machine Learning · Computer Science 2020-04-14 Yanghong Liu , Jia Lu , Tingting Li

As machine learning models continue to increase in complexity, collecting large hand-labeled training sets has become one of the biggest roadblocks in practice. Instead, weaker forms of supervision that provide noisier but cheaper labels…

Machine Learning · Statistics 2018-12-10 Alexander Ratner , Braden Hancock , Jared Dunnmon , Frederic Sala , Shreyash Pandey , Christopher Ré

The goal of eXtreme Multi-label Learning (XML) is to automatically annotate a given data point with the most relevant subset of labels from an extremely large vocabulary of labels (e.g., a million labels). Lately, many attempts have been…

Machine Learning · Computer Science 2021-10-18 Yashaswi Verma

State-of-the-art, high capacity deep neural networks not only require large amounts of labelled training data, they are also highly susceptible to label errors in this data, typically resulting in large efforts and costs and therefore…

Machine Learning · Computer Science 2020-07-20 Christian Haase-Schütz , Rainer Stal , Heinz Hertlein , Bernhard Sick

Data in the real-world classification problems are always imbalanced or long-tailed, wherein the majority classes have the most of the samples that dominate the model training. In such setting, the naive model tends to have poor performance…

Machine Learning · Computer Science 2023-08-30 Hong Zhu , Runpeng Yu , Xing Tang , Yifei Wang , Yuan Fang , Yisen Wang

Multi-label learning draws great interests in many real world applications. It is a highly costly task to assign many labels by the oracle for one instance. Meanwhile, it is also hard to build a good model without diagnosing discriminative…

Machine Learning · Computer Science 2019-04-16 Bo Du , Zengmao Wang , Lefei Zhang , Liangpei Zhang , Dacheng Tao

The problem of devising learning strategies for discrete losses (e.g., multilabeling, ranking) is currently addressed with methods and theoretical analyses ad-hoc for each loss. In this paper we study a least-squares framework to…

Machine Learning · Computer Science 2018-10-17 Alex Nowak-Vila , Francis Bach , Alessandro Rudi