English
Related papers

Related papers: A Unified View of Multi-Label Performance Measures

200 papers

In multi-label classification, where a single example may be associated with several class labels at the same time, the ability to model dependencies between labels is considered crucial to effectively optimize non-decomposable evaluation…

Machine Learning · Computer Science 2021-06-23 Michael Rapp , Eneldo Loza Mencía , Johannes Fürnkranz , Eyke Hüllermeier

Multi-label learning deals with the problem that each instance is associated with multiple labels simultaneously. Most of the existing approaches aim to improve the performance of multi-label learning by exploiting label correlations.…

Machine Learning · Computer Science 2022-01-19 Senlin Shu , Fengmao Lv , Yan Yan , Li Li , Shuo He , Jun He

Learning-enabled control systems increasingly rely on multiple sensing modalities (e.g., vision, audio, language, etc.) for perception and decision support. A key challenge is that multi-modal sensor training dynamics are often imbalanced:…

Machine Learning · Computer Science 2026-04-01 Heshan Fernando , Quan Xiao , Parikshit Ram , Yi Zhou , Horst Samulowitz , Nathalie Baracaldo , Tianyi Chen

Given a labeled training set and a collection of unlabeled data, the goal of active learning (AL) is to identify the best unlabeled points to label. In this comprehensive study, we analyze the performance of a variety of AL algorithms on…

Machine Learning · Computer Science 2022-10-11 Dara Bahri , Heinrich Jiang , Tal Schuster , Afshin Rostamizadeh

\textit{Multiple Instance Learning} (MIL) is concerned with learning from bags of instances, where only bag labels are given and instance labels are unknown. Existent approaches in this field were mainly designed for the bag-level label…

Machine Learning · Computer Science 2019-05-30 Minlong Peng , Qi Zhang

Label ranking is a prediction task which deals with learning a mapping between an instance and a ranking (i.e., order) of labels from a finite set, representing their relevance to the instance. Boosting is a well-known and reliable ensemble…

Machine Learning · Computer Science 2020-09-24 Lihi Dery , Erez Shmueli

A variety of modern applications exhibit multi-view multi-label learning, where each sample has multi-view features, and multiple labels are correlated via common views. Current methods usually fail to directly deal with the setting where…

Machine Learning · Computer Science 2023-08-30 Zhiwei Li , Zijian Yang , Lu Sun , Mineichi Kudo , Kego Kimura

Machine learning-based classifiers are commonly evaluated by metrics like accuracy, but deeper analysis is required to understand their strengths and weaknesses. MLMC is a visual exploration tool that tackles the challenge of multi-label…

Machine Learning · Computer Science 2025-01-27 Aleksandar Doknic , Torsten Möller

We propose a novel Riemannian method for solving the Extreme multi-label classification problem that exploits the geometric structure of the sparse low-dimensional local embedding models. A constrained optimization problem is formulated as…

Optimization and Control · Mathematics 2021-10-01 Jayadev Naram , Tanmay Kumar Sinha , Pawan Kumar

The F-measure, which has originally been introduced in information retrieval, is nowadays routinely used as a performance metric for problems such as binary classification, multi-label classification, and structured output prediction.…

Machine Learning · Statistics 2015-03-09 Willem Waegeman , Krzysztof Dembczynski , Arkadiusz Jachnik , Weiwei Cheng , Eyke Hullermeier

Learning to Rank (LTR) technique is ubiquitous in the Information Retrieval system nowadays, especially in the Search Ranking application. The query-item relevance labels typically used to train the ranking model are often noisy…

Information Retrieval · Computer Science 2022-07-11 Debabrata Mahapatra , Chaosheng Dong , Yetian Chen , Deqiang Meng , Michinari Momma

Classification algorithms aim to predict an unknown label (e.g., a quality class) for a new instance (e.g., a product). Therefore, training samples (instances and labels) are used to deduct classification hypotheses. Often, it is relatively…

Machine Learning · Computer Science 2019-01-30 Daniel Kottke , Jim Schellinger , Denis Huseljic , Bernhard Sick

We study an extreme scenario in multi-label learning where each training instance is endowed with a single one-bit label out of multiple labels. We formulate this problem as a non-trivial special case of one-bit rank-one matrix sensing and…

Machine Learning · Statistics 2017-03-20 Shuang Qiu , Tingjin Luo , Jieping Ye , Ming Lin

Annotating data for multi-label classification is prohibitively expensive because every category of interest must be confirmed to be present or absent. Recent work on single positive multi-label (SPML) learning shows that it is possible to…

Machine Learning · Computer Science 2023-05-26 Julio Arroyo , Pietro Perona , Elijah Cole

So far, multi-label classification algorithms have been evaluated using statistical methods that do not consider the semantics of the considered classes and that fully depend on abstract computations such as Bayesian Reasoning. Currently,…

Machine Learning · Computer Science 2021-08-17 Houcemeddine Turki , Mohamed Ali Hadj Taieb , Mohamed Ben Aouicha

Algorithm performance in supervised learning is a combination of memorization, generalization, and luck. By estimating how much information an algorithm can memorize from a dataset, we can set a lower bound on the amount of performance due…

Machine Learning · Computer Science 2020-03-19 Pedro Sandoval Segura , Julius Lauw , Daniel Bashir , Kinjal Shah , Sonia Sehra , Dominique Macias , George Montanez

Variational mutual information (MI) estimators are widely used in unsupervised representation learning methods such as contrastive predictive coding (CPC). A lower bound on MI can be obtained from a multi-class classification problem, where…

Machine Learning · Computer Science 2020-12-04 Jiaming Song , Stefano Ermon

We present a new perspective on the popular multi-class algorithmic techniques of one-vs-all and error correcting output codes. Rather than studying the behavior of these techniques for supervised learning, we establish a connection between…

Machine Learning · Computer Science 2016-11-28 Maria Florina Balcan , Travis Dick , Yishay Mansour

This work focuses on the problem of multi-label learning with missing labels (MLML), which aims to label each test instance with multiple class labels given training instances that have an incomplete/partial set of these labels. The key…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Baoyuan Wu , Fan Jia , Wei Liu , Bernard Ghanem , Siwei Lyu

Multi-label classification (MLC) is the task of assigning a set of target labels for a given sample. Modeling the combinatorial label interactions in MLC has been a long-haul challenge. We propose Label Message Passing (LaMP) Neural…

Machine Learning · Computer Science 2019-04-18 Jack Lanchantin , Arshdeep Sekhon , Yanjun Qi