English
Related papers

Related papers: sigmoidF1: A Smooth F1 Score Surrogate Loss for Mu…

200 papers

Machine learning approaches to multi-label document classification have to date largely relied on discriminative modeling techniques such as support vector machines. A drawback of these approaches is that performance rapidly drops off as…

Machine Learning · Statistics 2011-11-11 Timothy N. Rubin , America Chambers , Padhraic Smyth , Mark Steyvers

Classification is a fundamental task in machine learning. While conventional methods-such as binary, multiclass, and multi-label classification-are effective for simpler problems, they may not adequately address the complexities of some…

Multi-label feature selection (FS) reduces the dimensionality of multi-label data by removing irrelevant, noisy, and redundant features, thereby boosting the performance of multi-label learning models. However, existing methods typically…

Machine Learning · Computer Science 2025-11-25 Afsaneh Mahanipour , Hana Khamfroush

Noisy labels pose a common challenge for training accurate deep neural networks. To mitigate label noise, prior studies have proposed various robust loss functions to achieve noise tolerance in the presence of label noise, particularly…

Machine Learning · Computer Science 2025-08-05 Jialiang Wang , Xiong Zhou , Deming Zhai , Junjun Jiang , Xiangyang Ji , Xianming Liu

Label smoothing is widely used in deep neural networks for multi-class classification. While it enhances model generalization and reduces overconfidence by aiming to lower the probability for the predicted class, it distorts the predicted…

Machine Learning · Computer Science 2021-10-12 Mohamed Maher , Meelis Kull

Robust loss functions are essential for training deep neural networks with better generalization power in the presence of noisy labels. Symmetric loss functions are confirmed to be robust to label noise. However, the symmetric condition is…

Machine Learning · Computer Science 2021-06-08 Xiong Zhou , Xianming Liu , Junjun Jiang , Xin Gao , Xiangyang Ji

Active learning is a promising paradigm to reduce the labeling cost by strategically requesting labels to improve model performance. However, existing active learning methods often rely on expensive acquisition function to compute,…

Machine Learning · Computer Science 2023-10-27 Zixin Ding , Si Chen , Ruoxi Jia , Yuxin Chen

In this work, we addressed the issue of applying a stochastic classifier and a local, fuzzy confusion matrix under the framework of multi-label classification. We proposed a novel solution to the problem of correcting label pairwise…

Machine Learning · Computer Science 2018-02-08 Pawel Trajdos , Marek Kurzynski

It has been observed that machine learning algorithms exhibit biased predictions against certain population groups. To mitigate such bias while achieving comparable accuracy, a promising approach is to introduce surrogate functions of the…

Machine Learning · Computer Science 2024-04-10 Wei Yao , Zhanke Zhou , Zhicong Li , Bo Han , Yong Liu

Intelligent fault diagnosis (IFD) plays a crucial role in ensuring the safe operation of industrial machinery and improving production efficiency. However, traditional supervised deep learning methods require a large amount of training data…

Machine Learning · Computer Science 2025-07-22 Yajiao Dai , Jun Li , Zhen Mei , Yiyang Ni , Shi Jin , Zengxiang Li , Sheng Guo , Wei Xiang

Multicalibration requires predicted scores to agree with label probabilities across rich families of subgroups and score-dependent tests, but existing methods require clean input-label pairs for evaluation and post-processing. This…

Machine Learning · Statistics 2026-05-12 Futoshi Futami , Takashi Ishida

Multi-label learning in the presence of missing labels (MLML) is a challenging problem. Existing methods mainly focus on the design of network structures or training schemes, which increase the complexity of implementation. This work seeks…

Machine Learning · Computer Science 2021-12-28 Youcai Zhang , Yuhao Cheng , Xinyu Huang , Fei Wen , Rui Feng , Yaqian Li , Yandong Guo

Multilabel classification is an emergent data mining task with a broad range of real world applications. Learning from imbalanced multilabel data is being deeply studied latterly, and several resampling methods have been proposed in the…

Machine Learning · Computer Science 2018-02-15 Francisco Charte , Antonio J. Rivera , María J. del Jesus , Francisco Herrera

Self-supervised learning in the federated learning paradigm has been gaining a lot of interest both in industry and research due to the collaborative learning capability on unlabeled yet isolated data. However, self-supervised based…

Machine Learning · Computer Science 2025-02-05 Sunder Ali Khowaja , Kapal Dev , Syed Muhammad Anwar , Marius George Linguraru

We study consistency properties of surrogate loss functions for general multiclass learning problems, defined by a general multiclass loss matrix. We extend the notion of classification calibration, which has been studied for binary and…

Machine Learning · Computer Science 2015-08-25 Harish G. Ramaswamy , Shivani Agarwal

Deep metric learning has yielded impressive results in tasks such as clustering and image retrieval by leveraging neural networks to obtain highly discriminative feature embeddings, which can be used to group samples into different classes.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Ismail Elezi , Sebastiano Vascon , Alessandro Torcinovich , Marcello Pelillo , Laura Leal-Taixe

This paper provides new insight into maximizing F1 scores in the context of binary classification and also in the context of multilabel classification. The harmonic mean of precision and recall, F1 score is widely used to measure the…

Machine Learning · Statistics 2014-05-15 Zachary Chase Lipton , Charles Elkan , Balakrishnan Narayanaswamy

Annotating data for multi-label classification is prohibitively expensive because every category of interest must be confirmed to be present or absent. Recent work on single positive multi-label (SPML) learning shows that it is possible to…

Machine Learning · Computer Science 2023-05-26 Julio Arroyo , Pietro Perona , Elijah Cole

Exploiting multiple modalities for semantic scene parsing has been shown to improve accuracy over the singlemodality scenario. However multimodal datasets often suffer from problems such as data misalignment and label inconsistencies, where…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Sarah Taghavi Namin , Mohammad Najafi , Mathieu Salzmann , Lars Petersson

This paper analyzes and compares different deep learning loss functions in the framework of multi-label remote sensing (RS) image scene classification problems. We consider seven loss functions: 1) cross-entropy loss; 2) focal loss; 3)…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Hichame Yessou , Gencer Sumbul , Begüm Demir