English
Related papers

Related papers: Distribution-Balanced Loss for Multi-Label Classif…

200 papers

Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and…

Machine Learning · Computer Science 2024-02-20 Huafeng Liu , Mengmeng Sheng , Zeren Sun , Yazhou Yao , Xian-Sheng Hua , Heng-Tao Shen

Multi-label Classification (MLC) assigns an instance to one or more non-exclusive classes. A challenge arises when the dataset contains a large proportion of instances with no assigned class, referred to as negative data, which can…

Machine Learning · Computer Science 2025-06-09 Dumindu Tissera , Omar Awadallah , Muhammad Umair Danish , Ayan Sadhu , Katarina Grolinger

In multi-task learning, labels are often missing irregularly across samples, which can be fully labeled, partially labeled or unlabeled. The irregular label presence often appears in scientific studies due to experimental limitations. It…

Machine Learning · Computer Science 2025-08-07 Mingqian Li , Qiao Han , Ruifeng Li , Yao Yang , Hongyang Chen

In real-world data, long-tailed data distribution is common, making it challenging for models trained on empirical risk minimisation to learn and classify tail classes effectively. While many studies have sought to improve long tail…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Ziheng Wang , Toni Lassila , Sharib Ali

In real-world datasets, the challenges of long-tailed distributions and noisy labels often coexist, posing obstacles to the model training and performance. Existing studies on long-tailed noisy label learning (LTNLL) typically assume that…

Machine Learning · Computer Science 2025-03-17 Chen Shu , Mengke Li , Yiqun Zhang , Yang Lu , Bo Han , Yiu-ming Cheung , Hanzi Wang

(Partial) ranking loss is a commonly used evaluation measure for multi-label classification, which is usually optimized with convex surrogates for computational efficiency. Prior theoretical work on multi-label ranking mainly focuses on…

Machine Learning · Computer Science 2021-05-12 Guoqiang Wu , Chongxuan Li , Kun Xu , Jun Zhu

The effectiveness of contrastive learning technology in natural language processing tasks is yet to be explored and analyzed. How to construct positive and negative samples correctly and reasonably is the core challenge of contrastive…

Computation and Language · Computer Science 2023-07-17 Nankai Lin , Guanqiu Qin , Jigang Wang , Aimin Yang , Dong Zhou

Multi-task learning (MTL) considers learning a joint model for multiple tasks by optimizing a convex combination of all task losses. To solve the optimization problem, existing methods use an adaptive weight updating scheme, where task…

Machine Learning · Computer Science 2024-07-22 Yifei He , Shiji Zhou , Guojun Zhang , Hyokun Yun , Yi Xu , Belinda Zeng , Trishul Chilimbi , Han Zhao

Class distribution plays an important role in learning deep classifiers. When the proportion of each class in the test set differs from the training set, the performance of classification nets usually degrades. Such a label distribution…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Wenao Ma , Cheng Chen , Shuang Zheng , Jing Qin , Huimao Zhang , Qi Dou

Mixture models are flexible tools in density estimation and classification problems. Bayesian estimation of such models typically relies on sampling from the posterior distribution using Markov chain Monte Carlo. Label switching arises…

Applications · Statistics 2014-03-11 Wanchuang Zhu , Yanan Fan

Despite impressive accuracy, deep neural networks are often miscalibrated and tend to overly confident predictions. Recent techniques like temperature scaling (TS) and label smoothing (LS) show effectiveness in obtaining a well-calibrated…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Mobarakol Islam , Lalithkumar Seenivasan , Hongliang Ren , Ben Glocker

Most of the medical tasks naturally exhibit a long-tailed distribution due to the complex patient-level conditions and the existence of rare diseases. Existing long-tailed learning methods usually treat each class equally to re-balance the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Lie Ju , Yicheng Wu , Lin Wang , Zhen Yu , Xin Zhao , Xin Wang , Paul Bonnington , Zongyuan Ge

This paper explores the application of a simple weighted loss function to Transformer-based models for multi-label emotion detection in SemEval-2025 Shared Task 11. Our approach addresses data imbalance by dynamically adjusting class…

Computation and Language · Computer Science 2026-02-05 Xia Cui

In modern classification tasks, the number of labels is getting larger and larger, as is the size of the datasets encountered in practice. As the number of classes increases, class ambiguity and class imbalance become more and more…

Machine Learning · Statistics 2022-07-19 Camille Garcin , Maximilien Servajean , Alexis Joly , Joseph Salmon

In the real world, long-tailed data distributions are prevalent, making it challenging for models to effectively learn and classify tail classes. However, we discover that in the field of drug chemistry, certain tail classes exhibit higher…

Machine Learning · Computer Science 2025-04-08 Yujia Su , Xinjie Li , Lionel Z. Wang

Imbalanced data distributions are prevalent in real-world scenarios, posing significant challenges in both imbalanced classification and imbalanced regression tasks. They often cause deep learning models to overfit in areas of high sample…

Machine Learning · Computer Science 2025-03-31 Guangkun Nie , Gongzheng Tang , Shenda Hong

Cross-entropy loss and focal loss are the most common choices when training deep neural networks for classification problems. Generally speaking, however, a good loss function can take on much more flexible forms, and should be tailored for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Zhaoqi Leng , Mingxing Tan , Chenxi Liu , Ekin Dogus Cubuk , Xiaojie Shi , Shuyang Cheng , Dragomir Anguelov

Deep neural networks usually perform poorly when the training dataset suffers from extreme class imbalance. Recent studies found that directly training with out-of-distribution data (i.e., open-set samples) in a semi-supervised manner would…

Machine Learning · Computer Science 2022-07-06 Hongxin Wei , Lue Tao , Renchunzi Xie , Lei Feng , Bo An

Multi-label learning studies the problem where an instance is associated with a set of labels. By treating single-label learning problem as one task, the multi-label learning problem can be casted as solving multiple related tasks…

Machine Learning · Computer Science 2019-11-20 Lu Bai , Yew-Soon Ong , Tiantian He , Abhishek Gupta

Loss reweighting is a widely used strategy for long-tailed classification, but existing reweighting strategies often rely on heuristics and rarely define a well-specified target. Inspired by Neural Collapse (NC), the ideal simplex…

Machine Learning · Computer Science 2026-05-12 Jinping Wang , Zixin Tong , Zhiwu Xie , Zhiqiang Gao