English
Related papers

Related papers: Decouple then Converge: Handling Unknown Unlabeled…

200 papers

Object frequency in the real world often follows a power law, leading to a mismatch between datasets with long-tailed class distributions seen by a machine learning model and our expectation of the model to perform well on all classes. We…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Muhammad Abdullah Jamal , Matthew Brown , Ming-Hsuan Yang , Liqiang Wang , Boqing Gong

Semi-supervised multi-label learning (SSMLL) aims to address the challenge of limited labeled data in multi-label learning (MLL) by leveraging unlabeled data to improve the model's performance. While pseudo-labeling has become a dominant…

Machine Learning · Computer Science 2025-12-03 Bo Han , Zhuoming Li , Xiaoyu Wang , Yaxin Hou , Hui Liu , Junhui Hou , Yuheng Jia

Conventional detectors suffer from performance degradation when dealing with long-tailed data due to a classification bias towards the majority head categories. In this paper, we contend that the learning bias originates from two factors:…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Tianhao Qi , Hongtao Xie , Pandeng Li , Jiannan Ge , Yongdong Zhang

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

Deep learning based task systems normally rely on a large amount of manually labeled training data, which is expensive to obtain and subject to operator variations. Moreover, it does not always hold that the manually labeled data and the…

Machine Learning · Computer Science 2019-07-25 Jun Chen , Heye Zhang , Yanping Zhang , Shu Zhao , Raad Mohiaddin , Tom Wong , David Firmin , Guang Yang , Jennifer Keegan

Real-world datasets often exhibit long-tailed distributions, where a few dominant "Head" classes have abundant samples while most "Tail" classes are severely underrepresented, leading to biased learning and poor generalization for the Tail.…

Machine Learning · Computer Science 2026-02-02 Mahdiyar Molahasani , Michael Greenspan , Ali Etemad

We present a new loss function called Distribution-Balanced Loss for the multi-label recognition problems that exhibit long-tailed class distributions. Compared to conventional single-label classification problem, multi-label recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Tong Wu , Qingqiu Huang , Ziwei Liu , Yu Wang , Dahua Lin

Real-world data typically follow a long-tailed distribution, where a few majority categories occupy most of the data while most minority categories contain a limited number of samples. Classification models minimizing cross-entropy struggle…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Jianggang Zhu , Zheng Wang , Jingjing Chen , Yi-Ping Phoebe Chen , Yu-Gang Jiang

Intelligent fault diagnosis (IFD) plays a crucial role in ensuring the safe operation of industrial machinery and improving production efficiency. However, traditional supervised deep learning methods require a large amount of training data…

Machine Learning · Computer Science 2025-07-22 Yajiao Dai , Jun Li , Zhen Mei , Yiyang Ni , Shi Jin , Zengxiang Li , Sheng Guo , Wei Xiang

Semi-supervised learning can significantly boost model performance by leveraging unlabeled data, particularly when labeled data is scarce. However, real-world unlabeled data often contain unseen-class samples, which can hinder the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Qikai Wang , Rundong He , Yongshun Gong , Chunxiao Ren , Haoliang Sun , Xiaoshui Huang , Yilong Yin

Multi-label text classification is a challenging task because it requires capturing label dependencies. It becomes even more challenging when class distribution is long-tailed. Resampling and re-weighting are common approaches used for…

Computation and Language · Computer Science 2021-10-19 Yi Huang , Buse Giledereli , Abdullatif Köksal , Arzucan Özgür , Elif Ozkirimli

Semi-supervised learning (SSL) has been proven beneficial for mitigating the issue of limited labeled data especially on the task of volumetric medical image segmentation. Unlike previous SSL methods which focus on exploring highly…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Qingjie Zeng , Yutong Xie , Zilin Lu , Mengkang Lu , Yong Xia

Class distribution mismatch (CDM) refers to the discrepancy between class distributions in training data and target tasks. Previous methods address this by designing classifiers to categorize classes known during training, while grouping…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Pan Du , Wangbo Zhao , Xinai Lu , Nian Liu , Zhikai Li , Chaoyu Gong , Suyun Zhao , Hong Chen , Cuiping Li , Kai Wang , Yang You

Long-tailed image recognition presents massive challenges to deep learning systems since the imbalance between majority (head) classes and minority (tail) classes severely skews the data-driven deep neural networks. Previous methods tackle…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yue Xu , Yong-Lu Li , Jiefeng Li , Cewu Lu

Semi-supervised learning (SSL) has tremendous value in practice due to its ability to utilize both labeled data and unlabelled data. An important class of SSL methods is to naturally represent data as graphs such that the label information…

Machine Learning · Computer Science 2021-03-01 Zixing Song , Xiangli Yang , Zenglin Xu , Irwin King

Deep learning enables impressive performance in image recognition using large-scale artificially-balanced datasets. However, real-world datasets exhibit highly class-imbalanced distributions, yielding two main challenges: relative imbalance…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Saurabh Sharma , Ning Yu , Mario Fritz , Bernt Schiele

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

Computation and Language · Computer Science 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao

Deep long-tailed learning, one of the most challenging problems in visual recognition, aims to train well-performing deep models from a large number of images that follow a long-tailed class distribution. In the last decade, deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yifan Zhang , Bingyi Kang , Bryan Hooi , Shuicheng Yan , Jiashi Feng

Learning from data sequentially arriving, possibly in a non i.i.d. way, with changing task distribution over time is called continual learning. Much of the work thus far in continual learning focuses on supervised learning and some recent…

Machine Learning · Computer Science 2021-10-06 Dhanajit Brahma , Vinay Kumar Verma , Piyush Rai

Recent state-of-the-art methods in imbalanced semi-supervised learning (SSL) rely on confidence-based pseudo-labeling with consistency regularization. To obtain high-quality pseudo-labels, a high confidence threshold is typically adopted.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Zhuoran Yu , Yin Li , Yong Jae Lee