English
Related papers

Related papers: Feature-Balanced Loss for Long-Tailed Visual Recog…

200 papers

Long-tail learning has received significant attention in recent years due to the challenge it poses with extremely imbalanced datasets. In these datasets, only a few classes (known as the head classes) have an adequate number of training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Jiang-Xin Shi , Tong Wei , Yuke Xiang , Yu-Feng Li

We propose a distance supervised relation extraction approach for long-tailed, imbalanced data which is prevalent in real-world settings. Here, the challenge is to learn accurate "few-shot" models for classes existing at the tail of the…

Information Retrieval · Computer Science 2023-01-26 Ningyu Zhang , Shumin Deng , Zhanlin Sun , Guanying Wang , Xi Chen , Wei Zhang , Huajun Chen

Federated learning offers a paradigm to the challenge of preserving privacy in distributed machine learning. However, datasets distributed across each client in the real world are inevitably heterogeneous, and if the datasets can be…

Machine Learning · Computer Science 2024-09-19 Xiuhua Lu , Peng Li , Xuefeng Jiang

Camera traps are a method for monitoring wildlife and they collect a large number of pictures. The number of images collected of each species usually follows a long-tail distribution, i.e., a few classes have a large number of instances,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Fagner Cunha , Eulanda M. dos Santos , Juan G. Colonna

Long-tailed image recognition is a computer vision problem considering a real-world class distribution rather than an artificial uniform. Existing methods typically detour the problem by i) adjusting a loss function, ii) decoupling…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Youngseok Yoon , Sangwoo Hong , Hyungjun Joo , Yao Qin , Haewon Jeong , Jungwoo Lee

Neural networks trained on real-world datasets with long-tailed label distributions are biased towards frequent classes and perform poorly on infrequent classes. The imbalance in the ratio of positive and negative samples for each class…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Kevin Duarte , Yogesh S. Rawat , Mubarak Shah

Real-world visual recognition problems often exhibit long-tailed distributions, where the amount of data for learning in different categories shows significant imbalance. Standard classification models learned on such data distribution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Chi Zhang , Guosheng Lin , Lvlong Lai , Henghui Ding , Qingyao Wu

Supervised Contrastive Loss (SCL) is popular in visual representation learning. Given an anchor image, SCL pulls two types of positive samples, i.e., its augmentation and other images from the same class together, while pushes negative…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shiyu Xuan , Shiliang Zhang

Real-world data usually couples the label ambiguity and heavy imbalance, challenging the algorithmic robustness of partial label learning (PLL) and long-tailed learning (LT). The straightforward combination of LT and PLL, i.e., LT-PLL,…

Machine Learning · Computer Science 2023-02-13 Feng Hong , Jiangchao Yao , Zhihan Zhou , Ya Zhang , Yanfeng Wang

Existing long-tailed classification (LT) methods only focus on tackling the class-wise imbalance that head classes have more samples than tail classes, but overlook the attribute-wise imbalance. In fact, even if the class is balanced,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Kaihua Tang , Mingyuan Tao , Jiaxin Qi , Zhenguang Liu , Hanwang Zhang

In this paper, we propose Parametric Contrastive Learning (PaCo) to tackle long-tailed recognition. Based on theoretical analysis, we observe supervised contrastive loss tends to bias on high-frequency classes and thus increases the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Jiequan Cui , Zhisheng Zhong , Shu Liu , Bei Yu , Jiaya Jia

Deep learning algorithms are well-known to have a propensity for fitting the training data very well and often fit even outliers and mislabeled data points. Such fitting requires memorization of training data labels, a phenomenon that has…

Machine Learning · Computer Science 2020-08-11 Vitaly Feldman , Chiyuan Zhang

Long-tailed problems in healthcare emerge from data imbalance due to variability in the prevalence and representation of different medical conditions, warranting the requirement of precise and dependable classification methods. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Pankhi Kashyap , Pavni Tandon , Sunny Gupta , Abhishek Tiwari , Ritwik Kulkarni , Kshitij Sharad Jadhav

The Federated Learning setting has a central server coordinating the training of a model on a network of devices. One of the challenges is variable training performance when the dataset has a class imbalance. In this paper, we address this…

Machine Learning · Computer Science 2020-11-13 Dipankar Sarkar , Ankur Narang , Sumit Rai

In scenarios with long-tailed distributions, the model's ability to identify tail classes is limited due to the under-representation of tail samples. Class rebalancing, information augmentation, and other techniques have been proposed to…

Machine Learning · Computer Science 2023-10-17 Yanbiao Ma , Licheng Jiao , Fang Liu , Shuyuan Yang , Xu Liu , Lingling Li

Effectively handling the co-occurrence of non-IID data and long-tailed distributions remains a critical challenge in federated learning. While fine-tuning vision-language models (VLMs) like CLIP has shown to be promising in addressing…

Machine Learning · Computer Science 2025-03-11 Shihao Hou , Xinyi Shang , Shreyank N Gowda , Yang Lu , Chao Wu , Yan Yan , Hanzi Wang

Learning an effective representation in multi-label text classification (MLTC) is a significant challenge in NLP. This challenge arises from the inherent complexity of the task, which is shaped by two key factors: the intricate connections…

Machine Learning · Computer Science 2024-04-16 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

Long-tailed instance segmentation is a challenging task due to the extreme imbalance of training samples among classes. It causes severe biases of the head classes (with majority samples) against the tailed ones. This renders "how to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yin-Yin He , Peizhen Zhang , Xiu-Shen Wei , Xiangyu Zhang , Jian Sun

The distribution of data in the world (eg, internet, etc.) significantly differs from the well-curated datasets and is often over-populated with samples from common categories. The algorithms designed for well-curated datasets perform…

Machine Learning · Computer Science 2025-07-30 Harsh Rangwani

In real-world datasets, the challenges of long-tailed distributions and noisy labels often coexist, posing obstacles to the model training and performance. Existing studies on long-tailed noisy label learning (LTNLL) typically assume that…

Machine Learning · Computer Science 2025-03-17 Chen Shu , Mengke Li , Yiqun Zhang , Yang Lu , Bo Han , Yiu-ming Cheung , Hanzi Wang