English
Related papers

Related papers: Invariant Feature Learning for Generalized Long-Ta…

200 papers

Balancing performance trade-off on long-tail (LT) data distributions remains a long-standing challenge. In this paper, we posit that this dilemma stems from a phenomenon called "tail performance degradation" (the model tends to severely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shenghan Chen , Yiming Liu , Yanzhen Wang , Yujia Wang , Xiankai Lu

In this paper, our goal is to design a simple learning paradigm for long-tail visual recognition, which not only improves the robustness of the feature extractor but also alleviates the bias of the classifier towards head classes while…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Fei Du , Peng Yang , Qi Jia , Fengtao Nan , Xiaoting Chen , Yun Yang

Real-world data often exhibits a long-tailed distribution, in which head classes occupy most of the data, while tail classes only have very few samples. Models trained on long-tailed datasets have poor adaptability to tail classes and the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Qiong Chen , Tianlin Huang , Geren Zhu , Enlu Lin

In this work, we tackle the challenging problem of long-tailed image recognition. Previous long-tailed recognition approaches mainly focus on data augmentation or re-balancing strategies for the tail classes to give them more attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Weide Liu , Zhonghua Wu , Yiming Wang , Henghui Ding , Fayao Liu , Jie Lin , Guosheng Lin

Data privacy and class imbalance are the norm rather than the exception in many machine learning tasks. Recent attempts have been launched to, on one side, address the problem of learning from pervasive private data, and on the other side,…

Machine Learning · Computer Science 2022-07-01 Zihan Chen , Songshang Liu , Hualiang Wang , Howard H. Yang , Tony Q. S. Quek , Zuozhu Liu

Machine learning (ML) models have difficulty generalizing when the number of training class instances are numerically imbalanced. The problem of generalization in the face of data imbalance has largely been attributed to the lack of…

Machine Learning · Computer Science 2024-07-16 Damien A. Dablain , Nitesh V. Chawla

Deep learning enables impressive performance in image recognition using large-scale artificially-balanced datasets. However, real-world datasets exhibit highly class-imbalanced distributions, yielding two main challenges: relative imbalance…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Saurabh Sharma , Ning Yu , Mario Fritz , Bernt Schiele

Real-world data typically follow a long-tailed distribution, where a few majority categories occupy most of the data while most minority categories contain a limited number of samples. Classification models minimizing cross-entropy struggle…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Jianggang Zhu , Zheng Wang , Jingjing Chen , Yi-Ping Phoebe Chen , Yu-Gang Jiang

Federated learning is designed to enhance data security and privacy, but faces challenges when dealing with heterogeneous data in long-tailed and non-IID distributions. This paper explores an overlooked scenario where tail classes are…

Machine Learning · Computer Science 2024-03-14 Zhuoxin Chen , Zhenyu Wu , Yang Ji

Real-world data is extremely imbalanced and presents a long-tailed distribution, resulting in models that are biased towards classes with sufficient samples and perform poorly on rare classes. Recent methods propose to rebalance classes but…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Weiqi Li , Fan Lyu , Fanhua Shang , Liang Wan , Wei Feng

Recently, long-tailed image classification harvests lots of research attention, since the data distribution is long-tailed in many real-world situations. Piles of algorithms are devised to address the data imbalance problem by biasing the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Chaowei Fang , Dingwen Zhang , Wen Zheng , Xue Li , Le Yang , Lechao Cheng , Junwei Han

We propose a simple data model inspired from natural data such as text or images, and use it to study the importance of learning features in order to achieve good generalization. Our data model follows a long-tailed distribution in the…

Machine Learning · Computer Science 2023-01-02 Thomas Laurent , James H. von Brecht , Xavier Bresson

Object frequency in the real world often follows a power law, leading to a mismatch between datasets with long-tailed class distributions seen by a machine learning model and our expectation of the model to perform well on all classes. We…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Muhammad Abdullah Jamal , Matthew Brown , Ming-Hsuan Yang , Liqiang Wang , Boqing Gong

Generalized Category Discovery (GCD) utilizes labeled samples of known classes to discover novel classes in unlabeled samples. Existing methods show effective performance on artificial datasets with balanced distributions. However,…

Artificial Intelligence · Computer Science 2025-07-31 Cuong Manh Hoang

The problem of long-tailed recognition, where the number of examples per class is highly unbalanced, is considered. It is hypothesized that the well known tendency of standard classifier training to overfit to popular classes can be…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Bo Liu , Haoxiang Li , Hao Kang , Gang Hua , Nuno Vasconcelos

Balancing training on long-tail data distributions remains a long-standing challenge in deep learning. While methods such as re-weighting and re-sampling help alleviate the imbalance issue, limited sample diversity continues to hinder…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shizhen Zhao , Xin Wen , Jiahui Liu , Chuofan Ma , Chunfeng Yuan , Xiaojuan Qi

How to estimate the uncertainty of a given model is a crucial problem. Current calibration techniques treat different classes equally and thus implicitly assume that the distribution of training data is balanced, but ignore the fact that…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Jiahao Chen , Bing Su

Class imbalance has been extensively studied in single-view scenarios; however, addressing this challenge in multi-view contexts remains an open problem, with even scarcer research focusing on trustworthy solutions. In this paper, we tackle…

Machine Learning · Computer Science 2025-11-13 Chuanqing Tang , Yifei Shi , Guanghao Lin , Lei Xing , Long Shi

This paper considers learning deep features from long-tailed data. We observe that in the deep feature space, the head classes and the tail classes present different distribution patterns. The head classes have a relatively large spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Jialun Liu , Yifan Sun , Chuchu Han , Zhaopeng Dou , Wenhui Li

This paper introduces a novel perspective about error in machine learning and proposes inverse feature learning (IFL) as a representation learning approach that learns a set of high-level features based on the representation of error for…

Machine Learning · Computer Science 2020-03-10 Behzad Ghazanfari , Fatemeh Afghah