English
Related papers

Related papers: Prior2Posterior: Model Prior Correction for Long-T…

200 papers

The fine-tuning paradigm has emerged as a prominent approach for addressing long-tail learning tasks in the era of foundation models. However, the impact of fine-tuning strategies on long-tail learning performance remains unexplored. In…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Jiang-Xin Shi , Tong Wei , Yu-Feng Li

Long-tailed datasets, where head classes comprise much more training samples than tail classes, cause recognition models to get biased towards the head classes. Weighted loss is one of the most popular ways of mitigating this issue, and a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Saptarshi Sinha , Hiroki Ohashi

For long-tailed classification, most works often pretrain a big model on a large-scale dataset, and then fine-tune the whole model for adapting to long-tailed data. Though promising, fine-tuning the whole pretrained model tends to suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Bowen Dong , Pan Zhou , Shuicheng Yan , Wangmeng Zuo

Most classification models work by first predicting a posterior probability distribution over all classes and then selecting that class with the largest estimated probability. In many settings however, the quality of posterior probability…

Computation and Language · Computer Science 2020-05-04 Taehee Jung , Dongyeop Kang , Hua Cheng , Lucas Mentch , Thomas Schaaf

Real-world data tends to follow a long-tailed distribution, where the class imbalance results in dominance of the head classes during training. In this paper, we propose a frustratingly simple but effective step-wise learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Na Dong , Yongqiang Zhang , Mingli Ding , Gim Hee Lee

Many real-world prediction tasks have outcome variables that have characteristic heavy-tail distributions. Examples include copies of books sold, auction prices of art pieces, demand for commodities in warehouses, etc. By learning…

Machine Learning · Computer Science 2023-10-13 Xindi Wang , Onur Varol , Tina Eliassi-Rad

The long-tailed image classification task remains important in the development of deep neural networks as it explicitly deals with large imbalances in the class frequencies of the training data. While uncommon in engineered datasets, this…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Marc-Antoine Lavoie , Steven Waslander

Deep neural networks still struggle on long-tailed image datasets, and one of the reasons is that the imbalance of training data across categories leads to the imbalance of trained model parameters. Motivated by the empirical findings that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Haoxuan Wang , Junchi Yan

One of the most profound challenges of modern machine learning is performing well on the long-tail of rare and underrepresented features. Large general-purpose models are trained for many tasks, but work best on high-frequency use cases.…

Computation and Language · Computer Science 2025-06-18 Daniel D'souza , Julia Kreutzer , Adrien Morisot , Ahmet Üstün , Sara Hooker

Trained models are often composed with post-hoc transforms such as temperature scaling (TS), ensembling and stochastic weight averaging (SWA) to improve performance, robustness, uncertainty estimation, etc. However, such transforms are…

Machine Learning · Computer Science 2024-10-07 Rishabh Ranjan , Saurabh Garg , Mrigank Raman , Carlos Guestrin , Zachary Lipton

Deep long-tailed learning, one of the most challenging problems in visual recognition, aims to train well-performing deep models from a large number of images that follow a long-tailed class distribution. In the last decade, deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yifan Zhang , Bingyi Kang , Bryan Hooi , Shuicheng Yan , Jiashi Feng

Long-tailed data is a special type of multi-class imbalanced data with a very large amount of minority/tail classes that have a very significant combined influence. Long-tailed learning aims to build high-performance models on datasets with…

Machine Learning · Computer Science 2024-08-02 Chongsheng Zhang , George Almpanidis , Gaojuan Fan , Binquan Deng , Yanbo Zhang , Ji Liu , Aouaidjia Kamel , Paolo Soda , João Gama

Benchmark datasets for visual recognition assume that data is uniformly distributed, while real-world datasets obey long-tailed distribution. Current approaches handle the long-tailed problem to transform the long-tailed dataset to uniform…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Renhui Zhang , Tiancheng Lin , Rui Zhang , Yi Xu

Long-tailed classification poses a challenge due to its heavy imbalance in class probabilities and tail-sensitivity risks with asymmetric misprediction costs. Recent attempts have used re-balancing loss and ensemble methods, but they are…

Machine Learning · Computer Science 2023-03-22 Bolian Li , Ruqi Zhang

Data uncertainty in practical person reID is ubiquitous, hence it requires not only learning the discriminative features, but also modeling the uncertainty based on the input. This paper proposes to learn the sample posterior and the class…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yan Zhang , Zhilin Zheng , Binyu He , Li Sun

Long-tailed distributions frequently emerge in real-world data, where a large number of minority categories contain a limited number of samples. Such imbalance issue considerably impairs the performance of standard supervised learning…

Machine Learning · Computer Science 2024-03-15 Chaoqun Du , Yulin Wang , Shiji Song , Gao Huang

In real-world scenarios, where knowledge distributions exhibit long-tail. Humans manage to master knowledge uniformly across imbalanced distributions, a feat attributed to their diligent practices of reviewing, summarizing, and correcting…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Qihao Zhao , Yalun Dai , Shen Lin , Wei Hu , Fan Zhang , Jun Liu

Recently, long-tailed image classification harvests lots of research attention, since the data distribution is long-tailed in many real-world situations. Piles of algorithms are devised to address the data imbalance problem by biasing the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Chaowei Fang , Dingwen Zhang , Wen Zheng , Xue Li , Le Yang , Lechao Cheng , Junwei Han

As the data scale grows, deep recognition models often suffer from long-tailed data distributions due to the heavy imbalanced sample number across categories. Indeed, real-world data usually exhibit some similarity relation among different…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Lei Liu , Li Liu

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Zhisheng Zhong , Jiequan Cui , Shu Liu , Jiaya Jia