English
Related papers

Related papers: Long-tailed Recognition with Model Rebalancing

200 papers

Class imbalance is a common challenge in real-world recognition tasks, where the majority of classes have few samples, also known as tail classes. We address this challenge with the perspective of generalization and empirically find that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yixuan Zhou , Yi Qu , Xing Xu , Hengtao Shen

Pre-training plays a vital role in various vision tasks, such as object recognition and detection. Commonly used pre-training methods, which typically rely on randomized approaches like uniform or Gaussian distributions to initialize model…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Chen-Long Duan , Yong Li , Xiu-Shen Wei , Lin Zhao

Multi-label classification has received considerable interest in recent years. Multi-label classifiers have to address many problems including: handling large-scale datasets with many instances and a large set of labels, compensating…

Machine Learning · Computer Science 2016-06-21 Amirhossein Akbarnejad , Mahdieh Soleymani Baghshah

Deep learning algorithms can fare poorly when the training dataset suffers from heavy class-imbalance but the testing criterion requires good generalization on less frequent classes. We design two novel methods to improve performance in…

Machine Learning · Computer Science 2019-10-29 Kaidi Cao , Colin Wei , Adrien Gaidon , Nikos Arechiga , Tengyu Ma

Class imbalance and noisy labels are the norm rather than the exception in many large-scale classification datasets. Nevertheless, most works in machine learning typically assume balanced and clean data. There have been some recent attempts…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Shyamgopal Karthik , Jérome Revaud , Boris Chidlovskii

Real-world data tends to follow a long-tailed distribution, where the class imbalance results in dominance of the head classes during training. In this paper, we propose a frustratingly simple but effective step-wise learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Na Dong , Yongqiang Zhang , Mingli Ding , Gim Hee Lee

Generalized Class Discovery (GCD) plays a pivotal role in discerning both known and unknown categories from unlabeled datasets by harnessing the insights derived from a labeled set comprising recognized classes. A significant limitation in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Ziyun Li , Christoph Meinel , Haojin Yang

The variance in class-wise sample sizes within long-tailed scenarios often results in degraded performance in less frequent classes. Fortunately, foundation models, pre-trained on vast open-world datasets, demonstrate strong potential for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yufei Peng , Yonggang Zhang , Yiu-ming Cheung

Integrating supervised contrastive loss to cross entropy-based communication has recently been proposed as a solution to address the long-tail learning problem. However, when the class imbalance ratio is high, it requires adjusting the…

Machine Learning · Computer Science 2024-07-10 Charika De Alvis , Dishanika Denipitiyage , Suranga Seneviratne

Long-tailed data is prevalent in real-world classification tasks and heavily relies on supervised information, which makes the annotation process exceptionally labor-intensive and time-consuming. Unfortunately, despite being a common…

Machine Learning · Computer Science 2024-12-04 Meng Wei , Zhongnian Li , Yong Zhou , Xinzheng Xu

Multi-label learning predicts a subset of labels from a given label set for an unseen instance while considering label correlations. A known challenge with multi-label classification is the long-tailed distribution of labels. Many studies…

Machine Learning · Computer Science 2021-12-06 Vithya Yogarajan , Bernhard Pfahringer , Tony Smith , Jacob Montiel

The current evaluation protocol of long-tailed visual recognition trains the classification model on the long-tailed source label distribution and evaluates its performance on the uniform target label distribution. Such protocol has…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Youngkyu Hong , Seungju Han , Kwanghee Choi , Seokjun Seo , Beomsu Kim , Buru Chang

The long-tailed distribution datasets poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class-balacing strategies or transfer learing from…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Gongzhe Li , Zhiwen Tan , Linpeng Pan

Deep neural networks still struggle on long-tailed image datasets, and one of the reasons is that the imbalance of training data across categories leads to the imbalance of trained model parameters. Motivated by the empirical findings that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Haoxuan Wang , Junchi Yan

Our work focuses on tackling the challenging but natural visual recognition task of long-tailed data distribution (i.e., a few classes occupy most of the data, while most classes have rarely few samples). In the literature, class…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Boyan Zhou , Quan Cui , Xiu-Shen Wei , Zhao-Min Chen

Real-world data often have a long-tailed distribution, where the number of samples per class is not equal over training classes. The imbalanced data form a biased feature space, which deteriorates the performance of the recognition model.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Minki Jeong , Changick Kim

The conventional detectors tend to make imbalanced classification and suffer performance drop, when the distribution of the training data is severely skewed. In this paper, we propose to use the mean classification score to indicate the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Chengjian Feng , Yujie Zhong , Weilin Huang

Motivation: Despite recent advancements in semantic representation driven by pre-trained and large-scale language models, addressing long tail challenges in multi-label text classification remains a significant issue. Long tail challenges…

Computation and Language · Computer Science 2025-03-12 Yan Yan , Junyuan Liu , Bo-Wen Zhang

Latent Variable Models (LVMs) are a large family of machine learning models providing a principled and effective way to extract underlying patterns, structure and knowledge from observed data. Due to the dramatic growth of volume and…

Machine Learning · Computer Science 2015-12-24 Pengtao Xie , Yuntian Deng , Eric Xing

Class-incremental learning is dedicated to the development of deep learning models that are capable of acquiring new knowledge while retaining previously learned information. Most methods focus on balanced data distribution for each task,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Linjie Li , Zhenyu Wu , Jiaming Liu , Yang Ji