English
Related papers

Related papers: On The Relationship Between Continual Learning and…

200 papers

In this work, we address the challenging task of long-tailed image recognition. Previous long-tailed recognition methods commonly focus on the data augmentation or re-balancing strategy of the tail classes to give more attention to tail…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Weide Liu , Zhonghua Wu , Yiming Wang , Henghui Ding , Fayao Liu , Jie Lin , Guosheng Lin

Deploying deep models in real-world scenarios entails a number of challenges, including computational efficiency and real-world (e.g., long-tailed) data distributions. We address the combined challenge of learning long-tailed distributions…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jihun Kim , Dahyun Kim , Hyungrok Jung , Taeil Oh , Jonghyun Choi

Long-tailed visual recognition has received increasing attention in recent years. Due to the extremely imbalanced data distribution in long-tailed learning, the learning process shows great uncertainties. For example, the predictions of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Zichang Tan , Jun Li , Jinhao Du , Jun Wan , Zhen Lei , Guodong Guo

In vision domain, large-scale natural datasets typically exhibit long-tailed distribution which has large class imbalance between head and tail classes. This distribution poses difficulty in learning good representations for tail classes.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Anthony Meng Huat Tiong , Junnan Li , Guosheng Lin , Boyang Li , Caiming Xiong , Steven C. H. Hoi

In class incremental learning (CIL) a model must learn new classes in a sequential manner without forgetting old ones. However, conventional CIL methods consider a balanced distribution for each new task, which ignores the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Xialei Liu , Yu-Song Hu , Xu-Sheng Cao , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Zhisheng Zhong , Jiequan Cui , Shu Liu , Jiaya Jia

Long-tailed semi-supervised learning poses a significant challenge in training models with limited labeled data exhibiting a long-tailed label distribution. Current state-of-the-art LTSSL approaches heavily rely on high-quality…

Machine Learning · Computer Science 2024-10-10 Zi-Hao Zhou , Siyuan Fang , Zi-Jing Zhou , Tong Wei , Yuanyu Wan , Min-Ling Zhang

Continual learning from a sequential stream of data is a crucial challenge for machine learning research. Most studies have been conducted on this topic under the single-label classification setting along with an assumption of balanced…

Machine Learning · Computer Science 2020-09-09 Chris Dongjoo Kim , Jinseo Jeong , Gunhee Kim

Many data distributions in the real world are hardly uniform. Instead, skewed and long-tailed distributions of various kinds are commonly observed. This poses an interesting problem for machine learning, where most algorithms assume or work…

Machine Learning · Computer Science 2024-04-25 Charika de Alvis , Suranga Seneviratne

Long-tailed image recognition presents massive challenges to deep learning systems since the imbalance between majority (head) classes and minority (tail) classes severely skews the data-driven deep neural networks. Previous methods tackle…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yue Xu , Yong-Lu Li , Jiefeng Li , Cewu Lu

How to estimate the uncertainty of a given model is a crucial problem. Current calibration techniques treat different classes equally and thus implicitly assume that the distribution of training data is balanced, but ignore the fact that…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Jiahao Chen , Bing Su

The long-tailed recognition (LTR) is the task of learning high-performance classifiers given extremely imbalanced training samples between categories. Most of the existing works address the problem by either enhancing the features of tail…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Haixu Long , Xiaolin Zhang , Yanbin Liu , Zongtai Luo , Jianbo Liu

Existing out-of-distribution (OOD) methods have shown great success on balanced datasets but become ineffective in long-tailed recognition (LTR) scenarios where 1) OOD samples are often wrongly classified into head classes and/or 2)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Wenjun Miao , Guansong Pang , Tianqi Li , Xiao Bai , Jin Zheng

Imbalanced classification datasets pose significant challenges in machine learning, often leading to biased models that perform poorly on underrepresented classes. With the rise of foundation models, recent research has focused on the full,…

Machine Learning · Computer Science 2025-09-22 Nakul Sharma

Benchmark datasets for visual recognition assume that data is uniformly distributed, while real-world datasets obey long-tailed distribution. Current approaches handle the long-tailed problem to transform the long-tailed dataset to uniform…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Renhui Zhang , Tiancheng Lin , Rui Zhang , Yi Xu

Although contrastive learning methods have shown prevailing performance on a variety of representation learning tasks, they encounter difficulty when the training dataset is long-tailed. Many researchers have combined contrastive learning…

Machine Learning · Computer Science 2023-08-09 Min-Kook Suh , Seung-Woo Seo

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Real-world data often follow a long-tailed distribution with a high imbalance in the number of samples between classes. The problem with training from imbalanced data is that some background features, common to all classes, can be…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Sanglee Park , Seung-won Hwang , Jungmin So

Continual learning (CL) learns a sequence of tasks incrementally with the goal of achieving two main objectives: overcoming catastrophic forgetting (CF) and encouraging knowledge transfer (KT) across tasks. However, most existing techniques…

Computation and Language · Computer Science 2021-12-21 Zixuan Ke , Bing Liu , Nianzu Ma , Hu Xu , Lei Shu

Label distributions in camera-trap images are highly imbalanced and long-tailed, resulting in neural networks tending to be biased towards head-classes that appear frequently. Although long-tail learning has been extremely explored to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Byeongjun Park , Jeongsoo Kim , Seungju Cho , Heeseon Kim , Changick Kim