English
Related papers

Related papers: Long-Tailed Recognition via Information-Preservabl…

200 papers

Model bias triggered by long-tailed data has been widely studied. However, measure based on the number of samples cannot explicate three phenomena simultaneously: (1) Given enough data, the classification performance gain is marginal with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Yanbiao Ma , Licheng Jiao , Fang Liu , Yuxin Li , Shuyuan Yang , Xu Liu

The generalization gap on the long-tailed data sets is largely owing to most categories only occupying a few training samples. Decoupled training achieves better performance by training backbone and classifier separately. What causes the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Zhiwei Zhang

For semi-supervised learning with imbalance classes, the long-tailed distribution of data will increase the model prediction bias toward dominant classes, undermining performance on less frequent classes. Existing methods also face…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Kuo Yang , Duo Li , Menghan Hu , Guangtao Zhai , Xiaokang Yang , Xiao-Ping Zhang

In the context of long-tail classification on graphs, the vast majority of existing work primarily revolves around the development of model debiasing strategies, intending to mitigate class imbalances and enhance the overall performance.…

Machine Learning · Computer Science 2024-06-03 Haohui Wang , Baoyu Jing , Kaize Ding , Yada Zhu , Wei Cheng , Si Zhang , Yonghui Fan , Liqing Zhang , Dawei Zhou

Differentially Private Stochastic Gradient Descent (DPSGD) is widely utilized to preserve training data privacy in deep learning, which first clips the gradients to a predefined norm and then injects calibrated noise into the training…

Machine Learning · Computer Science 2024-05-29 Haichao Sha , Yang Cao , Yong Liu , Yuncheng Wu , Ruixuan Liu , Hong Chen

Class imbalance is a common issue in real-world data distributions, negatively impacting the training of accurate classifiers. Traditional approaches to mitigate this problem fall into three main categories: class re-balancing, information…

Machine Learning · Computer Science 2024-06-26 Zhiwei Yao

Long-tailed learning has attracted much attention recently, with the goal of improving generalisation for tail classes. Most existing works use supervised learning without considering the prevailing noise in the training dataset. To move…

Machine Learning · Computer Science 2021-08-27 Tong Wei , Jiang-Xin Shi , Wei-Wei Tu , Yu-Feng Li

In the realm of edge computing, the increasing demand for high Quality of Service (QoS), particularly in dynamic multimedia streaming applications (e.g., Augmented Reality/Virtual Reality and online gaming), has prompted the need for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-29 Cheng Zhang , Yinuo Deng , Hailiang Zhao , Tianlv Chen , Shuiguang Deng

Class imbalance, which is also called long-tailed distribution, is a common problem in classification tasks based on machine learning. If it happens, the minority data will be overwhelmed by the majority, which presents quite a challenge…

Machine Learning · Computer Science 2023-03-29 Jia-Chen Zhao

Diffusion models have achieved impressive performance in generating high-quality and diverse synthetic data. However, their success typically assumes a class-balanced training distribution. In real-world settings, multi-class data often…

The problem of long-tailed recognition, where the number of examples per class is highly unbalanced, is considered. While training with class-balanced sampling has been shown effective for this problem, it is known to over-fit to few-shot…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Bo Liu , Haoxiang Li , Hao Kang , Gang Hua , Nuno Vasconcelos

In predictive tasks, real-world datasets often present different degrees of imbalanced (i.e., long-tailed or skewed) distributions. While the majority (the head) classes have sufficient samples, the minority (the tail) classes can be…

Machine Learning · Computer Science 2021-09-14 Chongsheng Zhang , Paolo Soda , Jingjun Bi , Gaojuan Fan , George Almpanidis , Salvador Garcia

Though Self-supervised learning (SSL) has been widely studied as a promising technique for representation learning, it doesn't generalize well on long-tailed datasets due to the majority classes dominating the feature space. Recent work…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Jianhong Bai , Zuozhu Liu , Hualiang Wang , Jin Hao , Yang Feng , Huanpeng Chu , Haoji Hu

Deep classifiers have achieved great success in visual recognition. However, real-world data is long-tailed by nature, leading to the mismatch between training and testing distributions. In this paper, we show that the Softmax function,…

Machine Learning · Computer Science 2020-11-24 Jiawei Ren , Cunjun Yu , Shunan Sheng , Xiao Ma , Haiyu Zhao , Shuai Yi , Hongsheng Li

Class-incremental learning is dedicated to the development of deep learning models that are capable of acquiring new knowledge while retaining previously learned information. Most methods focus on balanced data distribution for each task,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Linjie Li , Zhenyu Wu , Jiaming Liu , Yang Ji

Mixup is a popular data augmentation method, with many variants subsequently proposed. These methods mainly create new examples via convex combination of random data pairs and their corresponding one-hot labels. However, most of them adhere…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Shaoyu Zhang , Chen Chen , Xiujuan Zhang , Silong Peng

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Large language models (LLMs) have significantly advanced various natural language processing tasks, but deploying them remains computationally expensive. Knowledge distillation (KD) is a promising solution, enabling the transfer of…

Computation and Language · Computer Science 2024-10-22 Yuhang Zhou , Jing Zhu , Paiheng Xu , Xiaoyu Liu , Xiyao Wang , Danai Koutra , Wei Ai , Furong Huang

Modern image classifiers perform well on populated classes, while degrading considerably on tail classes with only a few instances. Humans, by contrast, effortlessly handle the long-tailed recognition challenge, since they can learn the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Yingjun Du , Jiayi Shen , Xiantong Zhen , Cees G. M. Snoek

Camera traps are a method for monitoring wildlife and they collect a large number of pictures. The number of images collected of each species usually follows a long-tail distribution, i.e., a few classes have a large number of instances,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Fagner Cunha , Eulanda M. dos Santos , Juan G. Colonna