English
Related papers

Related papers: Efficient Long-Tail Learning in Latent Space by sa…

200 papers

As the state-of-the-art machine learning methods in many fields rely on larger datasets, storing datasets and training models on them become significantly more expensive. This paper proposes a training set synthesis technique for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Konda Reddy Mopuri , Hakan Bilen

Long-tailed instance segmentation is a challenging task due to the extreme imbalance of training samples among classes. It causes severe biases of the head classes (with majority samples) against the tailed ones. This renders "how to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yin-Yin He , Peizhen Zhang , Xiu-Shen Wei , Xiangyu Zhang , Jian Sun

The imbalanced distribution of long-tailed data presents a significant challenge for deep learning models, causing them to prioritize head classes while neglecting tail classes. Two key factors contributing to low recognition accuracy are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Mengke Li , Zhikai Hu , Yang Lu , Weichao Lan , Yiu-ming Cheung , Hui Huang

Long-tailed image recognition is a computer vision problem considering a real-world class distribution rather than an artificial uniform. Existing methods typically detour the problem by i) adjusting a loss function, ii) decoupling…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Youngseok Yoon , Sangwoo Hong , Hyungjun Joo , Yao Qin , Haewon Jeong , Jungwoo Lee

In the real-world setting, data often follows a long-tailed distribution, where head classes contain significantly more training samples than tail classes. Consequently, models trained on such data tend to be biased toward head classes. The…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Fan Zhang , Wei Qin , Weijieying Ren , Lei Wang , Zetong Chen , Richang Hong

Long-tailed classification is challenging due to its heavy imbalance in class probabilities. While existing methods often focus on overall accuracy or accuracy for tail classes, they overlook a critical aspect: certain types of errors can…

Machine Learning · Computer Science 2025-01-27 Bolian Li , Ruqi Zhang

Few-shot image classification remains challenging due to the scarcity of labeled training examples. Augmenting them with synthetic data has emerged as a promising way to alleviate this issue, but models trained on synthetic samples often…

Machine Learning · Computer Science 2025-06-26 Lan-Cuong Nguyen , Quan Nguyen-Tri , Bang Tran Khanh , Dung D. Le , Long Tran-Thanh , Khoat Than

In the long-tailed recognition field, the Decoupled Training paradigm has demonstrated remarkable capabilities among various methods. This paradigm decouples the training process into separate representation learning and classifier…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Han Lu , Siyu Sun , Yichen Xie , Liqing Zhang , Xiaokang Yang , Junchi Yan

In the context of time series forecasting, it is a common practice to evaluate multiple methods and choose one of these methods or an ensemble for producing the best forecasts. However, choosing among different ensembles over multiple…

Machine Learning · Computer Science 2021-12-16 Himanshi Charotia , Abhishek Garg , Gaurav Dhama , Naman Maheshwari

Data in the real world tends to exhibit a long-tailed label distribution, which poses great challenges for the training of neural networks in visual recognition. Existing methods tackle this problem mainly from the perspective of data…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Yan Zhao , Weicong Chen , Xu Tan , Kai Huang , Jihong Zhu

Imbalanced datasets pose a considerable challenge in training deep learning (DL) models for medical diagnostics, particularly for segmentation tasks. Imbalance may be associated with annotation quality limited annotated datasets, rare…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Bashir Alam , Masa Cirkovic , Mete Harun Akcay , Md Kaf Shahrier , Sebastien Lafond , Hergys Rexha , Kurt Benke , Sepinoud Azimi , Janan Arslan

Many important problems in science and engineering, such as drug design, involve optimizing an expensive black-box objective function over a complex, high-dimensional, and structured input space. Although machine learning techniques have…

Machine Learning · Computer Science 2020-10-27 Austin Tripp , Erik Daxberger , José Miguel Hernández-Lobato

Conventional multi-label classification (MLC) methods assume that all samples are fully labeled and identically distributed. Unfortunately, this assumption is unrealistic in large-scale MLC data that has long-tailed (LT) distribution and…

Machine Learning · Computer Science 2023-04-24 Wenqiao Zhang , Changshuo Liu , Lingze Zeng , Beng Chin Ooi , Siliang Tang , Yueting Zhuang

Based on the success of large-scale visual foundation models like CLIP in various downstream tasks, this paper initially attempts to explore their impact on Long-Tailed Semi-Supervised Learning (LTSSL) by employing the foundation model with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Enhao Zhang , Chaohua Li , Chuanxing Geng , Songcan Chen

Traditionally, in supervised machine learning, (a significant) part of the available data (usually 50% to 80%) is used for training and the rest for validation. In many problems, however, the data is highly imbalanced in regard to different…

Machine Learning · Computer Science 2020-04-21 Xiaowei Gu , Plamen P Angelov , Eduardo Almeida Soares

Models trained on semantically related datasets and tasks exhibit comparable inter-sample relations within their latent spaces. We investigate in this study the aggregation of such latent spaces to create a unified space encompassing the…

Recognition problems in long-tailed data, in which the sample size per class is heavily skewed, have gained importance because the distribution of the sample size per class in a dataset is generally exponential unless the sample size is…

Machine Learning · Computer Science 2024-04-30 Naoya Hasegawa , Issei Sato

Real world data often exhibits a long-tailed and open-ended (with unseen classes) distribution. A practical recognition system must balance between majority (head) and minority (tail) classes, generalize across the distribution, and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Ziwei Liu , Zhongqi Miao , Xiaohang Zhan , Jiayun Wang , Boqing Gong , Stella X. Yu

Handling imbalance in class distribution when building a classifier over tabular data has been a problem of long-standing interest. One popular approach is augmenting the training dataset with synthetically generated data. While classical…

Machine Learning · Computer Science 2025-02-20 Annie D'souza , Swetha M , Sunita Sarawagi

Effectively handling the co-occurrence of non-IID data and long-tailed distributions remains a critical challenge in federated learning. While fine-tuning vision-language models (VLMs) like CLIP has shown to be promising in addressing…

Machine Learning · Computer Science 2025-03-11 Shihao Hou , Xinyi Shang , Shreyank N Gowda , Yang Lu , Chao Wu , Yan Yan , Hanzi Wang