English
Related papers

Related papers: Efficient Long-Tail Learning in Latent Space by sa…

200 papers

The distribution of data in the world (eg, internet, etc.) significantly differs from the well-curated datasets and is often over-populated with samples from common categories. The algorithms designed for well-curated datasets perform…

Machine Learning · Computer Science 2025-07-30 Harsh Rangwani

In real-world scenarios, where knowledge distributions exhibit long-tail. Humans manage to master knowledge uniformly across imbalanced distributions, a feat attributed to their diligent practices of reviewing, summarizing, and correcting…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Qihao Zhao , Yalun Dai , Shen Lin , Wei Hu , Fan Zhang , Jun Liu

Real-world data often follow a long-tailed distribution with a high imbalance in the number of samples between classes. The problem with training from imbalanced data is that some background features, common to all classes, can be…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Sanglee Park , Seung-won Hwang , Jungmin So

Long-tailed classification poses a challenge due to its heavy imbalance in class probabilities and tail-sensitivity risks with asymmetric misprediction costs. Recent attempts have used re-balancing loss and ensemble methods, but they are…

Machine Learning · Computer Science 2023-03-22 Bolian Li , Ruqi Zhang

Most existing object instance detection and segmentation models only work well on fairly balanced benchmarks where per-category training sample numbers are comparable, such as COCO. They tend to suffer performance drop on realistic datasets…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Tao Wang , Yu Li , Bingyi Kang , Junnan Li , Junhao Liew , Sheng Tang , Steven Hoi , Jiashi Feng

The long-tailed distribution datasets poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class-balacing strategies or transfer learing from…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Gongzhe Li , Zhiwen Tan , Linpeng Pan

Class imbalance is a ubiquitous phenomenon occurring in real world data distributions. To overcome its detrimental effect on training accurate classifiers, existing work follows three major directions: class re-balancing, information…

Machine Learning · Computer Science 2022-10-04 Rahul Duggal , Shengyun Peng , Hao Zhou , Duen Horng Chau

The long-tailed class distribution in visual recognition tasks poses great challenges for neural networks on how to handle the biased predictions between head and tail classes, i.e., the model tends to classify tail classes as head classes.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yidong Wang , Bowen Zhang , Wenxin Hou , Zhen Wu , Jindong Wang , Takahiro Shinozaki

We introduce LPT++, a comprehensive framework for long-tailed classification that combines parameter-efficient fine-tuning (PEFT) with a learnable model ensemble. LPT++ enhances frozen Vision Transformers (ViTs) through the integration of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Bowen Dong , Pan Zhou , Wangmeng Zuo

Data privacy and long-tailed distribution are the norms rather than the exception in many real-world tasks. This paper investigates a federated long-tailed learning (Fed-LT) task in which each client holds a locally heterogeneous dataset;…

Machine Learning · Computer Science 2023-11-28 Zikai Xiao , Zihan Chen , Songshang Liu , Hualiang Wang , Yang Feng , Jin Hao , Joey Tianyi Zhou , Jian Wu , Howard Hao Yang , Zuozhu Liu

Deep learning-based food image classification enables precise identification of food categories, further facilitating accurate nutritional analysis. However, real-world food images often show a skewed distribution, with some food types…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 GaYeon Koh , Hyun-Jic Oh , Jeonghyun Noh , Won-Ki Jeong

Long-tailed multi-label visual recognition (LTML) task is a highly challenging task due to the label co-occurrence and imbalanced data distribution. In this work, we propose a unified framework for LTML, namely prompt tuning with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Peng Xia , Di Xu , Ming Hu , Lie Ju , Zongyuan Ge

Long-tail learning has received significant attention in recent years due to the challenge it poses with extremely imbalanced datasets. In these datasets, only a few classes (known as the head classes) have an adequate number of training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Jiang-Xin Shi , Tong Wei , Yuke Xiang , Yu-Feng Li

As deep learning models grow in complexity and the volume of training data increases, reducing storage and computational costs becomes increasingly important. Dataset distillation addresses this challenge by synthesizing a compact set of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhe Li , Sarah Cechnicka , Cheng Ouyang , Katharina Breininger , Peter Schüffler , Bernhard Kainz

Object detection has been widely explored for class-balanced datasets such as COCO. However, real-world scenarios introduce the challenge of long-tailed distributions, where numerous categories contain only a few instances. This inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Satyam Gaba

With the rapid increase of large-scale, real-world datasets, it becomes critical to address the problem of long-tailed data distribution (i.e., a few classes account for most of the data, while most classes are under-represented). Existing…

Computer Vision and Pattern Recognition · Computer Science 2019-01-18 Yin Cui , Menglin Jia , Tsung-Yi Lin , Yang Song , Serge Belongie

One of the most profound challenges of modern machine learning is performing well on the long-tail of rare and underrepresented features. Large general-purpose models are trained for many tasks, but work best on high-frequency use cases.…

Computation and Language · Computer Science 2025-06-18 Daniel D'souza , Julia Kreutzer , Adrien Morisot , Ahmet Üstün , Sara Hooker

Real-world data often have a long-tailed distribution, where the number of samples per class is not equal over training classes. The imbalanced data form a biased feature space, which deteriorates the performance of the recognition model.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Minki Jeong , Changick Kim

Real-world data typically follow a long-tailed distribution, where a few majority categories occupy most of the data while most minority categories contain a limited number of samples. Classification models minimizing cross-entropy struggle…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Jianggang Zhu , Zheng Wang , Jingjing Chen , Yi-Ping Phoebe Chen , Yu-Gang Jiang

Methods in long-tail learning focus on improving performance for data-poor (rare) classes; however, performance for such classes remains much lower than performance for more data-rich (frequent) classes. Analyzing the predictions of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Nadine Chang , Jayanth Koushik , Aarti Singh , Martial Hebert , Yu-Xiong Wang , Michael J. Tarr