English
Related papers

Related papers: Propheter: Prophetic Teacher Guided Long-Tailed Di…

200 papers

Long-tailed distributions frequently emerge in real-world data, where a large number of minority categories contain a limited number of samples. Such imbalance issue considerably impairs the performance of standard supervised learning…

Machine Learning · Computer Science 2024-03-15 Chaoqun Du , Yulin Wang , Shiji Song , Gao Huang

The long-tailed recognition (LTR) is the task of learning high-performance classifiers given extremely imbalanced training samples between categories. Most of the existing works address the problem by either enhancing the features of tail…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Haixu Long , Xiaolin Zhang , Yanbin Liu , Zongtai Luo , Jianbo Liu

Dataset distillation aims to synthesize a small, information-rich dataset from a large one for efficient model training. However, existing dataset distillation methods struggle with long-tailed datasets, which are prevalent in real-world…

Machine Learning · Computer Science 2025-03-20 Zhenghao Zhao , Haoxuan Wang , Yuzhang Shang , Kai Wang , Yan Yan

We tackle the long-tailed visual recognition problem from the knowledge distillation perspective by proposing a Distill the Virtual Examples (DiVE) method. Specifically, by treating the predictions of a teacher model as virtual examples, we…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Yin-Yin He , Jianxin Wu , Xiu-Shen Wei

The current evaluation protocol of long-tailed visual recognition trains the classification model on the long-tailed source label distribution and evaluates its performance on the uniform target label distribution. Such protocol has…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Youngkyu Hong , Seungju Han , Kwanghee Choi , Seokjun Seo , Beomsu Kim , Buru Chang

There is an inescapable long-tailed class-imbalance issue in many real-world classification problems. Current methods for addressing this problem only consider scenarios where all examples come from the same distribution. However, in many…

Machine Learning · Computer Science 2023-10-09 Xinyu Yang , Huaxiu Yao , Allan Zhou , Chelsea Finn

In the real world, long-tailed data distributions are prevalent, making it challenging for models to effectively learn and classify tail classes. However, we discover that in the field of drug chemistry, certain tail classes exhibit higher…

Machine Learning · Computer Science 2025-04-08 Yujia Su , Xinjie Li , Lionel Z. Wang

Large language models (LLMs) are trained on web-scale corpora that exhibit steep power-law distributions, in which the distribution of knowledge is highly long-tailed, with most appearing infrequently. While scaling has improved…

Computation and Language · Computer Science 2026-02-19 Sanket Badhe , Deep Shah , Nehal Kathrotia

Long-term trajectory forecasting is an important and challenging problem in the fields of computer vision, machine learning, and robotics. One fundamental difficulty stands in the evolution of the trajectory that becomes more and more…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sourav Das , Guglielmo Camporese , Shaokang Cheng , Lamberto Ballan

We introduce the \textsc{Tailed-Uniform} proposal distribution for generating training simulations in simulation-based inference. Instead of sampling parameters uniformly within bounded regions, we extend the distribution beyond prior…

Instrumentation and Methods for Astrophysics · Physics 2026-01-27 Chaipat Tirapongprasert , Matthew Ho

Recognition problems in long-tailed data, in which the sample size per class is heavily skewed, have gained importance because the distribution of the sample size per class in a dataset is generally exponential unless the sample size is…

Machine Learning · Computer Science 2024-04-30 Naoya Hasegawa , Issei Sato

Real-world data often exhibits a long-tailed distribution, in which head classes occupy most of the data, while tail classes only have very few samples. Models trained on long-tailed datasets have poor adaptability to tail classes and the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Qiong Chen , Tianlin Huang , Geren Zhu , Enlu Lin

As a safety critical task, autonomous driving requires accurate predictions of road users' future trajectories for safe motion planning, particularly under challenging conditions. Yet, many recent deep learning methods suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Junrui Zhang , Mozhgan Pourkeshavarz , Amir Rasouli

Real-world visual recognition problems often exhibit long-tailed distributions, where the amount of data for learning in different categories shows significant imbalance. Standard classification models learned on such data distribution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Chi Zhang , Guosheng Lin , Lvlong Lai , Henghui Ding , Qingyao Wu

Deep neural networks often degrade significantly when training data suffer from class imbalance problems. Existing approaches, e.g., re-sampling and re-weighting, commonly address this issue by rearranging the label distribution of training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Renzhen Wang , Kaiqin Hu , Yanwen Zhu , Jun Shu , Qian Zhao , Deyu Meng

Long-tailed multi-label visual recognition poses a significant challenge, as images typically contain multiple labels with highly imbalanced class distributions, leading to biased models that favor head classes while underperforming on tail…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Wei Tang , Zuo-Zheng Wang , Kun Zhang , Tong Wei , Min-Ling Zhang

Long-tailed data is still a big challenge for deep neural networks, even though they have achieved great success on balanced data. We observe that vanilla training on long-tailed data with cross-entropy loss makes the instance-rich head…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Mengke Li , Yiu-ming Cheung , Yang Lu

Real-world data often exhibits long tail distributions with heavy class imbalance, where the majority classes can dominate the training process and alter the decision boundaries of the minority classes. Recently, researchers have…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Tianhong Li , Peng Cao , Yuan Yuan , Lijie Fan , Yuzhe Yang , Rogerio Feris , Piotr Indyk , Dina Katabi

The success of deep learning depends on large-scale and well-curated training data, while data in real-world applications are commonly long-tailed and noisy. Many methods have been proposed to deal with long-tailed data or noisy data, while…

Machine Learning · Computer Science 2023-05-30 Lefan Zhang , Zhang-Hao Tian , Wujun Zhou , Wei Wang

Deep neural network models degrade significantly in the long-tailed data distribution, with the overall training data dominated by a small set of classes in the head, and the tail classes obtaining less training examples. Addressing the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Brainard Philemon Jagati , Jitendra Tembhurne , Harsh Goud , Rudra Pratap Singh , Chandrashekhar Meshram