English
Related papers

Related papers: Invariant Feature Learning for Generalized Long-Ta…

200 papers

The conventional detectors tend to make imbalanced classification and suffer performance drop, when the distribution of the training data is severely skewed. In this paper, we propose to use the mean classification score to indicate the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Chengjian Feng , Yujie Zhong , Weilin Huang

Graph Neural Networks (GNNs) are powerful tools for processing relational data but often struggle to generalize to unseen graphs, giving rise to the development of Graph Foundational Models (GFMs). However, current GFMs are challenged by…

Machine Learning · Computer Science 2026-05-25 Weishuo Ma , Yanbo Wang , Xiyuan Wang , Lei Zou , Muhan Zhang

Class imbalance, which is also called long-tailed distribution, is a common problem in classification tasks based on machine learning. If it happens, the minority data will be overwhelmed by the majority, which presents quite a challenge…

Machine Learning · Computer Science 2023-03-29 Jia-Chen Zhao

Federated learning (FL) is an emerging paradigm that permits a large number of clients with heterogeneous data to coordinate learning of a unified global model without the need to share data amongst each other. A major challenge in…

Machine Learning · Computer Science 2023-11-16 Irene Tenison , Sai Aravind Sreeramadas , Vaikkunth Mugunthan , Edouard Oyallon , Irina Rish , Eugene Belilovsky

Foundation models like CLIP allow zero-shot transfer on various tasks without additional training data. Yet, the zero-shot performance is less competitive than a fully supervised one. Thus, to enhance the performance, fine-tuning and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Beier Zhu , Kaihua Tang , Qianru Sun , Hanwang Zhang

Federated Learning (FL) aims at unburdening the training of deep models by distributing computation across multiple devices (clients) while safeguarding data privacy. On top of that, Federated Continual Learning (FCL) also accounts for data…

Machine Learning · Computer Science 2025-05-27 Riccardo Salami , Pietro Buzzega , Matteo Mosconi , Mattia Verasani , Simone Calderara

Long-tail class incremental learning (LT CIL) remains highly challenging because the scarcity of samples in tail classes not only hampers their learning but also exacerbates catastrophic forgetting under continuously evolving and imbalanced…

Artificial Intelligence · Computer Science 2026-03-24 Xi Wang , Xu Yang , Donghao Sun , Cheng Deng

Classification on long-tailed distributed data is a challenging problem, which suffers from serious class-imbalance and accordingly unpromising performance especially on tail classes. Recently, the ensembling based methods achieve the…

Machine Learning · Computer Science 2022-03-28 Bolian Li , Zongbo Han , Haining Li , Huazhu Fu , Changqing Zhang

Federated learning (FL) provides a privacy-preserving solution for distributed machine learning tasks. One challenging problem that severely damages the performance of FL models is the co-occurrence of data heterogeneity and long-tail…

Machine Learning · Computer Science 2022-04-29 Xinyi Shang , Yang Lu , Gang Huang , Hanzi Wang

Deep neural network models degrade significantly in the long-tailed data distribution, with the overall training data dominated by a small set of classes in the head, and the tail classes obtaining less training examples. Addressing the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Brainard Philemon Jagati , Jitendra Tembhurne , Harsh Goud , Rudra Pratap Singh , Chandrashekhar Meshram

Solving long-tail large vocabulary object detection with deep learning based models is a challenging and demanding task, which is however under-explored.In this work, we provide the first systematic analysis on the underperformance of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-20 Yu Li , Tao Wang , Bingyi Kang , Sheng Tang , Chunfeng Wang , Jintao Li , Jiashi Feng

Real-world visual recognition requires handling the extreme sample imbalance in large-scale long-tailed data. We propose a "divide&conquer" strategy for the challenging LVIS task: divide the whole data into balanced parts and then apply…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Xinting Hu , Yi Jiang , Kaihua Tang , Jingyuan Chen , Chunyan Miao , Hanwang Zhang

The great success of Convolutional Neural Networks (CNN) for facial attribute prediction relies on a large amount of labeled images. Facial image datasets are usually annotated by some commonly used attributes (e.g., gender), while labels…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Fariborz Taherkhani , Ali Dabouei , Sobhan Soleymani , Jeremy Dawson , Nasser M. Nasrabadi

To address the challenges of long-tailed classification, researchers have proposed several approaches to reduce model bias, most of which assume that classes with few samples are weak classes. However, recent studies have shown that tail…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yanbiao Ma , Licheng Jiao , Fang Liu , Maoji Wen , Lingling Li , Wenping Ma , Shuyuan Yang , Xu Liu , Puhua Chen

Machine learning models fail to perform well on real-world applications when 1) the category distribution P(Y) of the training dataset suffers from long-tailed distribution and 2) the test data is drawn from different conditional…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Xiao Gu , Yao Guo , Zeju Li , Jianing Qiu , Qi Dou , Yuxuan Liu , Benny Lo , Guang-Zhong Yang

Anomaly detection (AD) aims to identify defective images and localize their defects (if any). Ideally, AD models should be able to detect defects over many image classes; without relying on hard-coded class names that can be uninformative…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Chih-Hui Ho , Kuan-Chuan Peng , Nuno Vasconcelos

Data collected from the real world typically exhibit long-tailed distributions, where frequent classes contain abundant data while rare ones have only a limited number of samples. While existing supervised learning approaches have been…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Ci-Siang Lin , Min-Hung Chen , Yu-Chiang Frank Wang

Long-tailed object detection faces great challenges because of its extremely imbalanced class distribution. Recent methods mainly focus on the classification bias and its loss function design, while ignoring the subtle influence of the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Ke Zhu , Minghao Fu , Jie Shao , Tianyu Liu , Jianxin Wu

Large language models are typically post-trained using supervised fine-tuning (SFT) and reinforcement learning (RL), yet effectively unifying efficient knowledge injection with robust generalization remains challenging. In this work, we…

Artificial Intelligence · Computer Science 2026-05-05 Wangjie Gan , Miao Pan , Linbo Xi , Wenqi Zhang , Jintao Chen , Jianwei Yin , Xuhong Zhang

In the context of long-tail classification on graphs, the vast majority of existing work primarily revolves around the development of model debiasing strategies, intending to mitigate class imbalances and enhance the overall performance.…

Machine Learning · Computer Science 2024-06-03 Haohui Wang , Baoyu Jing , Kaize Ding , Yada Zhu , Wei Cheng , Si Zhang , Yonghui Fan , Liqing Zhang , Dawei Zhou