English
Related papers

Related papers: OSDTW: Optimal Shared Depth and Task Weighting for…

200 papers

In the long-tailed recognition field, the Decoupled Training paradigm has demonstrated remarkable capabilities among various methods. This paradigm decouples the training process into separate representation learning and classifier…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Han Lu , Siyu Sun , Yichen Xie , Liqing Zhang , Xiaokang Yang , Junchi Yan

While modern visual recognition systems have made significant advancements, many continue to struggle with the open problem of learning from few exemplars. This paper focuses on the task of object detection in the setting where object…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Phi Vu Tran

It is not uncommon that real-world data are distributed with a long tail. For such data, the learning of deep neural networks becomes challenging because it is hard to classify tail classes correctly. In the literature, several existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Mengke Li , Yiu-ming Cheung , Yang Lu , Zhikai Hu , Weichao Lan , Hui Huang

Existing out-of-distribution (OOD) detection methods are typically benchmarked on training sets with balanced class distributions. However, in real-world applications, it is common for the training sets to have long-tailed distributions. In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Haotao Wang , Aston Zhang , Yi Zhu , Shuai Zheng , Mu Li , Alex Smola , Zhangyang Wang

Training on datasets with long-tailed distributions has been challenging for major recognition tasks such as classification and detection. To deal with this challenge, image resampling is typically introduced as a simple but effective…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Nadine Chang , Zhiding Yu , Yu-Xiong Wang , Anima Anandkumar , Sanja Fidler , Jose M. Alvarez

Long-tailed recognition is ubiquitous and challenging in deep learning and even in the downstream finetuning of foundation models, since the skew class distribution generally prevents the model generalization to the tail classes. Despite…

Machine Learning · Computer Science 2025-10-10 Jiaan Luo , Feng Hong , Qiang Hu , Xiaofeng Cao , Feng Liu , Jiangchao Yao

Machine unlearning, which aims to efficiently remove the influence of specific data from trained models, is crucial for upholding data privacy regulations like the ``right to be forgotten". However, existing research predominantly evaluates…

Machine Learning · Computer Science 2026-02-24 Liheng Yu , Zhe Zhao , Yuxuan Wang , Pengkun Wang , Xiaofeng Cao , Binwu Wang , Yang Wang

Machine learning models fail to perform well on real-world applications when 1) the category distribution P(Y) of the training dataset suffers from long-tailed distribution and 2) the test data is drawn from different conditional…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Xiao Gu , Yao Guo , Zeju Li , Jianing Qiu , Qi Dou , Yuxuan Liu , Benny Lo , Guang-Zhong Yang

Domain Generalization (DG) seeks to train models that perform reliably on unseen target domains without access to target data during training. While recent progress in smoothing the loss landscape has improved generalization, existing…

Artificial Intelligence · Computer Science 2025-06-11 Sunny Gupta , Nikita Jangid , Shounak Das , Amit Sethi

In many real-world applications, the frequency distribution of class labels for training data can exhibit a long-tailed distribution, which challenges traditional approaches of training deep neural networks that require heavy amounts of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Richard Franklin , Jiawei Yao , Deyang Zhong , Qi Qian , Juhua Hu

Real-world data often exhibits a long-tailed distribution, in which head classes occupy most of the data, while tail classes only have very few samples. Models trained on long-tailed datasets have poor adaptability to tail classes and the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Qiong Chen , Tianlin Huang , Geren Zhu , Enlu Lin

Natural data are often long-tail distributed over semantic classes. Existing recognition methods tackle this imbalanced classification by placing more emphasis on the tail data, through class re-balancing/re-weighting or ensembling over…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Xudong Wang , Long Lian , Zhongqi Miao , Ziwei Liu , Stella X. Yu

How to estimate the uncertainty of a given model is a crucial problem. Current calibration techniques treat different classes equally and thus implicitly assume that the distribution of training data is balanced, but ignore the fact that…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Jiahao Chen , Bing Su

Real-world visual data often exhibits a long-tailed distribution, where some ''head'' classes have a large number of samples, yet only a few samples are available for ''tail'' classes. Such imbalanced distribution causes a great challenge…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Junjie Zhang , Lingqiao Liu , Peng Wang , Chunhua Shen

Multi-task learning (MTL) concurrently trains a model on diverse task datasets to exploit common features, thereby improving overall performance across the tasks. Recent studies have dedicated efforts to merging multiple independent model…

Machine Learning · Computer Science 2025-06-16 Bingjie Zhang , Hongkang Li , Changlong Shi , Guowei Rong , He Zhao , Dongsheng Wang , Dandan Guo , Meng Wang

Multi-task learning (MTL) aims at solving multiple related tasks simultaneously and has experienced rapid growth in recent years. However, MTL models often suffer from performance degeneration with negative transfer due to learning several…

Machine Learning · Computer Science 2023-02-01 Xin Dong , Ruize Wu , Chao Xiong , Hai Li , Lei Cheng , Yong He , Shiyou Qian , Jian Cao , Linjian Mo

Object frequency in the real world often follows a power law, leading to a mismatch between datasets with long-tailed class distributions seen by a machine learning model and our expectation of the model to perform well on all classes. We…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Muhammad Abdullah Jamal , Matthew Brown , Ming-Hsuan Yang , Liqiang Wang , Boqing Gong

This paper introduces a two-stage framework designed to enhance long-tail class incremental learning, enabling the model to progressively learn new classes, while mitigating catastrophic forgetting in the context of long-tailed data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jayateja Kalla , Soma Biswas

In this work, we address the challenging task of long-tailed image recognition. Previous long-tailed recognition methods commonly focus on the data augmentation or re-balancing strategy of the tail classes to give more attention to tail…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Weide Liu , Zhonghua Wu , Yiming Wang , Henghui Ding , Fayao Liu , Jie Lin , Guosheng Lin

Real-world data is often unbalanced and long-tailed, but deep models struggle to recognize rare classes in the presence of frequent classes. To address unbalanced data, most studies try balancing the data, the loss, or the classifier to…

Machine Learning · Computer Science 2021-11-02 Dvir Samuel , Gal Chechik