English
Related papers

Related papers: Trustworthy Long-Tailed Classification

200 papers

In vision domain, large-scale natural datasets typically exhibit long-tailed distribution which has large class imbalance between head and tail classes. This distribution poses difficulty in learning good representations for tail classes.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Anthony Meng Huat Tiong , Junnan Li , Guosheng Lin , Boyang Li , Caiming Xiong , Steven C. H. Hoi

Dataset distillation creates a small distilled set that enables efficient training by capturing key information from the full dataset. While existing dataset distillation methods perform well on balanced datasets, they struggle under…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Xiao Cui , Yulei Qin , Xinyue Li , Wengang Zhou , Hongsheng Li , Houqiang Li

Current out-of-distribution (OOD) detection methods typically assume balanced in-distribution (ID) data, while most real-world data follow a long-tailed distribution. Previous approaches to long-tailed OOD detection often involve balancing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Yina He , Lei Peng , Yongcun Zhang , Juanjuan Weng , Zhiming Luo , Shaozi Li

To address the problem of long-tail distribution for the large vocabulary object detection task, existing methods usually divide the whole categories into several groups and treat each group with different strategies. These methods bring…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Tong Wang , Yousong Zhu , Chaoyang Zhao , Wei Zeng , Jinqiao Wang , Ming Tang

Real-world data is extremely imbalanced and presents a long-tailed distribution, resulting in models that are biased towards classes with sufficient samples and perform poorly on rare classes. Recent methods propose to rebalance classes but…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Weiqi Li , Fan Lyu , Fanhua Shang , Liang Wan , Wei Feng

Evidential deep learning (EDL) has shown remarkable success in uncertainty estimation. However, there is still room for improvement, particularly in out-of-distribution (OOD) detection and classification tasks. The limited OOD detection…

Machine Learning · Computer Science 2025-10-15 Taeseong Yoon , Heeyoung Kim

By introducing a weight function into the density power divergence, we develop a new class of robust and smooth estimators for the tail index of Pareto-type distributions, offering improved efficiency in the presence of outliers. These…

Statistics Theory · Mathematics 2025-07-25 Saida Mancer , Abdelhakim Necir , Djamel Meraghni

We present a new loss function called Distribution-Balanced Loss for the multi-label recognition problems that exhibit long-tailed class distributions. Compared to conventional single-label classification problem, multi-label recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Tong Wu , Qingqiu Huang , Ziwei Liu , Yu Wang , Dahua Lin

Long-tailed datasets are very frequently encountered in real-world use cases where few classes or categories (known as majority or head classes) have higher number of data samples compared to the other classes (known as minority or tail…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Saptarshi Sinha , Hiroki Ohashi , Katsuyuki Nakamura

We introduce a new type of estimator for the spectral tail process of a regularly varying time series. The approach is based on a characterizing invariance property of the spectral tail process, which is incorporated into the new estimator…

Statistics Theory · Mathematics 2021-03-16 Holger Drees , Anja Janßen , Sebastian Neblung

We introduce the \textsc{Tailed-Uniform} proposal distribution for generating training simulations in simulation-based inference. Instead of sampling parameters uniformly within bounded regions, we extend the distribution beyond prior…

Instrumentation and Methods for Astrophysics · Physics 2026-01-27 Chaipat Tirapongprasert , Matthew Ho

Transfer Learning (TL) aims to transfer knowledge acquired in one problem, the source problem, onto another problem, the target problem, dispensing with the bottom-up construction of the target model. Due to its relevance, TL has gained…

Machine Learning · Computer Science 2017-12-07 Ricardo Gamelas Sousa , Luís A. Alexandre , Jorge M. Santos , Luís M. Silva , Joaquim Marques de Sá

Real-world data universally confronts a severe class-imbalance problem and exhibits a long-tailed distribution, i.e., most labels are associated with limited instances. The na\"ive models supervised by such datasets would prefer dominant…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Zhengzhuo Xu , Zenghao Chai , Chun Yuan

A major challenge in Semi-Supervised Learning (SSL) is the limited information available about the class distribution in the unlabeled data. In many real-world applications this arises from the prevalence of long-tailed distributions, where…

Machine Learning · Computer Science 2025-02-04 Khiem Pham , Charles Herrmann , Ramin Zabih

Multi-task learning (MTL) is a methodology that aims to improve the general performance of estimation and prediction by sharing common information among related tasks. In the MTL, there are several assumptions for the relationships and…

Methodology · Statistics 2023-04-27 Akira Okazaki , Shuichi Kawano

Long-tailed datasets, where head classes comprise much more training samples than tail classes, cause recognition models to get biased towards the head classes. Weighted loss is one of the most popular ways of mitigating this issue, and a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Saptarshi Sinha , Hiroki Ohashi

The long-tailed distribution datasets poses great challenges for deep learning based classification models on how to handle the class imbalance problem. Existing solutions usually involve class-balacing strategies or transfer learing from…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Gongzhe Li , Zhiwen Tan , Linpeng Pan

As machine learning technology gets applied to actual products and solutions, new challenges have emerged. Models unexpectedly fail to generalize to small changes in the distribution, tend to be confident on novel data they have never seen,…

Machine Learning · Computer Science 2023-10-13 Bálint Mucsányi , Michael Kirchhof , Elisa Nguyen , Alexander Rubinstein , Seong Joon Oh

One potential solution to combat the scarcity of tail observations in extreme value analysis is to integrate information from multiple datasets sharing similar tail properties, for instance, a common extreme value index. In other words, for…

Methodology · Statistics 2025-06-25 Liujun Chen , Marco Oesting , Chen Zhou

We study a scalable alternative to robust gradient descent (RGD) techniques that can be used when the gradients can be heavy-tailed, though this will be unknown to the learner. The core technique is simple: instead of trying to robustly…

Machine Learning · Statistics 2020-12-16 Matthew J. Holland