English
Related papers

Related papers: Difficulty-aware Balancing Margin Loss for Long-ta…

200 papers

Real-world datasets often exhibit long-tailed distributions, where a few dominant "Head" classes have abundant samples while most "Tail" classes are severely underrepresented, leading to biased learning and poor generalization for the Tail.…

Machine Learning · Computer Science 2026-02-02 Mahdiyar Molahasani , Michael Greenspan , Ali Etemad

Face recognition has witnessed significant progress due to the advances of deep convolutional neural networks (CNNs), the central task of which is how to improve the feature discrimination. To this end, several margin-based (\textit{e.g.},…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Xiaobo Wang , Shifeng Zhang , Shuo Wang , Tianyu Fu , Hailin Shi , Tao Mei

The heavy reliance on data is one of the major reasons that currently limit the development of deep learning. Data quality directly dominates the effect of deep learning models, and the long-tailed distribution is one of the factors…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Lu Yang , He Jiang , Qing Song , Jun Guo

Fairness-aware mining of massive data streams is a growing and challenging concern in the contemporary domain of machine learning. Many stream learning algorithms are used to replace humans at critical decision-making points e.g., hiring…

Machine Learning · Computer Science 2022-11-10 Maryam Badar , Marco Fisichella , Vasileios Iosifidis , Wolfgang Nejdl

Deep neural networks still struggle on long-tailed image datasets, and one of the reasons is that the imbalance of training data across categories leads to the imbalance of trained model parameters. Motivated by the empirical findings that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Haoxuan Wang , Junchi Yan

Real-world object classes appear in imbalanced ratios. This poses a significant challenge for classifiers which get biased towards frequent classes. We hypothesize that improving the generalization capability of a classifier should improve…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Munawar Hayat , Salman Khan , Waqas Zamir , Jianbing Shen , Ling Shao

In this work, we tackle the challenging problem of long-tailed image recognition. Previous long-tailed recognition approaches mainly focus on data augmentation or re-balancing strategies for the tail classes to give them more attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Weide Liu , Zhonghua Wu , Yiming Wang , Henghui Ding , Fayao Liu , Jie Lin , Guosheng Lin

While tasks could come with varying the number of instances and classes in realistic settings, the existing meta-learning approaches for few-shot classification assume that the number of instances per task and class is fixed. Due to such…

Machine Learning · Computer Science 2022-02-15 Hae Beom Lee , Hayeon Lee , Donghyun Na , Saehoon Kim , Minseop Park , Eunho Yang , Sung Ju Hwang

Deep neural networks trained with standard cross-entropy loss are more prone to memorize noisy labels, which degrades their performance. Negative learning using complementary labels is more robust when noisy labels intervene but with an…

Machine Learning · Computer Science 2022-09-07 Chen-Chen Zong , Zheng-Tao Cao , Hong-Tao Guo , Yun Du , Ming-Kun Xie , Shao-Yuan Li , Sheng-Jun Huang

Continual learning -- accumulating knowledge from a sequence of learning experiences -- is an important yet challenging problem. In this paradigm, the model's performance for previously encountered instances may substantially drop as…

Machine Learning · Computer Science 2022-07-14 Yasin Findik , Farhad Pourkamali-Anaraki

There is an inescapable long-tailed class-imbalance issue in many real-world classification problems. Current methods for addressing this problem only consider scenarios where all examples come from the same distribution. However, in many…

Machine Learning · Computer Science 2023-10-09 Xinyu Yang , Huaxiu Yao , Allan Zhou , Chelsea Finn

Data mixing methods play a crucial role in semi-supervised learning (SSL), but their application is unexplored in long-tailed semi-supervised learning (LTSSL). The primary reason is that the in-batch mixing manner fails to address class…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Hongwei Zheng , Linyuan Zhou , Han Li , Jinming Su , Xiaoming Wei , Xiaoming Xu

Many natural language processing (NLP) tasks are naturally imbalanced, as some target categories occur much more frequently than others in the real world. In such scenarios, current NLP models still tend to perform poorly on less frequent…

Computation and Language · Computer Science 2023-02-23 Sophie Henning , William Beluch , Alexander Fraser , Annemarie Friedrich

Deep learning has achieved remarkable success in bearing fault diagnosis. However, its performance oftentimes deteriorates when dealing with highly imbalanced or long-tailed data, while such cases are prevalent in industrial settings…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Wei-En Yu , Jinwei Sun , Shiping Zhang , Xiaoge Zhang , Jing-Xiao Liao

Class-bias, that is class-wise performance disparities, is typically attributed to data imbalance and addressed through frequency-based resampling. However, we demonstrate that substantial bias persists even in perfectly balanced datasets,…

Machine Learning · Computer Science 2026-04-13 Pawel Pukowski , Venet Osmani

Despite extensive research spanning several decades, class imbalance is still considered a profound difficulty for both machine learning and deep learning models. While data oversampling is the foremost technique to address this issue,…

Machine Learning · Computer Science 2025-02-12 Sukumar Kishanthan , Asela Hevapathige

In recent years Deep Neural Network-based systems are not only increasing in popularity but also receive growing user trust. However, due to the closed-world assumption of such systems, they cannot recognize samples from unknown classes and…

Machine Learning · Computer Science 2025-01-15 Joanna Komorniczak , Pawel Ksieniewicz

We present a formulation of deep learning that aims at producing a large margin classifier. The notion of margin, minimum distance to a decision boundary, has served as the foundation of several theoretically profound and empirically…

Machine Learning · Statistics 2018-12-05 Gamaleldin F. Elsayed , Dilip Krishnan , Hossein Mobahi , Kevin Regan , Samy Bengio

How to estimate the uncertainty of a given model is a crucial problem. Current calibration techniques treat different classes equally and thus implicitly assume that the distribution of training data is balanced, but ignore the fact that…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Jiahao Chen , Bing Su

Solving long-tail large vocabulary object detection with deep learning based models is a challenging and demanding task, which is however under-explored.In this work, we provide the first systematic analysis on the underperformance of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-20 Yu Li , Tao Wang , Bingyi Kang , Sheng Tang , Chunfeng Wang , Jintao Li , Jiashi Feng
‹ Prev 1 8 9 10 Next ›