English
Related papers

Related papers: Enlarged Large Margin Loss for Imbalanced Classifi…

200 papers

Deep neural networks trained using a softmax layer at the top and the cross-entropy loss are ubiquitous tools for image classification. Yet, this does not naturally enforce intra-class similarity nor inter-class margin of the learned deep…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 José Lezama , Qiang Qiu , Pablo Musé , Guillermo Sapiro

Long-tail learning is the problem of learning under skewed label distributions, which pose a challenge for standard learners. Several recent approaches for the problem have proposed enforcing a suitable margin in logit space. Such…

Machine Learning · Computer Science 2022-04-29 Wittawat Jitkrittum , Aditya Krishna Menon , Ankit Singh Rawat , Sanjiv Kumar

Deep Learning (DL) approaches have gained prominence in medical imaging for disease diagnosis. Chest X-ray (CXR) classification has emerged as an effective method for detecting various diseases. Among these methodologies, Chest X-ray (CXR)…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Sree Rama Vamsidhar S , Bhargava Satya , Rama Krishna Gorthi

Real-world object classes appear in imbalanced ratios. This poses a significant challenge for classifiers which get biased towards frequent classes. We hypothesize that improving the generalization capability of a classifier should improve…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Munawar Hayat , Salman Khan , Waqas Zamir , Jianbing Shen , Ling Shao

Learning discriminative face features plays a major role in building high-performing face recognition models. The recent state-of-the-art face recognition solutions proposed to incorporate a fixed penalty margin on commonly used…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Fadi Boutros , Naser Damer , Florian Kirchbuchner , Arjan Kuijper

Automatic segmentation methods are an important advancement in medical image analysis. Machine learning techniques, and deep neural networks in particular, are the state-of-the-art for most medical image segmentation tasks. Issues with…

Image and Video Processing · Electrical Eng. & Systems 2021-11-25 Michael Yeung , Evis Sala , Carola-Bibiane Schönlieb , Leonardo Rundo

In this paper, we propose a Dual Focal Loss (DFL) function, as a replacement for the standard cross entropy (CE) function to achieve a better treatment of the unbalanced classes in a dataset. Our DFL method is an improvement on the recently…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Md Sazzad Hossain , Andrew P Paplinski , John M Betts

Widely used loss functions for CNN segmentation, e.g., Dice or cross-entropy, are based on integrals over the segmentation regions. Unfortunately, for highly unbalanced segmentations, such regional summations have values that differ by…

Image and Video Processing · Electrical Eng. & Systems 2020-10-20 Hoel Kervadec , Jihene Bouchtiba , Christian Desrosiers , Eric Granger , Jose Dolz , Ismail Ben Ayed

One-class classification (OCC) aims to train a classifier only with the target class data and attracts great attention for its strong applicability in real-world application. Despite a lot of advances have been made in OCC, it still lacks…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Ziyang Jiang , Peng Lin , Tianlei Wang

The margin-based softmax loss functions greatly enhance intra-class compactness and perform well on the tasks of face recognition and object classification. Outperformance, however, depends on the careful hyperparameter selection. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 JT Wu , L. Wang

Data imbalance exists ubiquitously in real-world visual regressions, e.g., age estimation and pose estimation, hurting the model's generalizability and fairness. Thus, imbalanced regression gains increasing research attention recently.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Jiawei Ren , Mingyuan Zhang , Cunjun Yu , Ziwei Liu

Neural networks trained on real-world datasets with long-tailed label distributions are biased towards frequent classes and perform poorly on infrequent classes. The imbalance in the ratio of positive and negative samples for each class…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Kevin Duarte , Yogesh S. Rawat , Mubarak Shah

Deep convolutional neural networks have made significant breakthroughs in medical image classification, under the assumption that training samples from all classes are simultaneously available. However, in real-world medical scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xuze Hao , Wenqian Ni , Xuhao Jiang , Weimin Tan , Bo Yan

Deep-learning has proved in recent years to be a powerful tool for image analysis and is now widely used to segment both 2D and 3D medical images. Deep-learning segmentation frameworks rely not only on the choice of network architecture but…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Carole H Sudre , Wenqi Li , Tom Vercauteren , Sébastien Ourselin , M. Jorge Cardoso

With the development of deep learning, Deep Metric Learning (DML) has achieved great improvements in face recognition. Specifically, the widely used softmax loss in the training process often bring large intra-class variations, and feature…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Bowen Wu , Huaming Wu , Monica M. Y. Zhang

In this paper, we propose a balancing training method to address problems in imbalanced data learning. To this end, we derive a new loss used in the balancing training phase that alleviates the influence of samples that cause an overfitted…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Seulki Park , Jongin Lim , Younghan Jeon , Jin Young Choi

In this paper, we focus on the separability of classes with the cross-entropy loss function for classification problems by theoretically analyzing the intra-class distance and inter-class distance (i.e. the distance between any two points…

Machine Learning · Computer Science 2019-09-17 Rudrajit Das , Subhasis Chaudhuri

Intelligent diagnosis method based on data-driven and deep learning is an attractive and meaningful field in recent years. However, in practical application scenarios, the imbalance of time-series fault is an urgent problem to be solved.…

Machine Learning · Computer Science 2021-07-15 Xingtai Gui , Jiyang Zhang

In Continual Learning (CL), while existing work primarily focuses on the multi-class classification task, there has been limited research on Multi-Label Learning (MLL). In practice, MLL datasets are often class-imbalanced, making it…

Machine Learning · Computer Science 2024-12-25 Yan Zhang , Guoqiang Wu , Bingzheng Wang , Teng Pang , Haoliang Sun , Yilong Yin

In face recognition, designing margin-based (e.g., angular, additive, additive angular margins) softmax loss functions plays an important role in learning discriminative features. However, these hand-crafted heuristic methods are…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Xiaobo Wang , Shuo Wang , Cheng Chi , Shifeng Zhang , Tao Mei