English
Related papers

Related papers: Basket-based Softmax

200 papers

State-of-the-art face recognition methods typically take the multi-classification pipeline and adopt the softmax-based loss for optimization. Although these methods have achieved great success, the softmax-based loss has its limitation from…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Lizhe Liu , Mingqiang Chen , Xiaohao Chen , Siyu Zhu , Ping Tan

Face recognition has made tremendous progress in recent years due to the advances in loss functions and the explosive growth in training sets size. A properly designed loss is seen as key to extract discriminative features for…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Shijie Wu , Xun Gong

In recent years, the softmax model and its fast approximations have become the de-facto loss functions for deep neural networks when dealing with multi-class prediction. This loss has been extended to language modeling and recommendation,…

Machine Learning · Statistics 2019-09-19 Ugo Tanielian , Flavian Vasile

Deep classifiers have achieved great success in visual recognition. However, real-world data is long-tailed by nature, leading to the mismatch between training and testing distributions. In this paper, we show that the Softmax function,…

Machine Learning · Computer Science 2020-11-24 Jiawei Ren , Cunjun Yu , Shunan Sheng , Xiao Ma , Haiyu Zhao , Shuai Yi , Hongsheng Li

Face recognition has witnessed significant progresses due to the advances of deep convolutional neural networks (CNNs), the central challenge of which, is feature discrimination. To address it, one group tries to exploit mining-based…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Xiaobo Wang , Shuo Wang , Shifeng Zhang , Tianyu Fu , Hailin Shi , Tao Mei

The softmax-based loss functions and its variants (e.g., cosface, sphereface, and arcface) significantly improve the face recognition performance in wild unconstrained scenes. A common practice of these algorithms is to perform…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Hongwei Xu , Suncheng Xiang , Dahong Qian

Most image segmentation algorithms are trained on binary masks formulated as a classification task per pixel. However, in applications such as medical imaging, this "black-and-white" approach is too constraining because the contrast between…

Image and Video Processing · Electrical Eng. & Systems 2020-11-19 Charley Gros , Andreanne Lemay , Julien Cohen-Adad

With the development of deep learning, Deep Metric Learning (DML) has achieved great improvements in face recognition. Specifically, the widely used softmax loss in the training process often bring large intra-class variations, and feature…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Bowen Wu , Huaming Wu , Monica M. Y. Zhang

The softmax loss and its variants are widely used as objectives for embedding learning, especially in applications like face recognition. However, the intra- and inter-class objectives in the softmax loss are entangled, therefore a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Lanqing He , Zhongdao Wang , Yali Li , Shengjin Wang

Face recognition has witnessed significant progress due to the advances of deep convolutional neural networks (CNNs), the central task of which is how to improve the feature discrimination. To this end, several margin-based (\textit{e.g.},…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Xiaobo Wang , Shifeng Zhang , Shuo Wang , Tianyu Fu , Hailin Shi , Tao Mei

Whilst face recognition applications are becoming increasingly prevalent within our daily lives, leading approaches in the field still suffer from performance bias to the detriment of some racial profiles within society. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Seyma Yucer , Samet Akçay , Noura Al-Moubayed , Toby P. Breckon

Exploring a substantial amount of unlabeled data, semi-supervised learning (SSL) boosts the recognition performance when only a limited number of labels are provided. However, traditional methods assume that the data distribution is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Wujian Peng , Zejia Weng , Hengduo Li , Zuxuan Wu

State-of-the-art deep face recognition methods are mostly trained with a softmax-based multi-class classification framework. Despite being popular and effective, these methods still have a few shortcomings that limit empirical performance.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Yandong Wen , Weiyang Liu , Adrian Weller , Bhiksha Raj , Rita Singh

In face recognition, designing margin-based (e.g., angular, additive, additive angular margins) softmax loss functions plays an important role in learning discriminative features. However, these hand-crafted heuristic methods are…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Xiaobo Wang , Shuo Wang , Cheng Chi , Shifeng Zhang , Tao Mei

Face recognition has been an active and vital topic among computer vision community for a long time. Previous researches mainly focus on loss functions used for facial feature extraction network, among which the improvements of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Xiang An , Xuhan Zhu , Yang Xiao , Lan Wu , Ming Zhang , Yuan Gao , Bin Qin , Debing Zhang , Ying Fu

Deep embedding learning is expected to learn a metric space in which features have smaller maximal intra-class distance than minimal inter-class distance. In recent years, one research focus is to solve the open-set problem by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Hao Zhu , Yang Yuan , Guosheng Hu , Xiang Wu , Neil Robertson

This work considers the problem of domain shift in person re-identification.Being trained on one dataset, a re-identification model usually performs much worse on unseen data. Partially this gap is caused by the relatively small scale of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Vladislav Sovrasov , Dmitry Sidnev

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Yangdi Lu , Wenbo He

In replay-based methods for continual learning, replaying input samples in episodic memory has shown its effectiveness in alleviating catastrophic forgetting. However, the potential key factor of cross-entropy loss with softmax in causing…

Machine Learning · Computer Science 2024-01-25 Hoyong Kim , Minchan Kwon , Kangil Kim

As the adoption of federated learning increases for learning from sensitive data local to user devices, it is natural to ask if the learning can be done using implicit signals generated as users interact with the applications of interest,…

Machine Learning · Computer Science 2023-03-21 Alekh Agarwal , H. Brendan McMahan , Zheng Xu
‹ Prev 1 2 3 10 Next ›