English
Related papers

Related papers: Partial FC: Training 10 Million Identities on a Si…

200 papers

State-of-the-art deep face recognition methods are mostly trained with a softmax-based multi-class classification framework. Despite being popular and effective, these methods still have a few shortcomings that limit empirical performance.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Yandong Wen , Weiyang Liu , Adrian Weller , Bhiksha Raj , Rita Singh

Softmax-based losses have achieved state-of-the-art performances on various tasks such as face recognition and re-identification. However, these methods highly relied on clean datasets with global labels, which limits their usage in many…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Qiang Meng , Xinqian Gu , Xiaqing Xu , Feng Zhou

Currently available face datasets mainly consist of a large number of high-quality and a small number of low-quality samples. As a result, a Face Recognition (FR) network fails to learn the distribution of low-quality samples since they are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Mohammad Saeed Ebrahimi Saadabadi , Sahar Rahimi Malakshan , Ali Zafari , Moktari Mostofa , Nasser M. Nasrabadi

With the development of deep learning, Deep Metric Learning (DML) has achieved great improvements in face recognition. Specifically, the widely used softmax loss in the training process often bring large intra-class variations, and feature…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Bowen Wu , Huaming Wu , Monica M. Y. Zhang

One-shot face recognition measures the ability to identify persons with only seeing them at one glance, and is a hallmark of human visual intelligence. It is challenging for conventional machine learning approaches to mimic this way, since…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Zhengming Ding , Yandong Guo , Lei Zhang , Yun Fu

Face recognition has made extraordinary progress owing to the advancement of deep convolutional neural networks (CNNs). The central task of face recognition, including face verification and identification, involves face feature…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Hao Wang , Yitong Wang , Zheng Zhou , Xing Ji , Dihong Gong , Jingchao Zhou , Zhifeng Li , Wei Liu

The cross-entropy softmax loss is the primary loss function used to train deep neural networks. On the other hand, the focal loss function has been demonstrated to provide improved performance when there is an imbalance in the number of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Leslie N. Smith

Face recognition (FR) using deep convolutional neural networks (DCNNs) has seen remarkable success in recent years. One key ingredient of DCNN-based FR is the appropriate design of a loss function that ensures discrimination between various…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Syed Safwan Khalid , Muhammad Awais , Chi-Ho Chan , Zhenhua Feng , Ammarah Farooq , Ali Akbari , Josef Kittler

Normalization is a vital process for any machine learning task as it controls the properties of data and affects model performance at large. The impact of particular forms of normalization, however, has so far been investigated in limited…

Machine Learning · Computer Science 2022-06-22 Chintan Trivedi , Konstantinos Makantasis , Antonios Liapis , Georgios N. Yannakakis

Learning image representations on decentralized data can bring many benefits in cases where data cannot be aggregated across data silos. Softmax cross entropy loss is highly effective and commonly used for learning image representations.…

Machine Learning · Computer Science 2022-03-10 Sagar M. Waghmare , Hang Qi , Huizhong Chen , Mikhail Sirotenko , Tomer Meron

In recent years, the performance of face verification and recognition systems based on deep convolutional neural networks (DCNNs) has significantly improved. A typical pipeline for face verification includes training a deep network for…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Rajeev Ranjan , Ankan Bansal , Hongyu Xu , Swami Sankaranarayanan , Jun-Cheng Chen , Carlos D. Castillo , Rama Chellappa

Cross-entropy loss together with softmax is arguably one of the most common used supervision components in convolutional neural networks (CNNs). Despite its simplicity, popularity and excellent performance, the component does not explicitly…

Machine Learning · Statistics 2017-11-21 Weiyang Liu , Yandong Wen , Zhiding Yu , Meng Yang

In the field of deep learning applied to face recognition, securing large-scale, high-quality datasets is vital for attaining precise and reliable results. However, amassing significant volumes of high-quality real data faces hurdles such…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Omer Granoviter , Alexey Gruzdev , Vladimir Loginov , Max Kogan , Orly Zvitia

Recognizability, a key perceptual factor in human face processing, strongly affects the performance of face recognition (FR) systems in both verification and identification tasks. Effectively using recognizability to enhance feature…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Duc-Phuong Doan-Ngo , Thanh-Dang Diep , Thanh Nguyen-Duc , Thanh-Sach LE , Nam Thoai

In current practical face authentication systems, most face recognition (FR) algorithms are based on cosine similarity with softmax classification. Despite its reliable classification performance, this method struggles with hard samples. A…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Fan Xie , Yang Wang , Yikang Jiao , Zhenyu Yuan , Congxi Chen , Chuanxin Zhao

Softmax loss is arguably one of the most popular losses to train CNN models for image classification. However, recent works have exposed its limitation on feature discriminability. This paper casts a new viewpoint on the weakness of softmax…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Xiaobo Wang , Shifeng Zhang , Zhen Lei , Si Liu , Xiaojie Guo , Stan Z. Li

The softmax function is widely used in artificial neural networks for the multiclass classification problems, where the softmax transformation enforces the output to be positive and sum to one, and the corresponding loss function allows to…

Machine Learning · Computer Science 2021-12-24 Shaoshi Sun , Zhenyuan Zhang , BoCheng Huang , Pengbin Lei , Jianlin Su , Shengfeng Pan , Jiarun Cao

Recognition in low quality face datasets is challenging because facial attributes are obscured and degraded. Advances in margin-based loss functions have resulted in enhanced discriminability of faces in the embedding space. Further,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Minchul Kim , Anil K. Jain , Xiaoming Liu

Face recognition has achieved great progress owing to the fast development of the deep neural network in the past a few years. As an important part of deep neural networks, a number of the loss functions have been proposed which…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Xin Wei , Hui Wang , Bryan Scotney , Huan Wan

Training deep learning models for accurate spatiotemporal recognition of facial expressions in videos requires significant computational resources. For practical reasons, 3D Convolutional Neural Networks (3D CNNs) are usually trained with…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Théo Ayral , Marco Pedersoli , Simon Bacon , Eric Granger