English
Related papers

Related papers: Additive Margin Softmax for Face Verification

200 papers

One of the main challenges for feature representation in deep learning-based classification is the design of appropriate loss functions that exhibit strong discriminative power. The classical softmax loss does not explicitly encourage…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Xiong Zhou , Xianming Liu , Deming Zhai , Junjun Jiang , Xin Gao , Xiangyang Ji

Researches using margin based comparison loss demonstrate the effectiveness of penalizing the distance between face feature and their corresponding class centers. Despite their popularity and excellent performance, they do not explicitly…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Ying Huang , Shangfeng Qiu , Wenwei Zhang , Xianghui Luo , Jinzhuo Wang

Softmax function is widely used in artificial neural networks for multiclass classification, multilabel classification, attention mechanisms, etc. However, its efficacy is often questioned in literature. The log-softmax loss has been shown…

Machine Learning · Computer Science 2020-11-24 Kunal Banerjee , Vishak Prasad C , Rishi Raj Gupta , Karthik Vyas , Anushree H , Biswajit Mishra

Recognition in low quality face datasets is challenging because facial attributes are obscured and degraded. Advances in margin-based loss functions have resulted in enhanced discriminability of faces in the embedding space. Further,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Minchul Kim , Anil K. Jain , Xiaoming Liu

In recent years, the performance of face verification systems has significantly improved using deep convolutional neural networks (DCNNs). A typical pipeline for face verification includes training a deep network for subject classification…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Rajeev Ranjan , Carlos D. Castillo , Rama Chellappa

Face recognition has been an active and vital topic among computer vision community for a long time. Previous researches mainly focus on loss functions used for facial feature extraction network, among which the improvements of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Xiang An , Xuhan Zhu , Yang Xiao , Lan Wu , Ming Zhang , Yuan Gao , Bin Qin , Debing Zhang , Ying Fu

Face recognition is an open-set problem requiring high discriminative power to ensure that intra-class distances remain smaller than inter-class distances. Margin-based softmax losses, such as SphereFace, CosFace, and ArcFace, have been…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Jinhui Zheng , Xueyuan Gong

We motivate and present Ring loss, a simple and elegant feature normalization approach for deep networks designed to augment standard loss functions such as Softmax. We argue that deep feature normalization is an important aspect of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Yutong Zheng , Dipan K. Pal , Marios Savvides

Cross-entropy loss together with softmax is arguably one of the most common used supervision components in convolutional neural networks (CNNs). Despite its simplicity, popularity and excellent performance, the component does not explicitly…

Machine Learning · Statistics 2017-11-21 Weiyang Liu , Yandong Wen , Zhiding Yu , Meng Yang

We present a novel framework to exploit privileged information for recognition which is provided only during the training phase. Here, we focus on recognition task where images are provided as the main view and soft biometric traits…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Seyed Mehdi Iranmanesh , Ali Dabouei , Nasser M. Nasrabadi

Performance in face and speaker verification is largely driven by margin-based softmax losses such as CosFace and ArcFace. Recently introduced $\alpha$-divergence loss functions offer a compelling alternative, particularly due to their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Dimitrios Koutsianos , Ladislav Mosner , Yannis Panagakis , Themos Stafylakis

The cosine-based softmax losses and their variants achieve great success in deep learning based face recognition. However, hyperparameter settings in these losses have significant influences on the optimization path as well as the final…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Xiao Zhang , Rui Zhao , Yu Qiao , Xiaogang Wang , Hongsheng Li

Facial landmark detection is an important task in computer vision with numerous applications, such as head pose estimation, expression analysis, face swapping, etc. Heatmap regression-based methods have been widely used to achieve…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Chiao-An Yang , Raymond A. Yeh

In current practical face authentication systems, most face recognition (FR) algorithms are based on cosine similarity with softmax classification. Despite its reliable classification performance, this method struggles with hard samples. A…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Fan Xie , Yang Wang , Yikang Jiao , Zhenyu Yuan , Congxi Chen , Chuanxin Zhao

Softmax loss is arguably one of the most popular losses to train CNN models for image classification. However, recent works have exposed its limitation on feature discriminability. This paper casts a new viewpoint on the weakness of softmax…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Xiaobo Wang , Shifeng Zhang , Zhen Lei , Si Liu , Xiaojie Guo , Stan Z. Li

Thanks to the recent developments of Convolutional Neural Networks, the performance of face verification methods has increased rapidly. In a typical face verification method, feature normalization is a critical step for boosting…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Feng Wang , Xiang Xiang , Jian Cheng , Alan L. Yuille

State-of-the-art face recognition methods typically take the multi-classification pipeline and adopt the softmax-based loss for optimization. Although these methods have achieved great success, the softmax-based loss has its limitation from…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Lizhe Liu , Mingqiang Chen , Xiaohao Chen , Siyu Zhu , Ping Tan

Face recognition is one of the most widely publicized feature in the devices today and hence represents an important problem that should be studied with the utmost priority. As per the recent trends, the Convolutional Neural Network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey

Most state-of-the-art self-supervised speaker verification systems rely on a contrastive-based objective function to learn speaker representations from unlabeled speech data. We explore different ways to improve the performance of these…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Theo Lepage , Reda Dehak

The softmax function is widely used in artificial neural networks for the multiclass classification problems, where the softmax transformation enforces the output to be positive and sum to one, and the corresponding loss function allows to…

Machine Learning · Computer Science 2021-12-24 Shaoshi Sun , Zhenyuan Zhang , BoCheng Huang , Pengbin Lei , Jianlin Su , Shengfeng Pan , Jiarun Cao