English
Related papers

Related papers: X2-Softmax: Margin Adaptive Loss Function for Face…

200 papers

Cross-entropy loss together with softmax is arguably one of the most common used supervision components in convolutional neural networks (CNNs). Despite its simplicity, popularity and excellent performance, the component does not explicitly…

Machine Learning · Statistics 2017-11-21 Weiyang Liu , Yandong Wen , Zhiding Yu , Meng Yang

We present a novel framework to exploit privileged information for recognition which is provided only during the training phase. Here, we focus on recognition task where images are provided as the main view and soft biometric traits…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Seyed Mehdi Iranmanesh , Ali Dabouei , Nasser M. Nasrabadi

In recent years, the performance of face verification systems has significantly improved using deep convolutional neural networks (DCNNs). A typical pipeline for face verification includes training a deep network for subject classification…

Computer Vision and Pattern Recognition · Computer Science 2017-06-09 Rajeev Ranjan , Carlos D. Castillo , Rama Chellappa

One of the main challenges for feature representation in deep learning-based classification is the design of appropriate loss functions that exhibit strong discriminative power. The classical softmax loss does not explicitly encourage…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Xiong Zhou , Xianming Liu , Deming Zhai , Junjun Jiang , Xin Gao , Xiangyang Ji

To encourage intra-class compactness and inter-class separability among trainable feature vectors, large-margin softmax methods are developed and widely applied in the face recognition community. The introduction of the large-margin concept…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-22 Jingjing Huo , Yingbo Gao , Weiyue Wang , Ralf Schlüter , Hermann Ney

We present a new loss function, namely Wing loss, for robust facial landmark localisation with Convolutional Neural Networks (CNNs). We first compare and analyse different loss functions including L2, L1 and smooth L1. The analysis of these…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Zhen-Hua Feng , Josef Kittler , Muhammad Awais , Patrik Huber , Xiao-Jun Wu

Loss functions play a key role in training superior deep neural networks. In convolutional neural networks (CNNs), the popular cross entropy loss together with softmax does not explicitly guarantee minimization of intra-class variance or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 XiaoBin Li , WeiQiang Wang

Face recognition has achieved great progress owing to the fast development of the deep neural network in the past a few years. As an important part of deep neural networks, a number of the loss functions have been proposed which…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Xin Wei , Hui Wang , Bryan Scotney , Huan Wan

Learning discriminative deep feature embeddings by using million-scale in-the-wild datasets and margin-based softmax loss is the current state-of-the-art approach for face recognition. However, the memory and computing cost of the Fully…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Xiang An , Jiankang Deng , Jia Guo , Ziyong Feng , Xuhan Zhu , Jing Yang , Tongliang Liu

As an emerging topic in face recognition, designing margin-based loss functions can increase the feature margin between different classes for enhanced discriminability. More recently, the idea of mining-based strategies is adopted to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yuge Huang , Yuhan Wang , Ying Tai , Xiaoming Liu , Pengcheng Shen , Shaoxin Li , Jilin Li , Feiyue Huang

Speaker Recognition is a challenging task with essential applications such as authentication, automation, and security. The SincNet is a new deep learning based model which has produced promising results to tackle the mentioned task. To…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-15 João Antônio Chagas Nunes , David Macêdo , Cleber Zanchettin

Face recognition has been an active and vital topic among computer vision community for a long time. Previous researches mainly focus on loss functions used for facial feature extraction network, among which the improvements of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Xiang An , Xuhan Zhu , Yang Xiao , Lan Wu , Ming Zhang , Yuan Gao , Bin Qin , Debing Zhang , Ying Fu

The cosine-based softmax losses and their variants achieve great success in deep learning based face recognition. However, hyperparameter settings in these losses have significant influences on the optimization path as well as the final…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Xiao Zhang , Rui Zhao , Yu Qiao , Xiaogang Wang , Hongsheng Li

Face Recognition is one of the prominent problems in the computer vision domain. Witnessing advances in deep learning, significant work has been observed in face recognition, which touched upon various parts of the recognition framework…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey

A deep convolutional neural network (CNN) has been widely used in image classification and gives better classification accuracy than the other techniques. The softmax cross-entropy loss function is often used for classification tasks. There…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Motoshi Abe , Junichi Miyao , Takio Kurita

Softmax loss is arguably one of the most popular losses to train CNN models for image classification. However, recent works have exposed its limitation on feature discriminability. This paper casts a new viewpoint on the weakness of softmax…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Xiaobo Wang , Shifeng Zhang , Zhen Lei , Si Liu , Xiaojie Guo , Stan Z. Li

Person re-identification is a challenging task because of the high intra-class variance induced by the unrestricted nuisance factors of variations such as pose, illumination, viewpoint, background, and sensor noise. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Sinan Sabri , Zaigham Randhawa , Gianfranco Doretto

Performance in face and speaker verification is largely driven by margin-based softmax losses such as CosFace and ArcFace. Recently introduced $\alpha$-divergence loss functions offer a compelling alternative, particularly due to their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Dimitrios Koutsianos , Ladislav Mosner , Yannis Panagakis , Themos Stafylakis

The softmax loss and its variants are widely used as objectives for embedding learning, especially in applications like face recognition. However, the intra- and inter-class objectives in the softmax loss are entangled, therefore a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Lanqing He , Zhongdao Wang , Yali Li , Shengjin Wang

Cosine-based softmax losses significantly improve the performance of deep face recognition networks. However, these losses always include sensitive hyper-parameters which can make training process unstable, and it is very tricky to set…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Xiao Zhang , Rui Zhao , Junjie Yan , Mengya Gao , Yu Qiao , Xiaogang Wang , Hongsheng Li