English
Related papers

Related papers: A Performance Comparison of Loss Functions for Dee…

200 papers

Loss functions are at the heart of deep learning, shaping how models learn and perform across diverse tasks. They are used to quantify the difference between predicted outputs and ground truth labels, guiding the optimization process to…

Machine Learning · Computer Science 2025-09-11 Omar Elharrouss , Yasir Mahmood , Yassine Bechqito , Mohamed Adel Serhani , Elarbi Badidi , Jamal Riffi , Hamid Tairi

Recently, intermediate feature maps of pre-trained convolutional neural networks have shown significant perceptual quality improvements, when they are used in the loss function for training new networks. It is believed that these features…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Taimoor Tariq , Okan Tarhan Tursun , Munchurl Kim , Piotr Didyk

Deep models have achieved impressive performance for face hallucination tasks. However, we observe that directly feeding the hallucinated facial images into recog- nition models can even degrade the recognition performance despite the much…

Computer Vision and Pattern Recognition · Computer Science 2016-11-28 Junyu Wu , Shengyong Ding , Wei Xu , Hongyang Chao

Over the past few years, Convolutional Neural Networks (CNNs) have shown promise on facial expression recognition. However, the performance degrades dramatically under real-world settings due to variations introduced by subtle facial…

Computer Vision and Pattern Recognition · Computer Science 2018-01-26 Jie Cai , Zibo Meng , Ahmed Shehab Khan , Zhiyuan Li , James O'Reilly , Yan Tong

With the advent of 2-dimensional Convolution Neural Networks (2D CNNs), the face recognition accuracy has reached above 99%. However, face recognition is still a challenge in real world conditions. A video, instead of an image, as an input…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Nayaneesh Kumar Mishra , Satish Kumar Singh

With the development of deep learning, Deep Metric Learning (DML) has achieved great improvements in face recognition. Specifically, the widely used softmax loss in the training process often bring large intra-class variations, and feature…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Bowen Wu , Huaming Wu , Monica M. Y. Zhang

For the convolutional neural network (CNN) used for pattern classification, the training loss function is usually applied to the final output of the network, except for some regularization constraints on the network parameters. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Qiuyu Zhu , Hao Wang , Xuewen Zu , Chengfei Liu

Recently, a popular line of research in face recognition is adopting margins in the well-established softmax loss function to maximize class separability. In this paper, we first introduce an Additive Angular Margin Loss (ArcFace), which…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Jiankang Deng , Jia Guo , Jing Yang , Niannan Xue , Irene Kotsia , Stefanos Zafeiriou

Deep convolutional neural networks (CNNs) have greatly improved the Face Recognition (FR) performance in recent years. Almost all CNNs in FR are trained on the carefully labeled datasets containing plenty of identities. However, such…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Wei Hu , Yangyu Huang , Fan Zhang , Ruirui Li , Wei Li , Guodong Yuan

Recently there has been a growing interest in Transformer not only in NLP but also in computer vision. We wonder if transformer can be used in face recognition and whether it is better than CNNs. Therefore, we investigate the performance of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Yaoyao Zhong , Weihong Deng

Convolutional Neural Networks (CNNs) are widely used for image classification in a variety of fields, including medical imaging. While most studies deploy cross-entropy as the loss function in such tasks, a growing number of approaches have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Vasileios Baltatzis , Loic Le Folgoc , Sam Ellis , Octavio E. Martinez Manzanera , Kyriaki-Margarita Bintsi , Arjun Nair , Sujal Desai , Ben Glocker , Julia A. Schnabel

The deep convolutional neural network(CNN) has significantly raised the performance of image classification and face recognition. Softmax is usually used as supervision, but it only penalizes the classification loss. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Ce Qi , Fei Su

Facial recognition using deep learning has been widely used in social life for applications such as authentication, smart door locks, and photo grouping, etc. More and more networks have been developed to facilitate computer vision tasks,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Mingxuan Li , Kai Zhou

In current practical face authentication systems, most face recognition (FR) algorithms are based on cosine similarity with softmax classification. Despite its reliable classification performance, this method struggles with hard samples. A…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Fan Xie , Yang Wang , Yikang Jiao , Zhenyu Yuan , Congxi Chen , Chuanxin Zhao

In recent years, deep perceptual loss has been widely and successfully used to train machine learning models for many computer vision tasks, including image synthesis, segmentation, and autoencoding. Deep perceptual loss is a type of loss…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Gustav Grund Pihlgren , Konstantina Nikolaidou , Prakash Chandra Chhipa , Nosheen Abid , Rajkumar Saini , Fredrik Sandin , Marcus Liwicki

Convolutional Neural Networks have reached extremely high performances on the Face Recognition task. Largely used datasets, such as VGGFace2, focus on gender, pose and age variations trying to balance them to achieve better results.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Fabio Valerio Massoli , Giuseppe Amato , Fabrizio Falchi

Face images appeared in multimedia applications, e.g., social networks and digital entertainment, usually exhibit dramatic pose, illumination, and expression variations, resulting in considerable performance degradation for traditional face…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Changxing Ding , Dacheng Tao

Accurate and fast recognition of forgeries is an issue of great importance in the fields of artificial intelligence, image processing and object detection. Recognition of forgeries of facial imagery is the process of classifying and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Günel Jabbarlı , Murat Kurt

Real-world face detection and alignment demand an advanced discriminative model to address challenges by pose, lighting and expression. Illuminated by the deep learning algorithm, some convolutional neural networks based face detection and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Weilin Cong , Sanyuan Zhao , Hui Tian , Jianbing Shen

Convolution Neural Networks (CNN) have recently achieved state-of-the art performance on handwritten Chinese character recognition (HCCR). However, most of CNN models employ the SoftMax activation function and minimize cross entropy loss,…

Machine Learning · Computer Science 2019-09-02 Junyi Zou , Jinliang Zhang , Ludi Wang