English
Related papers

Related papers: Ensemble Soft-Margin Softmax Loss for Image Classi…

200 papers

In this paper, we propose a conceptually simple and geometrically interpretable objective function, i.e. additive margin Softmax (AM-Softmax), for deep face verification. In general, the face verification task can be viewed as a metric…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Feng Wang , Weiyang Liu , Haijun Liu , Jian Cheng

The popular softmax loss and its recent extensions have achieved great success in the deep learning-based image classification. However, the data for training image classifiers usually has different quality. Ignoring such problem, the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Weihua Liu , Xiabi Liu , Murong Wang , Ling Ma

The learning objective plays a fundamental role to build a recommender system. Most methods routinely adopt either pointwise or pairwise loss to train the model parameters, while rarely pay attention to softmax loss due to its computational…

Information Retrieval · Computer Science 2023-12-20 Jiancan Wu , Xiang Wang , Xingyu Gao , Jiawei Chen , Hongcheng Fu , Tianyu Qiu

Learning discriminative deep feature embeddings by using million-scale in-the-wild datasets and margin-based softmax loss is the current state-of-the-art approach for face recognition. However, the memory and computing cost of the Fully…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Xiang An , Jiankang Deng , Jia Guo , Ziyong Feng , Xuhan Zhu , Jing Yang , Tongliang Liu

The softmax loss and its variants are widely used as objectives for embedding learning, especially in applications like face recognition. However, the intra- and inter-class objectives in the softmax loss are entangled, therefore a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Lanqing He , Zhongdao Wang , Yali Li , Shengjin Wang

Many loss functions have been derived from cross-entropy loss functions such as large-margin softmax loss and focal loss. The large-margin softmax loss makes the classification more rigorous and prevents overfitting. The focal loss…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Jiajie Chen

In the field of pattern classification, the training of deep learning classifiers is mostly end-to-end learning, and the loss function is the constraint on the final output (posterior probability) of the network, so the existence of Softmax…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Qiuyu Zhu , Xuewen Zu

Sampling-based methods, e.g., Deep Ensembles and Bayesian Neural Nets have become promising approaches to improve the quality of uncertainty estimation and robust generalization. However, they suffer from a large model size and high latency…

Machine Learning · Computer Science 2024-05-29 Ha Manh Bui , Anqi Liu

Researches using margin based comparison loss demonstrate the effectiveness of penalizing the distance between face feature and their corresponding class centers. Despite their popularity and excellent performance, they do not explicitly…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Ying Huang , Shangfeng Qiu , Wenwei Zhang , Xianghui Luo , Jinzhuo Wang

Few-shot classification algorithms can alleviate the data scarceness issue, which is vital in many real-world problems, by adopting models pre-trained from abundant data in other domains. However, the pre-training process was commonly…

Machine Learning · Computer Science 2020-03-03 Chao Wang , Ruo-Ze Liu , Han-Jia Ye , Yang Yu

Speaker Recognition is a challenging task with essential applications such as authentication, automation, and security. The SincNet is a new deep learning based model which has produced promising results to tackle the mentioned task. To…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-15 João Antônio Chagas Nunes , David Macêdo , Cleber Zanchettin

Learning image representations on decentralized data can bring many benefits in cases where data cannot be aggregated across data silos. Softmax cross entropy loss is highly effective and commonly used for learning image representations.…

Machine Learning · Computer Science 2022-03-10 Sagar M. Waghmare , Hang Qi , Huizhong Chen , Mikhail Sirotenko , Tomer Meron

We present a novel framework to exploit privileged information for recognition which is provided only during the training phase. Here, we focus on recognition task where images are provided as the main view and soft biometric traits…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Seyed Mehdi Iranmanesh , Ali Dabouei , Nasser M. Nasrabadi

The margin-based softmax loss functions greatly enhance intra-class compactness and perform well on the tasks of face recognition and object classification. Outperformance, however, depends on the careful hyperparameter selection. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 JT Wu , L. Wang

The softmax function is widely used in artificial neural networks for the multiclass classification problems, where the softmax transformation enforces the output to be positive and sum to one, and the corresponding loss function allows to…

Machine Learning · Computer Science 2021-12-24 Shaoshi Sun , Zhenyuan Zhang , BoCheng Huang , Pengbin Lei , Jianlin Su , Shengfeng Pan , Jiarun Cao

Deep convolutional neural networks (CNNs) can be applied to malware binary detection via image classification. The performance, however, is degraded due to the imbalance of malware families (classes). To mitigate this issue, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Songqing Yue , Tianyang Wang

Deep embedding learning is expected to learn a metric space in which features have smaller maximal intra-class distance than minimal inter-class distance. In recent years, one research focus is to solve the open-set problem by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Hao Zhu , Yang Yuan , Guosheng Hu , Xiang Wu , Neil Robertson

Metric learning aims to learn distances from the data, which enhances the performance of similarity-based algorithms. An author style detection task is a metric learning problem, where learning style features with small intra-class…

Machine Learning · Computer Science 2022-12-19 Gayan K. Kulatilleke , Shekhar S. Chandra , Marius Portmann

State-of-the-art face recognition methods typically take the multi-classification pipeline and adopt the softmax-based loss for optimization. Although these methods have achieved great success, the softmax-based loss has its limitation from…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Lizhe Liu , Mingqiang Chen , Xiaohao Chen , Siyu Zhu , Ping Tan

A deep convolutional neural network (CNN) has been widely used in image classification and gives better classification accuracy than the other techniques. The softmax cross-entropy loss function is often used for classification tasks. There…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Motoshi Abe , Junichi Miyao , Takio Kurita