English
Related papers

Related papers: $\mathcal{G}$-softmax: Improving Intra-class Compa…

200 papers

As a key task in machine learning, data classification is essentially to find a suitable coordinate system to represent data features of different classes of samples. This paper proposes the mutual-energy inner product optimization method…

Machine Learning · Computer Science 2024-11-12 Yuanxiu Wang

The softmax-based loss functions and its variants (e.g., cosface, sphereface, and arcface) significantly improve the face recognition performance in wild unconstrained scenes. A common practice of these algorithms is to perform…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Hongwei Xu , Suncheng Xiang , Dahong Qian

Meta-learning has emerged as a prominent technology for few-shot text classification and has achieved promising performance. However, existing methods often encounter difficulties in drawing accurate class prototypes from support set…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xinyue Liu , Yunlong Gao , Linlin Zong , Bo Xu

The Softmax loss is one of the most widely employed surrogate objectives for classification and ranking tasks. To elucidate its theoretical properties, the Fenchel-Young framework situates it as a canonical instance within a broad family of…

Machine Learning · Computer Science 2026-02-02 Yuanhao Pu , Defu Lian , Enhong Chen

This paper introduces two straightforward, effective indices to evaluate the input data and the data flowing through layers of a feedforward deep neural network. For classification problems, the separation rate of target labels in the space…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Ahmad Kalhor , Mohsen Saffar , Melika Kheirieh , Somayyeh Hoseinipoor , Babak N. Araabi

Multi-label recognition is a fundamental, and yet is a challenging task in computer vision. Recently, deep learning models have achieved great progress towards learning discriminative features from input images. However, conventional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mohammed Hassanin , Ibrahim Radwan , Salman Khan , Murat Tahtali

Novel class discovery (NCD) aims at learning a model that transfers the common knowledge from a class-disjoint labelled dataset to another unlabelled dataset and discovers new classes (clusters) within it. Many methods, as well as elaborate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Wenbin Li , Zhichen Fan , Jing Huo , Yang Gao

Few-shot classification algorithms can alleviate the data scarceness issue, which is vital in many real-world problems, by adopting models pre-trained from abundant data in other domains. However, the pre-training process was commonly…

Machine Learning · Computer Science 2020-03-03 Chao Wang , Ruo-Ze Liu , Han-Jia Ye , Yang Yu

We present a conceptually new and flexible method for multi-class open set classification. Unlike previous methods where unknown classes are inferred with respect to the feature or decision distance to the known classes, our approach is…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 ZongYuan Ge , Sergey Demyanov , Zetao Chen , Rahil Garnavi

Unsupervised learning has gained prominence in the big data era, offering a means to extract valuable insights from unlabeled datasets. Deep clustering has emerged as an important unsupervised category, aiming to exploit the non-linear…

Machine Learning · Computer Science 2024-02-02 Georgios Vardakas , Ioannis Papakostas , Aristidis Likas

In this work, we present a novel, machine-learning approach for constructing Multiclass Interpretable Scoring Systems (MISS) - a fully data-driven methodology for generating single, sparse, and user-friendly scoring systems for multiclass…

Machine Learning · Computer Science 2024-01-11 Michal K. Grzeszczyk , Tomasz Trzciński , Arkadiusz Sitek

Fairness has been a critical issue that affects the adoption of deep learning models in real practice. To improve model fairness, many existing methods have been proposed and evaluated to be effective in their own contexts. However, there…

Machine Learning · Computer Science 2024-03-26 Junjie Yang , Jiajun Jiang , Zeyu Sun , Junjie Chen

Deep convolutional neural networks (CNNs) can be applied to malware binary detection via image classification. The performance, however, is degraded due to the imbalance of malware families (classes). To mitigate this issue, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Songqing Yue , Tianyang Wang

We propose a novel strategy for extracting features in supervised learning that can be used to construct a classifier which is more robust to small perturbations in the input space. Our method builds upon the idea of the information…

Machine Learning · Computer Science 2019-10-16 Ankit Pensia , Varun Jog , Po-Ling Loh

Deep-learning has proved in recent years to be a powerful tool for image analysis and is now widely used to segment both 2D and 3D medical images. Deep-learning segmentation frameworks rely not only on the choice of network architecture but…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Carole H Sudre , Wenqi Li , Tom Vercauteren , Sébastien Ourselin , M. Jorge Cardoso

Over the last decade, the development of deep image classification networks has mostly been driven by the search for the best performance in terms of classification accuracy on standardized benchmarks like ImageNet. More recently, this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Kalun Ho , Franz-Josef Pfreundt , Janis Keuper , Margret Keuper

We propose sparsemax, a new activation function similar to the traditional softmax, but able to output sparse probabilities. After deriving its properties, we show how its Jacobian can be efficiently computed, enabling its use in a network…

Computation and Language · Computer Science 2016-02-09 André F. T. Martins , Ramón Fernandez Astudillo

Latent categorical variables are frequently found in deep learning architectures. They can model actions in discrete reinforcement-learning environments, represent categories in latent-variable models, or express relations in graph neural…

Machine Learning · Computer Science 2026-05-14 Alessandro Manenti , Cesare Alippi

Speech emotion recognition is an important aspect of human-computer interaction. Prior work proposes various end-to-end models to improve the classification performance. However, most of them rely on the cross-entropy loss together with…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Zheng Lian , Ya Li , Jianhua Tao , Jian Huang

Medical image data are usually imbalanced across different classes. One-class classification has attracted increasing attention to address the data imbalance problem by distinguishing the samples of the minority class from the majority…

Image and Video Processing · Electrical Eng. & Systems 2022-04-15 Long Gao , Chang Liu , Dooman Arefan , Ashok Panigrahy , Shandong Wu