English
Related papers

Related papers: Imbalance Robust Softmax for Deep Embeeding Learni…

200 papers

Feature learning is a widely used method employed for large-scale face recognition. Recently, large-margin softmax loss methods have demonstrated significant enhancements on deep face recognition. These methods propose fixed positive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Chingis Oinar , Binh M. Le , Simon S. Woo

Class imbalance problems manifest in domains such as financial fraud detection or network intrusion analysis, where the prevalence of one class is much higher than another. Typically, practitioners are more interested in predicting the…

Machine Learning · Statistics 2017-11-16 Peter Xenopoulos

Learning from limited and imbalanced data is a challenging problem in the Artificial Intelligence community. Real-time scenarios demand decision-making from rare events wherein the data are typically imbalanced. These situations commonly…

Neural and Evolutionary Computing · Computer Science 2022-05-17 Deeksha Sethi , Nithin Nagaraj , Harikrishnan N B

Whilst face recognition applications are becoming increasingly prevalent within our daily lives, leading approaches in the field still suffer from performance bias to the detriment of some racial profiles within society. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Seyma Yucer , Samet Akçay , Noura Al-Moubayed , Toby P. Breckon

Federated Learning (FL) has emerged as one of the prominent paradigms for distributed machine learning (ML). However, it is well-established that its performance can degrade significantly under non-IID (non-independent and identically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Kasra Borazjani , Payam Abdisarabshali , Naji Khosravan , Seyyedali Hosseinalipour

A variety of modern applications exhibit multi-view multi-label learning, where each sample has multi-view features, and multiple labels are correlated via common views. Current methods usually fail to directly deal with the setting where…

Machine Learning · Computer Science 2023-08-30 Zhiwei Li , Zijian Yang , Lu Sun , Mineichi Kudo , Kego Kimura

Deep neural networks (DNNs) are often prone to learn the spurious correlations between target classes and bias attributes, like gender and race, inherent in a major portion of training data (bias-aligned samples), thus showing unfair…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Mei Wang , Weihong Deng , Jiani Hu , Sen Su

Spoken language understanding (SLU) datasets, like many other machine learning datasets, usually suffer from the label imbalance problem. Label imbalance usually causes the learned model to replicate similar biases at the output which…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Leda Sarı , Mark Hasegawa-Johnson

The softmax function is a widely used activation function in the output layers of neural networks, responsible for converting raw scores into class probabilities while introducing essential non-linearity. Implementing Softmax efficiently…

Enabling machine learning classifiers to defer their decision to a downstream expert when the expert is more accurate will ensure improved safety and performance. This objective can be achieved with the learning-to-defer framework which…

Machine Learning · Computer Science 2023-11-03 Yuzhou Cao , Hussein Mozannar , Lei Feng , Hongxin Wei , Bo An

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

Machine Learning · Computer Science 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

Deep metric learning (DML) enables learning with less supervision through its emphasis on the similarity structure of representations. There has been much work on improving generalization of DML in settings like zero-shot retrieval, but…

Machine Learning · Computer Science 2022-03-25 Natalie Dullerud , Karsten Roth , Kimia Hamidieh , Nicolas Papernot , Marzyeh Ghassemi

Learning image representations on decentralized data can bring many benefits in cases where data cannot be aggregated across data silos. Softmax cross entropy loss is highly effective and commonly used for learning image representations.…

Machine Learning · Computer Science 2022-03-10 Sagar M. Waghmare , Hang Qi , Huizhong Chen , Mikhail Sirotenko , Tomer Meron

Face recognition has witnessed significant progresses due to the advances of deep convolutional neural networks (CNNs), the central challenge of which, is feature discrimination. To address it, one group tries to exploit mining-based…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Xiaobo Wang , Shuo Wang , Shifeng Zhang , Tianyu Fu , Hailin Shi , Tao Mei

Multi-task learning (MTL) has emerged as a promising approach for deploying deep learning models in real-life applications. Recent studies have proposed optimization-based learning paradigms to establish task-shared representations in MTL.…

Machine Learning · Computer Science 2025-03-12 Zhipeng Zhou , Liu Liu , Peilin Zhao , Wei Gong

Class-imbalanced data, in which some classes contain far more samples than others, is ubiquitous in real-world applications. Standard techniques for handling class-imbalance usually work by training on a re-weighted loss or on re-balanced…

Artificial Intelligence · Computer Science 2021-06-18 Arpit Bansal , Micah Goldblum , Valeriia Cherepanova , Avi Schwarzschild , C. Bayan Bruss , Tom Goldstein

Class-imbalance is one of the major challenges in real world datasets, where a few classes (called majority classes) constitute much more data samples than the rest (called minority classes). Learning deep neural networks using such…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Saptarshi Sinha , Hiroki Ohashi , Katsuyuki Nakamura

Deep networks have produced significant gains for various visual recognition problems, leading to high impact academic and commercial applications. Recent work in deep networks highlighted that it is easy to generate images that humans…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Abhijit Bendale , Terrance Boult

Ensuring fairness is critical when applying artificial intelligence to high-stakes domains such as healthcare, where predictive models trained on imbalanced and demographically skewed data risk exacerbating existing disparities. Federated…

Computers and Society · Computer Science 2025-05-15 Qiming Wu , Siqi Li , Doudou Zhou , Nan Liu

Data in real-world application often exhibit skewed class distribution which poses an intense challenge for machine learning. Conventional classification algorithms are not effective in the case of imbalanced data distribution, and may fail…

Machine Learning · Computer Science 2019-01-08 Enlu Lin , Qiong Chen , Xiaoming Qi