English
Related papers

Related papers: Implementation of an Asymmetric Adjusted Activatio…

200 papers

The label distribution skew induced data heterogeniety has been shown to be a significant obstacle that limits the model performance in federated learning, which is particularly developed for collaborative model training over decentralized…

Machine Learning · Computer Science 2023-03-16 Jian Xu , Meiling Yang , Wenbo Ding , Shao-Lun Huang

The location fingerprinting method, which typically utilizes supervised learning, has been widely adopted as a viable solution for the indoor positioning problem. Many indoor positioning datasets are imbalanced. Models trained on imbalanced…

Signal Processing · Electrical Eng. & Systems 2021-09-01 Fahad Alhomayani , Mohammad H. Mahoor

Imbalance in classification tasks is commonly quantified by the cardinalities of examples across classes. This, however, disregards the presence of redundant examples and inherent differences in the learning difficulties of classes.…

Machine Learning · Computer Science 2026-01-22 Çağrı Eser , Zeynep Sonat Baltacı , Emre Akbaş , Sinan Kalkan

In this paper, we present a simple yet effective provable method (named ABSGD) for addressing the data imbalance or label noise problem in deep learning. Our method is a simple modification to momentum SGD where we assign an individual…

Machine Learning · Computer Science 2023-06-09 Qi Qi , Yi Xu , Rong Jin , Wotao Yin , Tianbao Yang

Online continual learning is a challenging problem where models must learn from a non-stationary data stream while avoiding catastrophic forgetting. Inter-class imbalance during training has been identified as a major cause of forgetting,…

Machine Learning · Computer Science 2024-10-01 Zhehao Huang , Tao Li , Chenhe Yuan , Yingwen Wu , Xiaolin Huang

When dealing with imbalanced classification data, reweighting the loss function is a standard procedure allowing to equilibrate between the true positive and true negative rates within the risk measure. Despite significant theoretical work…

Machine Learning · Statistics 2024-04-17 Anass Aghbalou , François Portier , Anne Sabourin

Despite recent progress on semi-supervised federated learning (FL) for medical image diagnosis, the problem of imbalanced class distributions among unlabeled clients is still unsolved for real-world use. In this paper, we study a practical…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Meirui Jiang , Hongzheng Yang , Xiaoxiao Li , Quande Liu , Pheng-Ann Heng , Qi Dou

To visualize the regions of interest that classifiers base their decisions on, different Class Activation Mapping (CAM) methods have been developed. However, all of these techniques target categorical classifiers only, though most…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Xinyi Zhang , Johanna Sophie Bieri , Manuel Günther

In many classification settings, the class of primary interest is underrepresented, leading to imbalanced data problems that arise in applications such as rare disease detection and fraud identification. In these contexts, identifying a…

Machine Learning · Statistics 2026-05-06 Daniel Fraiman , Ricardo Fraiman

Missing data is a common problem faced with real-world datasets. Imputation is a widely used technique to estimate the missing data. State-of-the-art imputation approaches, such as Generative Adversarial Imputation Nets (GAIN), model the…

Machine Learning · Computer Science 2020-12-02 Saqib Ejaz Awan , Mohammed Bennamoun , Ferdous Sohel , Frank M Sanfilippo , Girish Dwivedi

As the economic and environmental costs of training and deploying large vision or language models increase dramatically, analog in-memory computing (AIMC) emerges as a promising energy-efficient solution. However, the training perspective,…

Machine Learning · Computer Science 2026-01-14 Zhaoxian Wu , Quan Xiao , Tayfun Gokmen , Omobayode Fagbohungbe , Tianyi Chen

Label efficiency has become an increasingly important objective in deep learning applications. Active learning aims to reduce the number of labeled examples needed to train deep networks, but the empirical performance of active learning…

Machine Learning · Computer Science 2023-12-19 Jifan Zhang , Shuai Shao , Saurabh Verma , Robert Nowak

Most classification models can be considered as the process of matching templates. However, when intra-class uncertainty/variability is not considered, especially for datasets containing unbalanced classes, this may lead to classification…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 He Zhu , Shan Yu

Despite the vast literature on Human Activity Recognition (HAR) with wearable inertial sensor data, it is perhaps surprising that there are few studies investigating semisupervised learning for HAR, particularly in a challenging scenario…

Machine Learning · Computer Science 2021-01-14 Govind Narasimman , Kangkang Lu , Arun Raja , Chuan Sheng Foo , Mohamed Sabry Aly , Jie Lin , Vijay Chandrasekhar

Class imbalance in data presents significant challenges for classification tasks. It is fairly common and requires careful handling to obtain desirable performance. Traditional classification algorithms become biased toward the majority…

Machine Learning · Computer Science 2024-10-28 Asif Newaz , Asif Ur Rahman Adib , Taskeed Jabid

In this study, we systematically investigate the impact of class imbalance on classification performance of convolutional neural networks (CNNs) and compare frequently used methods to address the issue. Class imbalance is a common problem…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Mateusz Buda , Atsuto Maki , Maciej A. Mazurowski

Fairness-aware mining of massive data streams is a growing and challenging concern in the contemporary domain of machine learning. Many stream learning algorithms are used to replace humans at critical decision-making points e.g., hiring…

Machine Learning · Computer Science 2022-11-10 Maryam Badar , Marco Fisichella , Vasileios Iosifidis , Wolfgang Nejdl

Rehearsal approaches in class incremental learning (CIL) suffer from decision boundary overfitting to new classes, which is mainly caused by two factors: insufficiency of old classes data for knowledge distillation and imbalanced data…

Machine Learning · Computer Science 2024-09-27 Kunchi Li , Jun Wan , Shan Yu

The increasing impact of algorithmic decisions on people's lives compels us to scrutinize their fairness and, in particular, the disparate impacts that ostensibly-color-blind algorithms can have on different groups. Examples include credit…

Machine Learning · Statistics 2020-06-17 Nathan Kallus , Xiaojie Mao , Angela Zhou

Adaptive optimizers are pivotal in guiding the weight updates of deep neural networks, yet they often face challenges such as poor generalization and oscillation issues. To counter these, we introduce sigSignGrad and tanhSignGrad, two novel…

Machine Learning · Computer Science 2024-08-23 Hongye Zheng , Bingxing Wang , Minheng Xiao , Honglin Qin , Zhizhong Wu , Lianghao Tan