English
Related papers

Related papers: Consistent Batch Normalization for Weighted Loss i…

200 papers

Deep convolutional neural networks (CNNs) can be applied to malware binary detection via image classification. The performance, however, is degraded due to the imbalance of malware families (classes). To mitigate this issue, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Songqing Yue , Tianyang Wang

The vast majority of real world classification problems are imbalanced, meaning there are far fewer data from the class of interest (the positive class) than from other classes. We propose two machine learning algorithms to handle highly…

Machine Learning · Statistics 2014-06-10 Siong Thye Goh , Cynthia Rudin

Substantial experiments have validated the success of Batch Normalization (BN) Layer in benefiting convergence and generalization. However, BN requires extra memory and float-point calculation. Moreover, BN would be inaccurate on…

Machine Learning · Computer Science 2024-10-30 Wen Fei , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

Real-world datasets often exhibit imbalanced data distribution, where certain class levels are severely underrepresented. In such cases, traditional pattern classifiers have shown a bias towards the majority class, impeding accurate…

Machine Learning · Statistics 2025-08-12 Shraddha M. Naik , Tanujit Chakraborty , Madhurima Panja , Abdenour Hadid , Bibhas Chakraborty

The Federated Learning setting has a central server coordinating the training of a model on a network of devices. One of the challenges is variable training performance when the dataset has a class imbalance. In this paper, we address this…

Machine Learning · Computer Science 2020-11-13 Dipankar Sarkar , Ankur Narang , Sumit Rai

Machine Learning-based supervised approaches require highly customized and fine-tuned methodologies to deliver outstanding performance. This paper presents a dataset-driven design and performance evaluation of a machine learning classifier…

Cryptography and Security · Computer Science 2022-05-13 Zeinab Zoghi , Gursel Serpen

Model learning from class imbalanced training data is a long-standing and significant challenge for machine learning. In particular, existing deep learning methods consider mostly either class balanced data or moderately imbalanced data in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Qi Dong , Shaogang Gong , Xiatian Zhu

With the expansion of data availability, machine learning (ML) has achieved remarkable breakthroughs in both academia and industry. However, imbalanced data distributions are prevalent in various types of raw data and severely hinder the…

Machine Learning · Computer Science 2025-09-15 Xinyi Gao , Dongting Xie , Yihang Zhang , Zhengren Wang , Chong Chen , Conghui He , Hongzhi Yin , Wentao Zhang

Batch Normalization (BN) is extensively employed in various network architectures by performing standardization within mini-batches. A full understanding of the process has been a central target in the deep learning communities. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Lei Huang , Lei Zhao , Yi Zhou , Fan Zhu , Li Liu , Ling Shao

Batch Normalization (BN) has become an essential technique in contemporary neural network design, enhancing training stability. Specifically, BN employs centering and scaling operations to standardize features along the batch dimension and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Shaobo Wang , Xiangdong Zhang , Dongrui Liu , Junchi Yan

Numerous large-scale chest x-ray datasets have spearheaded expert-level detection of abnormalities using deep learning. However, these datasets focus on detecting a subset of disease labels that could be present, thus making them…

Machine Learning · Computer Science 2023-03-14 Pranav Kulkarni , Adway Kanhere , Paul H. Yi , Vishwa S. Parekh

Batch Normalization (BN) is a milestone technique in the development of deep learning, enabling various networks to train. However, normalizing along the batch dimension introduces problems --- BN's error increases rapidly when the batch…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Yuxin Wu , Kaiming He

Batch normalization (BN) is a fundamental unit in modern deep networks, in which a linear transformation module was designed for improving BN's flexibility of fitting complex data distributions. In this paper, we demonstrate properly…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Yuhui Xu , Lingxi Xie , Cihang Xie , Jieru Mei , Siyuan Qiao , Wei Shen , Hongkai Xiong , Alan Yuille

Federated learning is a collaborative model training method that iterates model updates by multiple clients and aggregation of the updates by a central server. Device and statistical heterogeneity of participating clients cause significant…

Machine Learning · Computer Science 2023-08-29 Ayano Nakai-Kasai , Tadashi Wadayama

Learning from many real-world datasets is limited by a problem called the class imbalance problem. A dataset is imbalanced when one class (the majority class) has significantly more samples than the other class (the minority class). Such…

Machine Learning · Computer Science 2017-11-30 Soroush Saryazdi , Bahareh Nikpour , Hossein Nezamabadi-pour

The emerging paradigm of federated learning (FL) strives to enable collaborative training of deep models on the network edge without centrally aggregating raw data and hence improving data privacy. In most cases, the assumption of…

Machine Learning · Computer Science 2021-05-12 Xiaoxiao Li , Meirui Jiang , Xiaofei Zhang , Michael Kamp , Qi Dou

Batch normalization (BN) is a key facilitator and considered essential for state-of-the-art binary neural networks (BNN). However, the BN layer is costly to calculate and is typically implemented with non-binary parameters, leaving a hurdle…

Machine Learning · Computer Science 2021-04-19 Tianlong Chen , Zhenyu Zhang , Xu Ouyang , Zechun Liu , Zhiqiang Shen , Zhangyang Wang

Deep learning approaches are successful in a wide range of AI problems and in particular for visual recognition tasks. However, there are still open problems among which is the capacity to handle streams of visual information and the…

Machine Learning · Computer Science 2022-02-02 Umang Aggarwal , Adrian Popescu , Eden Belouadah , Céline Hudelot

Training models on highly unbalanced data is admitted to be a challenging task for machine learning algorithms. Current studies on deep learning mainly focus on data sets with balanced class labels or unbalanced data, but with massive…

Machine Learning · Computer Science 2020-02-27 Louis Marceau , Lingling Qiu , Nick Vandewiele , Eric Charton

Deep learning models, including modern systems like large language models, are well known to offer unreliable estimates of the uncertainty of their decisions. In order to improve the quality of the confidence levels, also known as…

Machine Learning · Computer Science 2024-04-15 Jiayi Huang , Sangwoo Park , Osvaldo Simeone
‹ Prev 1 3 4 5 6 7 10 Next ›