English
Related papers

Related papers: Simplifying Neural Network Training Under Class Im…

200 papers

In imbalanced multi-class classification problems, the misclassification rate as an error measure may not be a relevant choice. Several methods have been developed where the performance measure retained richer information than the mere…

Machine Learning · Computer Science 2013-11-05 Sokol Koço , Cécile Capponi

Data imbalance remains one of the open challenges in the contemporary machine learning. It is especially prevalent in case of medical data, such as histopathological images. Traditional data-level approaches for dealing with data imbalance…

Machine Learning · Computer Science 2021-04-20 Michał Koziarski

Several studies point out different causes of performance degradation in supervised machine learning. Problems such as class imbalance, overlapping, small-disjuncts, noisy labels, and sparseness limit accuracy in classification algorithms.…

Machine Learning · Computer Science 2020-04-17 Gustavo A. Valencia-Zapata , Carolina Gonzalez-Canas , Michael G. Zentner , Okan Ersoy , Gerhard Klimeck

In this study, classification problems based on feedforward neural networks in a data-imbalanced environment are considered. Learning from an imbalanced dataset is one of the most important practical problems in the field of machine…

Machine Learning · Statistics 2020-12-23 Muneki Yasuda , Yeo Xian En , Seishirou Ueno

The lack of mathematical tractability of Deep Neural Networks (DNNs) has hindered progress towards having a unified convergence analysis of training algorithms, in the general setting. We propose a unified optimization framework for…

Machine Learning · Computer Science 2018-05-24 Hadi Ghauch , Hossein Shokri-Ghadikolaei , Carlo Fischione , Mikael Skoglund

Class imbalance is a common challenge in many NLP tasks, and has clear connections to bias, in that bias in training data often leads to higher accuracy for majority groups at the expense of minority groups. However there has traditionally…

Computation and Language · Computer Science 2021-09-23 Shivashankar Subramanian , Afshin Rahimi , Timothy Baldwin , Trevor Cohn , Lea Frermann

Fine-tuning is a common practice in deep learning, achieving excellent generalization results on downstream tasks using relatively little training data. Although widely used in practice, it is lacking strong theoretical understanding. We…

Machine Learning · Computer Science 2021-11-09 Gal Shachaf , Alon Brutzkus , Amir Globerson

Recognizing and telling similar objects apart is even hard for human beings. In this paper, we show that there is a phenomenon of class interference with all deep neural networks. Class interference represents the learning difficulty in…

Machine Learning · Computer Science 2022-11-04 Dongcui Diao , Hengshuai Yao , Bei Jiang

Most modern neural networks for classification fail to take into account the concept of the unknown. Trained neural networks are usually tested in an unrealistic scenario with only examples from a closed set of known classes. In an attempt…

Machine Learning · Computer Science 2022-12-27 Justin Leo , Jugal Kalita

Class imbalance and noisy labels are the norm rather than the exception in many large-scale classification datasets. Nevertheless, most works in machine learning typically assume balanced and clean data. There have been some recent attempts…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Shyamgopal Karthik , Jérome Revaud , Boris Chidlovskii

Several works have shown that the regularization mechanisms underlying deep neural networks' generalization performances are still poorly understood. In this paper, we hypothesize that deep neural networks are regularized through their…

Machine Learning · Computer Science 2021-03-12 Carbonnelle Simon , Christophe De Vleeschouwer

Online class imbalance learning constitutes a new problem and an emerging research topic that focusses on the challenges of online learning under class imbalance and concept drift. Class imbalance deals with data streams that have very…

Machine Learning · Computer Science 2020-09-02 Kleanthis Malialis , Christos G. Panayiotou , Marios M. Polycarpou

Modern machine learning suffers from catastrophic forgetting when learning new classes incrementally. The performance dramatically degrades due to the missing data of old classes. Incremental learning methods have been proposed to retain…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Yue Wu , Yinpeng Chen , Lijuan Wang , Yuancheng Ye , Zicheng Liu , Yandong Guo , Yun Fu

Class imbalance severely impacts machine learning performance on minority classes in real-world applications. While various solutions exist, active learning offers a fundamental fix by strategically collecting balanced, informative labeled…

Machine Learning · Computer Science 2025-06-13 Shyam Nuggehalli , Jifan Zhang , Lalit Jain , Robert Nowak

The increasing complexity of modern deep neural network models and the expanding sizes of datasets necessitate the development of optimized and scalable training methods. In this white paper, we addressed the challenge of efficiently…

Machine Learning · Computer Science 2024-04-29 Raphael Ruschel , A. S. M. Iftekhar , B. S. Manjunath , Suya You

Class imbalance is an intrinsic characteristic of multi-label data. Most of the labels in multi-label data sets are associated with a small number of training examples, much smaller compared to the size of the data set. Class imbalance…

Machine Learning · Computer Science 2018-11-07 Bin Liu , Grigorios Tsoumakas

Imbalanced classification problems are extremely common in natural language processing and are solved using a variety of resampling and filtering techniques, which often involve making decisions on how to select training data or decide…

Computation and Language · Computer Science 2022-09-02 Ryan Muther , David Smith

To reduce the overwhelming size of Deep Neural Networks (DNN) teacher-student methodology tries to transfer knowledge from a complex teacher network to a simple student network. We instead propose a novel method called the teacher-class…

Machine Learning · Computer Science 2021-11-02 Shaiq Munir Malik , Muhammad Umair Haider , Mohbat Tharani , Musab Rasheed , Murtaza Taj

Structural concept complexity, class overlap, and data scarcity are some of the most important factors influencing the performance of classifiers under class imbalance conditions. When these effects were uncovered in the early 2000s,…

Machine Learning · Computer Science 2021-07-30 Kushankur Ghosh , Colin Bellinger , Roberto Corizzo , Bartosz Krawczyk , Nathalie Japkowicz

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

Machine Learning · Computer Science 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete