English
Related papers

Related papers: Class-wise Flooding Regularization for Imbalanced …

200 papers

Over-parameterized neural network models often lead to significant performance discrepancies between training and test sets, a phenomenon known as overfitting. To address this, researchers have proposed numerous regularization techniques…

Machine Learning · Computer Science 2025-01-27 RuiZhe Jiang , Haotian Lei

Catastrophic forgetting (CF) happens whenever a neural network overwrites past knowledge while being trained on new tasks. Common techniques to handle CF include regularization of the weights (using, e.g., their importance on past tasks),…

Machine Learning · Statistics 2021-08-06 Jary Pomponi , Simone Scardapane , Aurelio Uncini

Overparameterized deep networks have the capacity to memorize training data with zero \emph{training error}. Even after memorization, the \emph{training loss} continues to approach zero, making the model overconfident and the test…

Machine Learning · Computer Science 2021-04-01 Takashi Ishida , Ikko Yamane , Tomoya Sakai , Gang Niu , Masashi Sugiyama

Single image rain removal is a typical inverse problem in computer vision. The deep learning technique has been verified to be effective for this task and achieved state-of-the-art performance. However, previous deep learning methods need…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Wei Wei , Deyu Meng , Qian Zhao , Zongben Xu , Ying Wu

Learning classifiers using skewed or imbalanced datasets can occasionally lead to classification issues; this is a serious issue. In some cases, one class contains the majority of examples while the other, which is frequently the more…

Machine Learning · Computer Science 2022-11-11 Satyendra Singh Rawat , Amit Kumar Mishra

Real-world datasets are often highly class-imbalanced, which can adversely impact the performance of deep learning models. The majority of research on training neural networks under class imbalance has focused on specialized loss functions,…

Machine Learning · Computer Science 2023-12-06 Ravid Shwartz-Ziv , Micah Goldblum , Yucen Lily Li , C. Bayan Bruss , Andrew Gordon Wilson

Training of deep neural networks heavily depends on the data distribution. In particular, the networks easily suffer from class imbalance. The trained networks would recognize the frequent classes better than the infrequent classes. To…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Byungju Kim , Junmo Kim

The deep convolutional neural network has achieved significant progress for single image rain streak removal. However, most of the data-driven learning methods are full-supervised or semi-supervised, unexpectedly suffering from significant…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Changfeng Yu , Yi Chang , Yi Li , Xile Zhao , Luxin Yan

Class-incremental learning requires a learning system to continually learn knowledge of new classes and meanwhile try to preserve previously learned knowledge of old classes. As current state-of-the-art methods based on Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Jiantao Tan , Peixian Ma , Tong Yu , Wentao Zhang , Ruixuan Wang

Super-resolution is an ill-posed problem, since it allows for multiple predictions for a given low-resolution image. This fundamental fact is largely ignored by state-of-the-art deep learning based approaches. These methods instead train a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Andreas Lugmayr , Martin Danelljan , Luc Van Gool , Radu Timofte

Class imbalanced datasets are common in real-world applications that range from credit card fraud detection to rare disease diagnostics. Several popular classification algorithms assume that classes are approximately balanced, and hence…

Machine Learning · Statistics 2018-09-10 Val Andrei Fajardo , David Findlay , Roshanak Houmanfar , Charu Jaiswal , Jiaxi Liang , Honglei Xie

This study is about inducing classifiers using data that is imbalanced, with a minority class being under-represented in relation to the majority classes. The first section of this research focuses on the main characteristics of data that…

Machine Learning · Computer Science 2022-10-25 Shivaditya Shivganesh , Nitin Narayanan N , Pranav Murali , Ajaykumar M

Anomaly segmentation is an essential capability for safety-critical robotics applications that must be aware of unexpected events. Normalizing flows (NFs), a class of generative models, are a promising approach for this task due to their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Chang Won Lee , Selina Leveugle , Svetlana Stolpner , Chris Langley , Paul Grouchy , Jonathan Kelly , Steven L. Waslander

Despite remarkable progress on visual recognition tasks, deep neural-nets still struggle to generalize well when training data is scarce or highly imbalanced, rendering them extremely vulnerable to real-world examples. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Shiran Zada , Itay Benou , Michal Irani

Model learning from class imbalanced training data is a long-standing and significant challenge for machine learning. In particular, existing deep learning methods consider mostly either class balanced data or moderately imbalanced data in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Qi Dong , Shaogang Gong , Xiatian Zhu

Based on the manifold hypothesis, real-world data often lie on a low-dimensional manifold, while normalizing flows as a likelihood-based generative model are incapable of finding this manifold due to their structural constraints. So, one…

Machine Learning · Computer Science 2022-06-08 Seyedeh Fatemeh Razavi , Mohammad Mahdi Mehmanchi , Reshad Hosseini , Mostafa Tavassolipour

Medical diagnosis might fail due to bias. In this work, we identified class-feature bias, which refers to models' potential reliance on features that are strongly correlated with only a subset of classes, leading to biased performance and…

Machine Learning · Computer Science 2025-09-03 Lishi Zuo , Man-Wai Mak , Lu Yi , Youzhi Tu

Despite extensive research spanning several decades, class imbalance is still considered a profound difficulty for both machine learning and deep learning models. While data oversampling is the foremost technique to address this issue,…

Machine Learning · Computer Science 2025-02-12 Sukumar Kishanthan , Asela Hevapathige

Class imbalance is a common problem in the case of real-world object detection and classification tasks. Data of some classes is abundant making them an over-represented majority, and data of other classes is scarce, making them an…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Salman H. Khan , Munawar Hayat , Mohammed Bennamoun , Ferdous Sohel , Roberto Togneri

Overfitting is one of the most critical challenges in deep neural networks, and there are various types of regularization methods to improve generalization performance. Injecting noises to hidden units during training, e.g., dropout, is…

Machine Learning · Computer Science 2017-11-10 Hyeonwoo Noh , Tackgeun You , Jonghwan Mun , Bohyung Han