English
Related papers

Related papers: How many classes do we need to see for novel class…

200 papers

In this work, we perform a wide variety of experiments with different deep learning architectures on datasets of limited size. According to our study, we show that model complexity is a critical factor when only a few samples per class are…

Machine Learning · Computer Science 2020-10-27 L. Brigato , L. Iocchi

In open-set recognition, existing methods generally learn statically fixed decision boundaries using known classes to reject unknown classes. Though they have achieved promising results, such decision boundaries are evidently insufficient…

Machine Learning · Computer Science 2024-05-06 Haifeng Yang , Chuanxing Geng , Pong C. Yuen , Songcan Chen

Classic supervised learning makes the closed-world assumption, meaning that classes seen in testing must have been seen in training. However, in the dynamic world, new or unseen class examples may appear constantly. A model working in such…

Computation and Language · Computer Science 2019-03-05 Hu Xu , Bing Liu , Lei Shu , P. Yu

Machine learning models often encounter samples that are diverged from the training distribution. Failure to recognize an out-of-distribution (OOD) sample, and consequently assign that sample to an in-class label significantly compromises…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Mohammadreza Salehi , Hossein Mirzaei , Dan Hendrycks , Yixuan Li , Mohammad Hossein Rohban , Mohammad Sabokrou

Class imbalance poses a significant challenge in classification tasks, where traditional approaches often lead to biased models and unreliable predictions. Undersampling and oversampling techniques have been commonly employed to address…

Machine Learning · Computer Science 2025-10-22 Matt Clifford , Jonathan Erskine , Alexander Hepburn , Raúl Santos-Rodríguez , Dario Garcia-Garcia

Training of deep neural networks heavily depends on the data distribution. In particular, the networks easily suffer from class imbalance. The trained networks would recognize the frequent classes better than the infrequent classes. To…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Byungju Kim , Junmo Kim

Investigation of machine learning algorithms robust to changes between the training and test distributions is an active area of research. In this paper we explore a special type of dataset shift which we call class-dependent domain shift.…

Machine Learning · Computer Science 2020-07-13 Tigran Galstyan , Hrant Khachatrian , Greg Ver Steeg , Aram Galstyan

Domain adaptation for visual recognition has undergone great progress in the past few years. Nevertheless, most existing methods work in the so-called closed-set scenario, assuming that the classes depicted by the target images are exactly…

Computer Vision and Pattern Recognition · Computer Science 2018-06-01 Mahsa Baktashmotlagh , Masoud Faraki , Tom Drummond , Mathieu Salzmann

Gathering training data is a key step of any supervised learning task, and it is both critical and expensive. Critical, because the quantity and quality of the training data has a high impact on the performance of the learned function.…

Data Structures and Algorithms · Computer Science 2021-10-28 Quentin Lutz , Élie de Panafieu , Alex Scott , Maya Stein

Conventional machine learning studies generally assume close-environment scenarios where important factors of the learning process hold invariant. With the great success of machine learning, nowadays, more and more practical tasks,…

Machine Learning · Computer Science 2022-08-10 Zhi-Hua Zhou

While many works on Continual Learning have shown promising results for mitigating catastrophic forgetting, they have relied on supervised training. To successfully learn in a label-agnostic incremental setting, a model must distinguish…

Machine Learning · Computer Science 2021-12-09 Shivam Khare , Kun Cao , James Rehg

Class imbalance in deep neural networks (DNNs) has witnessed a rapid increase in research attention in recent years. However, the varying accounts of the reasons behind the poor performance of DNN on imbalance data in pertinent literature…

Machine Learning · Computer Science 2026-05-26 Ismail B. Mustapha , Shafaatunnur Hasan , Sunday O. Olatunji , Hatem S. Y. Nabus

Many studies have proposed machine-learning (ML) models for malware detection and classification, reporting an almost-perfect performance. However, they assemble ground-truth in different ways, use diverse static- and dynamic-analysis…

Cryptography and Security · Computer Science 2023-07-28 Savino Dambra , Yufei Han , Simone Aonzo , Platon Kotzias , Antonino Vitale , Juan Caballero , Davide Balzarotti , Leyla Bilge

Introductory programming courses often rely on small code-writing exercises that have clearly specified problem statements. This limits opportunities for students to practice how to clarify ambiguous requirements -- a critical skill in…

Human-Computer Interaction · Computer Science 2025-04-17 Paul Denny , Viraj Kumar , Stephen MacNeil , James Prather , Juho Leinonen

In this paper, we address Novel Class Discovery (NCD), the task of unveiling new classes in a set of unlabeled samples given a labeled dataset with known classes. We exploit the peculiarities of NCD to build a new framework, named…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Zhun Zhong , Enrico Fini , Subhankar Roy , Zhiming Luo , Elisa Ricci , Nicu Sebe

Real-world datasets are often highly class-imbalanced, which can adversely impact the performance of deep learning models. The majority of research on training neural networks under class imbalance has focused on specialized loss functions,…

Machine Learning · Computer Science 2023-12-06 Ravid Shwartz-Ziv , Micah Goldblum , Yucen Lily Li , C. Bayan Bruss , Andrew Gordon Wilson

In many object recognition applications, the set of possible categories is an open set, and the deployed recognition system will encounter novel objects belonging to categories unseen during training. Detecting such "novel category" objects…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Thomas G. Dietterich , Alexander Guyer

Class-wise characteristics of training examples affect the performance of deep classifiers. A well-studied example is when the number of training examples of classes follows a long-tailed distribution, a situation that is likely to yield…

Machine Learning · Computer Science 2025-05-02 Z. S. Baltaci , K. Oksuz , S. Kuzucu , K. Tezoren , B. K. Konar , A. Ozkan , E. Akbas , S. Kalkan

Learning classifiers using skewed or imbalanced datasets can occasionally lead to classification issues; this is a serious issue. In some cases, one class contains the majority of examples while the other, which is frequently the more…

Machine Learning · Computer Science 2022-11-11 Satyendra Singh Rawat , Amit Kumar Mishra

Knowledge distillation is a technique for improving the performance of a simple "student" model by replacing its one-hot training labels with a distribution over labels obtained from a complex "teacher" model. While this simple approach has…

Machine Learning · Computer Science 2020-05-22 Aditya Krishna Menon , Ankit Singh Rawat , Sashank J. Reddi , Seungyeon Kim , Sanjiv Kumar