English
Related papers

Related papers: VaB-AL: Incorporating Class Imbalance and Difficul…

200 papers

The latent variables learned by VAEs have seen considerable interest as an unsupervised way of extracting features, which can then be used for downstream tasks. There is a growing interest in the question of whether features learned on one…

Machine Learning · Computer Science 2020-05-13 Saeid Asgari Taghanaki , Mohammad Havaei , Alex Lamb , Aditya Sanghi , Ara Danielyan , Tonya Custis

In this paper, we present a novel approach for training a Variational Autoencoder (VAE) on a highly imbalanced data set. The proposed training of a high-resolution VAE model begins with the training of a low-resolution core model, which can…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Dmitry Utyamishev , Inna Partin-Vaisband

How can we find a general way to choose the most suitable samples for training a classifier? Even with very limited prior information? Active learning, which can be regarded as an iterative optimization procedure, plays a key role to…

Machine Learning · Computer Science 2019-04-16 Bo Du , Zengmao Wang , Lefei Zhang , Liangpei Zhang , Wei Liu , Jialie Shen , Dacheng Tao

Recent advances in machine learning have led to increased deployment of black-box classifiers across a wide variety of applications. In many such situations there is a critical need to both reliably assess the performance of these…

Machine Learning · Statistics 2021-03-16 Disi Ji , Robert L. Logan , Padhraic Smyth , Mark Steyvers

Adequate sampling space coverage is the keystone to effectively train trustworthy Machine Learning models. Unfortunately, real data do carry several inherent risks due to the many potential biases they exhibit when gathered without a proper…

Machine Learning · Computer Science 2025-03-27 Antonio Maratea , Rita Perna

The high cost of acquiring labels is one of the main challenges in deploying supervised machine learning algorithms. Active learning is a promising approach to control the learning process and address the difficulties of data labeling by…

Machine Learning · Computer Science 2019-11-19 Farhad Pourkamali-Anaraki , Michael B. Wakin

Recently, several studies have investigated active learning (AL) for natural language processing tasks to alleviate data dependency. However, for query selection, most of these studies mainly rely on uncertainty-based sampling, which…

Computation and Language · Computer Science 2020-11-30 Yekyung Kim

When using machine learning for imbalanced binary classification problems, it is common to subsample the majority class to create a (more) balanced training dataset. This biases the model's predictions because the model learns from data…

Machine Learning · Computer Science 2025-11-03 Nathan Phelps , Daniel J. Lizotte , Douglas G. Woolford

Datasets are rarely a realistic approximation of the target population. Say, prevalence is misrepresented, image quality is above clinical standards, etc. This mismatch is known as sampling bias. Sampling biases are a major hindrance for…

Given a multivariate function taking deterministic and uncertain inputs, we consider the problem of estimating a quantile set: a set of deterministic inputs for which the probability that the output belongs to a specific region remains…

Applications · Statistics 2025-07-25 Romain Ait Abdelmalek-Lomenech , Julien Bect , Emmanuel Vazquez

The variational autoencoder (VAE) typically employs a standard normal prior as a regularizer for the probabilistic latent encoder. However, the Gaussian tail often decays too quickly to effectively accommodate the encoded points, failing to…

Machine Learning · Statistics 2024-03-05 Juno Kim , Jaehyuk Kwon , Mincheol Cho , Hyunjong Lee , Joong-Ho Won

Explainability poses a major challenge to artificial intelligence (AI) techniques. Current studies on explainable AI (XAI) lack the efficiency of extracting global knowledge about the learning task, thus suffer deficiencies such as…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Ruitao Xie , Jingbang Chen , Limai Jiang , Rui Xiao , Yi Pan , Yunpeng Cai

In this paper, we study the accuracy of values aggregated over classes predicted by a classification algorithm. The problem is that the resulting aggregates (e.g., sums of a variable) are known to be biased. The bias can be large even for…

Machine Learning · Statistics 2019-12-02 Q. A. Meertens , C. G. H. Diks , H. J. van den Herik , F W Takes

Learning representations that disentangle the underlying factors of variability in data is an intuitive way to achieve generalization in deep models. In this work, we address the scenario where generative factors present a multimodal…

Machine Learning · Statistics 2020-04-07 Javier Antoran , Antonio Miguel

An active learner is given a class of models, a large set of unlabeled examples, and the ability to interactively query labels of a subset of these examples; the goal of the learner is to learn a model in the class that fits the data well.…

Machine Learning · Computer Science 2015-06-09 Kamalika Chaudhuri , Sham Kakade , Praneeth Netrapalli , Sujay Sanghavi

Class-imbalance refers to classification problems in which many more instances are available for certain classes than for others. Such imbalanced datasets require special attention because traditional classifiers generally favor the…

Machine Learning · Statistics 2018-11-30 Rafael M. O. Cruz , Robert Sabourin , George D. C. Cavalcanti

A popular strategy for active learning is to specifically target a reduction in epistemic uncertainty, since aleatoric uncertainty is often considered as being intrinsic to the system of interest and therefore not reducible. Yet,…

Methodology · Statistics 2024-12-12 Jake Thomas , Jeremie Houssineau

Modern computing and communication technologies can make data collection procedures very efficient. However, our ability to analyze large data sets and/or to extract information out from them is hard-pressed to keep up with our capacities…

Machine Learning · Statistics 2019-01-30 Zhanfeng Wang , Yumi Kwon , Yuan-chin Ivan Chang

Class imbalance induces systematic bias in deep neural networks by imposing a skewed effective class prior. This work introduces the Neural Prior Estimator (NPE), a framework that learns feature-conditioned log-prior estimates from latent…

Machine Learning · Computer Science 2026-02-23 Masoud Yavari , Payman Moallem

Incremental Learning (IL) allows AI systems to adapt to streamed data. Most existing algorithms make two strong hypotheses which reduce the realism of the incremental scenario: (1) new data are assumed to be readily annotated when streamed…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Eden Belouadah , Adrian Popescu , Umang Aggarwal , Léo Saci