English
Related papers

Related papers: Neural Prior Estimation: Learning Class Priors fro…

200 papers

Computer simulations have proven a valuable tool for understanding complex phenomena across the sciences. However, the utility of simulators for modelling and forecasting purposes is often restricted by low data quality, as well as…

Machine Learning · Statistics 2022-10-14 Daniel Ward , Patrick Cannon , Mark Beaumont , Matteo Fasiolo , Sebastian M Schmon

Improving the classification of multi-class imbalanced data is more difficult than its two-class counterpart. In this paper, we use deep neural networks to train new representations of tabular multi-class data. Unlike the typically…

Machine Learning · Computer Science 2023-12-19 Damian Horna , Lango Mateusz , Jerzy Stefanowski

Without any specific way for imbalance data classification, artificial intelligence algorithm cannot recognize data from minority classes easily. In general, modifying the existing algorithm by assuming that the training data is imbalanced,…

Machine Learning · Computer Science 2018-07-16 Fanny , Tjeng Wawan Cenggoro

Deep neural networks employing error back-propagation for learning can suffer from exploding and vanishing gradient problems. Numerous solutions have been proposed such as normalisation techniques or limiting activation functions to linear…

Machine Learning · Computer Science 2023-09-08 Sama Daryanavard , Bernd Porr

Deeply-learned planning methods are often based on learning representations that are optimized for unrelated tasks. For example, they might be trained on reconstructing the environment. These representations are then combined with predictor…

Machine Learning · Computer Science 2021-03-18 Hlynur Davíð Hlynsson , Merlin Schüler , Robin Schiewer , Tobias Glasmachers , Laurenz Wiskott

Neural Posterior Estimation (NPE) enables rapid parameter inference for complex simulators with intractable likelihoods. NPE trains an inference network to estimate a probability density over parameters given data, typically assumed to be…

Machine Learning · Computer Science 2026-05-14 Jan Boelts , Cornelius Schröder , Jonas Beck , Jakob H. Macke , Michael Deistler , Daniel Gedon

Neural networks have revolutionized numerous fields, yet they remain vulnerable to a critical flaw: the tendency to learn implicit biases, spurious correlations between certain attributes and target labels in training data. These biases are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Piyush Arora , Navlika Singh , Vasubhya Diwan , Pratik Mazumder

In this study, we systematically investigate the impact of class imbalance on classification performance of convolutional neural networks (CNNs) and compare frequently used methods to address the issue. Class imbalance is a common problem…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Mateusz Buda , Atsuto Maki , Maciej A. Mazurowski

We present Neural Autoregressive Distribution Estimation (NADE) models, which are neural network architectures applied to the problem of unsupervised distribution and density estimation. They leverage the probability product rule and a…

Machine Learning · Computer Science 2016-05-30 Benigno Uria , Marc-Alexandre Côté , Karol Gregor , Iain Murray , Hugo Larochelle

Training of deep neural networks heavily depends on the data distribution. In particular, the networks easily suffer from class imbalance. The trained networks would recognize the frequent classes better than the infrequent classes. To…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Byungju Kim , Junmo Kim

Although deep neural networks achieve tremendous success on various classification tasks, the generalization ability drops sheer when training datasets exhibit long-tailed distributions. One of the reasons is that the learned…

Machine Learning · Computer Science 2023-02-27 Xuantong Liu , Jianfeng Zhang , Tianyang Hu , He Cao , Lujia Pan , Yuan Yao

Deep neural networks have become the dominant approach in natural language processing (NLP). However, in recent years, it has become apparent that there are shortcomings in systematicity that limit the performance and data efficiency of…

Computation and Language · Computer Science 2021-03-11 Radha Kopparti , Tillman Weyde

The variational autoencoder (VAE) is a popular combination of deep latent variable model and accompanying variational learning technique. By using a neural inference network to approximate the model's posterior on latent variables, VAEs…

Machine Learning · Computer Science 2019-01-30 Junxian He , Daniel Spokoyny , Graham Neubig , Taylor Berg-Kirkpatrick

Real-world datasets are often highly class-imbalanced, which can adversely impact the performance of deep learning models. The majority of research on training neural networks under class imbalance has focused on specialized loss functions,…

Machine Learning · Computer Science 2023-12-06 Ravid Shwartz-Ziv , Micah Goldblum , Yucen Lily Li , C. Bayan Bruss , Andrew Gordon Wilson

When using machine learning for imbalanced binary classification problems, it is common to subsample the majority class to create a (more) balanced training dataset. This biases the model's predictions because the model learns from data…

Machine Learning · Computer Science 2025-11-03 Nathan Phelps , Daniel J. Lizotte , Douglas G. Woolford

Recognizing named entities (NEs) is commonly conducted as a classification problem that predicts a class tag for a word or a NE candidate in a sentence. In shallow structures, categorized features are weighted to support the prediction.…

Computation and Language · Computer Science 2022-02-01 Yanping Chen , Lefei Wu , Qinghua Zheng , Ruizhang Huang , Jun Liu , Liyuan Deng , Junhui Yu , Yongbin Qing , Bo Dong , Ping Chen

Motivated by applications in protein function prediction, we consider a challenging supervised classification setting in which positive labels are scarce and there are no explicit negative labels. The learning algorithm must thus select…

Machine Learning · Computer Science 2019-01-28 Marco Frasca , Nicolò Cesa-Bianchi

Simulation-based inference (SBI) enables parameter estimation for complex stochastic models with intractable likelihoods when model simulation is feasible. Neural posterior estimation (NPE) is a popular SBI approach that often achieves…

Methodology · Statistics 2026-02-23 Ryan P. Kelly , David T. Frazier , David J. Warne , Christopher C. Drovandi

Head pose estimation (HPE) plays a critical role in various computer vision applications such as human-computer interaction and facial recognition. In this paper, we propose a novel deep learning approach for head pose estimation with…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Mahdi Ghafourian , Federico M. Sukno

Class imbalance poses a significant challenge in classification tasks, where traditional approaches often lead to biased models and unreliable predictions. Undersampling and oversampling techniques have been commonly employed to address…

Machine Learning · Computer Science 2025-10-22 Matt Clifford , Jonathan Erskine , Alexander Hepburn , Raúl Santos-Rodríguez , Dario Garcia-Garcia