English
Related papers

Related papers: Statistical Undersampling with Mutual Information …

200 papers

In machine learning, classification is usually seen as a function approximation problem, where the goal is to learn a function that maps input features to class labels. In this paper, we propose a novel clustering and classification…

Machine Learning · Computer Science 2025-02-25 Hrushikesh Mhaskar , Ryan O'Dowd , Efstratios Tsoukanis

Class imbalance problems manifest in domains such as financial fraud detection or network intrusion analysis, where the prevalence of one class is much higher than another. Typically, practitioners are more interested in predicting the…

Machine Learning · Statistics 2017-11-16 Peter Xenopoulos

Sample re-weighting strategies provide a promising mechanism to deal with imperfect training data in machine learning, such as noisily labeled or class-imbalanced data. One such strategy involves formulating a bi-level optimization problem…

Machine Learning · Computer Science 2023-02-10 Yinjun Wu , Adam Stein , Jacob Gardner , Mayur Naik

In this paper we address imbalanced binary classification (IBC) tasks. Applying resampling strategies to balance the class distribution of training instances is a common approach to tackle these problems. Many state-of-the-art methods find…

Machine Learning · Computer Science 2022-05-31 Vitor Cerqueira , Luis Torgo , Paula Branco , Colin Bellinger

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

The era of huge data necessitates highly efficient machine learning algorithms. Many common machine learning algorithms, however, rely on computationally intensive subroutines that are prohibitively expensive on large datasets. Oftentimes,…

Machine Learning · Computer Science 2023-09-26 Mo Tiwari

Faced with massive data, subsampling is a commonly used technique to improve computational efficiency, and using nonuniform subsampling probabilities is an effective approach to improve estimation efficiency. For computational efficiency,…

Statistics Theory · Mathematics 2022-05-19 Jing Wang , Jiahui Zou , HaiYing Wang

Algorithms deployed in education can shape the learning experience and success of a student. It is therefore important to understand whether and how such algorithms might create inequalities or amplify existing biases. In this paper, we…

Computers and Society · Computer Science 2022-12-21 Jade Maï Cock , Muhammad Bilal , Richard Davis , Mirko Marras , Tanja Käser

Existing learning-based point cloud upsampling methods often overlook the intrinsic data distribution charac?teristics of point clouds, leading to suboptimal results when handling sparse and non-uniform point clouds. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yaohui Fang , Xingce Wang

We study the problem of learning classifiers that perform well across (known or unknown) groups of data. After observing that common worst-group-accuracy datasets suffer from substantial imbalances, we set out to compare state-of-the-art…

Machine Learning · Computer Science 2022-02-21 Badr Youbi Idrissi , Martin Arjovsky , Mohammad Pezeshki , David Lopez-Paz

Data imbalance is common in many vision tasks where one or more classes are rare. Without addressing this issue conventional methods tend to be biased toward the majority class with poor predictive accuracy for the minority class. These…

Computer Vision and Pattern Recognition · Computer Science 2016-02-04 Chen Huang , Chen Change Loy , Xiaoou Tang

The aim of Active Learning is to select the most informative samples from an unlabelled set of data. This is useful in cases where the amount of data is large and labelling is expensive, such as in machine vision or medical imaging. Two…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Julien Combes , Alexandre Derville , Jean-François Coeurjolly

Recently, deep learning models have achieved great success in computer vision applications, relying on large-scale class-balanced datasets. However, imbalanced class distributions still limit the wide applicability of these models due to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Yechan Kim , Younkwan Lee , Moongu Jeon

There is often a mixture of very frequent labels and very infrequent labels in multi-label datatsets. This variation in label frequency, a type class imbalance, creates a significant challenge for building efficient multi-label…

Machine Learning · Computer Science 2021-09-28 Payel Sadhukhan , Arjun Pakrashi , Sarbani Palit , Brian Mac Namee

With increasing computing capabilities of modern supercomputers, the size of the data generated from the scientific simulations is growing rapidly. As a result, application scientists need effective data summarization techniques that can…

Human-Computer Interaction · Computer Science 2019-07-30 Soumya Dutta , Ayan Biswas , James Ahrens

Multi-modal learning aims to enhance performance by unifying models from various modalities but often faces the "modality imbalance" problem in real data, leading to a bias towards dominant modalities and neglecting others, thereby limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yang Yang , Hongpeng Pan , Qing-Yuan Jiang , Yi Xu , Jinghui Tang

Highly imbalanced datasets are ubiquitous in medical image classification problems. In such problems, it is often the case that rare classes associated to less prevalent diseases are severely under-represented in labeled databases,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Adrian Galdran , Gustavo Carneiro , Miguel A. González Ballester

Forums play an important role in providing a platform for community interaction. The introduction of irrelevant content or spam by individuals for commercial and social gains tends to degrade the professional experience presented to the…

Information Retrieval · Computer Science 2019-09-12 Pratik Ratadiya , Rahul Moorthy

In recent years the importance of finding a meaningful pattern from huge datasets has become more challenging. Data miners try to adopt innovative methods to face this problem by applying feature selection methods. In this paper we propose…

Machine Learning · Computer Science 2014-03-11 Mehdi Naseriparsa , Amir-masoud Bidgoli , Touraj Varaee

Given a supervised machine learning problem where the training set has been subject to a known sampling bias, how can a model be trained to fit the original dataset? We achieve this through the Bayesian inference framework by altering the…

Machine Learning · Statistics 2022-03-16 Max Sklar