English
Related papers

Related papers: On the impact of dataset size and class imbalance …

200 papers

Deep learning methods such as multitask neural networks have recently been applied to ligand-based virtual screening and other drug discovery applications. Using a set of industrial ADMET datasets, we compare neural networks to standard…

Machine Learning · Statistics 2017-01-16 Steven Kearnes , Brian Goldman , Vijay Pande

Medical events of interest, such as mortality, often happen at a low rate in electronic medical records, as most admitted patients survive. Training models with this imbalance rate (class density discrepancy) may lead to suboptimal…

Machine Learning · Computer Science 2022-08-02 Zepeng Huo , Xiaoning Qian , Shuai Huang , Zhangyang Wang , Bobak J. Mortazavi

Active learning aims to optimize the dataset annotation process when resources are constrained. Most existing methods are designed for balanced datasets. Their practical applicability is limited by the fact that a majority of real-life…

Machine Learning · Computer Science 2022-02-02 Umang Aggarwal , Adrian Popescu , Céline Hudelot

Dataset Condensation (DC) aims to reduce deep neural networks training efforts by synthesizing a small dataset such that it will be as effective as the original large dataset. Conventionally, DC relies on a costly bi-level optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Sahar Rahimi Malakshan , Mohammad Saeed Ebrahimi Saadabadi , Ali Dabouei , Nasser M. Nasrabadi

In recent years, dataset distillation has provided a reliable solution for data compression, where models trained on the resulting smaller synthetic datasets achieve performance comparable to those trained on the original datasets. To…

Our objective is to develop an artificially intelligent system which aims at checking the compatibility between the roommates of same or different sex sharing a common area of residence. There are a few key factors determining one's…

Social and Information Networks · Computer Science 2024-09-05 Mansha Lamba , Raunak Goswami , Vinay , Mohit Lamba

Dataset Condensation aims to condense a large dataset into a smaller one while maintaining its ability to train a well-performing model, thus reducing the storage cost and training effort in deep learning applications. However, conventional…

Machine Learning · Computer Science 2023-07-20 Ganlong Zhao , Guanbin Li , Yipeng Qin , Yizhou Yu

Data is a cornerstone of empirical software engineering (ESE) research and practice. Data underpin numerous process and project management activities, including the estimation of development effort and the prediction of the likely location…

Software Engineering · Computer Science 2020-12-22 Michael F. Bosu , Stephen G. MacDonell

This paper focuses on block likelihood estimation for geostatistical data, a method that balances statistical accuracy and computational efficiency. Central to this approach is the choice of block size, which can significantly impact…

Methodology · Statistics 2026-05-06 Alfredo Alegría

In practice, machine learning experts are often confronted with imbalanced data. Without accounting for the imbalance, common classifiers perform poorly and standard evaluation metrics mislead the practitioners on the model's performance. A…

Machine Learning · Computer Science 2020-07-21 Ramiro Camino , Christian Hammerschmidt , Radu State

Large language models (LLMs) can generate programs that pass unit tests, but passing tests does not guarantee reliable runtime behavior. We find that different correct solutions to the same task can show very different memory and…

Class imbalance exists in many classification problems, and since the data is designed for accuracy, imbalance in data classes can lead to classification challenges with a few classes having higher misclassification costs. The Backblaze…

Machine Learning · Computer Science 2023-10-16 Shuangshuang Yuan , Peng Wu , Yuehui Chen , Qiang Li

Large language models achieve high performance on many but not all downstream tasks. The interaction between pretraining data and task data is commonly assumed to determine this variance: a task with data that is more similar to a model's…

Computation and Language · Computer Science 2023-11-16 Gregory Yauney , Emily Reif , David Mimno

Recent observations have underscored a disparity between the inflated benchmark scores and the actual performance of LLMs, raising concerns about potential contamination of evaluation benchmarks. This issue is especially critical for…

Computation and Language · Computer Science 2024-04-05 Chunyuan Deng , Yilun Zhao , Xiangru Tang , Mark Gerstein , Arman Cohan

Machine learning models are susceptible to being misled by biases in training data that emphasize incidental correlations over the intended learning task. In this study, we demonstrate the impact of data bias on the performance of a machine…

Materials Science · Physics 2024-12-11 Ali Davariashtiyani , Busheng Wang , Samad Hajinazar , Eva Zurek , Sara Kadkhodaei

Several studies point out different causes of performance degradation in supervised machine learning. Problems such as class imbalance, overlapping, small-disjuncts, noisy labels, and sparseness limit accuracy in classification algorithms.…

Machine Learning · Computer Science 2020-04-17 Gustavo A. Valencia-Zapata , Carolina Gonzalez-Canas , Michael G. Zentner , Okan Ersoy , Gerhard Klimeck

There are many real-world classification problems wherein the issue of data imbalance (the case when a data set contains substantially more samples for one/many classes than the rest) is unavoidable. While under-sampling the problematic…

Computer Vision and Pattern Recognition · Computer Science 2018-01-09 John McKay , Isaac Gerg , Vishal Monga

In the era of big data, the utilization of credit-scoring models to determine the credit risk of applicants accurately becomes a trend in the future. The conventional machine learning on credit scoring data sets tends to have poor…

Machine Learning · Statistics 2021-02-10 Xiaofan Liua , Zuoquan Zhanga , Di Wanga

Class-imbalanced data, in which some classes contain far more samples than others, is ubiquitous in real-world applications. Standard techniques for handling class-imbalance usually work by training on a re-weighted loss or on re-balanced…

Artificial Intelligence · Computer Science 2021-06-18 Arpit Bansal , Micah Goldblum , Valeriia Cherepanova , Avi Schwarzschild , C. Bayan Bruss , Tom Goldstein

Data imbalance exists ubiquitously in real-world visual regressions, e.g., age estimation and pose estimation, hurting the model's generalizability and fairness. Thus, imbalanced regression gains increasing research attention recently.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Jiawei Ren , Mingyuan Zhang , Cunjun Yu , Ziwei Liu