English
Related papers

Related papers: balance -- a Python package for balancing biased d…

200 papers

In this paper we present a technique to couple non-traditional data with statistics based on survey data, in order to partially correct for the bias produced by non-random sample selections. All major social media platforms represent huge…

Methodology · Statistics 2022-12-21 Valerio Astuti

The selection, development, or comparison of machine learning methods in data mining can be a difficult task based on the target problem and goals of a particular study. Numerous publicly available real-world and simulated benchmark…

Machine Learning · Computer Science 2017-03-03 Randal S. Olson , William La Cava , Patryk Orzechowski , Ryan J. Urbanowicz , Jason H. Moore

Assessing sensitivity to unmeasured confounding is an important step in observational studies, which typically estimate effects under the assumption that all confounders are measured. In this paper, we develop a sensitivity analysis…

Methodology · Statistics 2023-09-04 Dan Soriano , Eli Ben-Michael , Peter J. Bickel , Avi Feller , Samuel D. Pimentel

Supervised learning under measurement constraints is a common challenge in statistical and machine learning. In many applications, despite extensive design points, acquiring responses for all points is often impractical due to resource…

Methodology · Statistics 2025-03-19 Lin Wang

Understanding how and why certain communities bear a disproportionate burden of disease is challenging due to the scarcity of data on these communities. Surveys provide a useful avenue for accessing hard-to-reach populations, as many…

Methodology · Statistics 2023-07-27 Stephanie M. Wu , Briana Joy K. Stephenson

Surveys usually suffer from non-response, which decreases the effective sample size. Item non-response is typically handled by means of some form of random imputation if we wish to preserve the distribution of the imputed variable. This…

Methodology · Statistics 2017-08-04 Guillaume Chauvet , Wilfried Do Paco

Unbalanced tabular data sets present significant challenges for predictive modeling and data analysis across a wide range of applications. In many real-world scenarios, such as fraud detection, medical diagnosis, and rare event prediction,…

Machine Learning · Computer Science 2025-07-23 Ivona Krchova , Michael Platzer , Paul Tiwald

Research in psychology generates interesting data sets and unique statistical modelling tasks. However, these tasks, while important, are often very specific, so appropriate statistical models and methods cannot be found in accessible…

Applications · Statistics 2019-07-04 Jure Demšar , Grega Repovš , Erik Štrumbelj

Language models are prone to dataset biases, known as shortcuts and spurious correlations in data, which often result in performance drop on new data. We present a new debiasing framework called ``FairFlow'' that mitigates dataset biases by…

Machine Learning · Computer Science 2025-03-25 Jiali Cheng , Hadi Amiri

StepMix is an open-source Python package for the pseudo-likelihood estimation (one-, two- and three-step approaches) of generalized finite mixture models (latent profile and latent class analysis) with external variables (covariates and…

Survey weighting allows researchers to account for bias in survey samples, due to unit nonresponse or convenience sampling, using measured demographic covariates. Unfortunately, in practice, it is impossible to know whether the estimated…

Methodology · Statistics 2023-03-07 Erin Hartman , Melody Huang

This paper evaluates six strategies for mitigating imbalanced data: oversampling, undersampling, ensemble methods, specialized algorithms, class weight adjustments, and a no-mitigation approach referred to as the baseline. These strategies…

Machine Learning · Computer Science 2023-11-13 Jacques Wainer

Covariate balance is crucial for unconfounded descriptive or causal comparisons. However, lack of balance is common in observational studies. This article considers weighting strategies for balancing covariates. We define a general class of…

Methodology · Statistics 2016-09-30 Fan Li , Kari Lock Morgan , Alan M. Zaslavsky

Covariate balance is crucial for unconfounded descriptive or causal comparisons. However, lack of balance is common in observational studies. This article considers weighting strategies for balancing covariates. We define a general class of…

Methodology · Statistics 2016-11-17 Fan Li , Kari Lock Morgan , Alan M. Zaslavsky

Application of interpretable machine learning techniques on medical datasets facilitate early and fast diagnoses, along with getting deeper insight into the data. Furthermore, the transparency of these models increase trust among…

Machine Learning · Computer Science 2025-06-05 Sreejita Ghosh , Elizabeth S. Baranowski , Michael Biehl , Wiebke Arlt , Peter Tino , Kerstin Bunte

The Bayesian approach to data analysis provides a powerful way to handle uncertainty in all observations, model parameters, and model structure using probability theory. Probabilistic programming languages make it easier to specify and fit…

{Analyzing and modeling rare events in count data presents significant challenges due to the scarcity of observations and the complexity of underlying processes, which are often overlooked by analysts due to limitations in time, resources,…

Methodology · Statistics 2025-05-07 Zeke Ahern , Paul Corry , Alexander Paz

We consider the setting of an aggregate data meta-analysis of a continuous outcome of interest. When the distribution of the outcome is skewed, it is often the case that some primary studies report the sample mean and standard deviation of…

Conventional meta analysis of model performance conducted using datasources from different underlying populations often result in estimates that cannot be interpreted in the context of a well defined target population. In this manuscript we…

Methodology · Statistics 2024-09-23 Jon A. Steingrimsson , Lan Wen , Sarah Voter , Issa J. Dahabreh

The reliability of survey data is crucial in supply chain decision-making, particularly when evaluating readiness for AI-driven tools such as safety stock optimization systems. However, surveys often attract low-effort or fake responses…

Computers and Society · Computer Science 2026-01-27 Bhubalan Mani