English
Related papers

Related papers: Nonuniform Negative Sampling and Log Odds Correcti…

200 papers

Negative binomial regression is essential for analyzing over-dispersed count data in in comparative studies, but parameter estimation becomes computationally challenging in large screens requiring millions of comparisons. We investigate…

Machine Learning · Statistics 2025-08-07 Valentine Svensson

In this paper, we address the challenging problem of learning from imbalanced data using a Nearest-Neighbor (NN) algorithm. In this setting, the minority examples typically belong to the class of interest requiring the optimization of…

Machine Learning · Computer Science 2020-01-23 Rémi Viola , Rémi Emonet , Amaury Habrard , Guillaume Metzler , Sébastien Riou , Marc Sebban

We consider the problem of estimating quantile treatment effects without assuming strict overlap , i.e., we do not assume that the propensity score is bounded away from zero. More specifically, we consider an inverse probability weighting…

Statistics Theory · Mathematics 2026-02-24 Marco Avella-Medina , Richard Davis , Gennady Samorodnitsky

The inverse probability weighting (IPW) method is used to handle attrition in association analyses derived from cohort studies. It consists in weighting the respondents at a given follow-up by their inverse probability to participate.…

Applications · Statistics 2021-05-05 Marie-Astrid Metten , Nathalie Costet , J. -F. Viel , Guillaume Chauvet

Negative binomial regression is commonly employed to analyze overdispersed count data. With small to moderate sample sizes, the maximum likelihood estimator of the dispersion parameter may be subject to a significant bias, that in turn…

Methodology · Statistics 2020-11-06 Euloge Clovis Kenne Pagui , Alessandra Salvan , Nicola Sartori

Recurrent events are common and important clinical trial endpoints in many disease areas, e.g., cardiovascular hospitalizations in heart failure, relapses in multiple sclerosis, or exacerbations in asthma. During a trial, patients may…

Methodology · Statistics 2026-04-08 Jiren Sun , Tobias Mutze , Richard Cook , Tianmeng Lyu

Inverse propensity weighting (IPW) is a popular method for estimating treatment effects from observational data. However, its correctness relies on the untestable (and frequently implausible) assumption that all confounders have been…

Statistics Theory · Mathematics 2023-08-04 Jacob Dorn , Kevin Guo

This paper develops an updatable inverse probability weighting (UIPW) estimation for the generalized linear models with response missing at random in streaming data sets. A two-step online updating algorithm is provided for the proposed…

Statistics Theory · Mathematics 2023-10-10 Xianhua Zhang , Lu lin , Qihua Wang

Randomized Controlled Trials (RCTs) may suffer from limited scope. In particular, samples may be unrepresentative: some RCTs over- or under- sample individuals with certain characteristics compared to the target population, for which one…

Methodology · Statistics 2024-03-15 Bénédicte Colnet , Julie Josse , Gaël Varoquaux , Erwan Scornet

A model is proposed for the statistical analysis of arbitrary-strength quantum measurements, based on a picture of "sampling weak values" from different configurations of the system. The model is comprised of two elements: a "local weak…

Quantum Physics · Physics 2007-05-23 Alonso Botero

In this paper, we propose improved estimation method for logistic regression based on subsamples taken according the optimal subsampling probabilities developed in Wang et al. 2018 Both asymptotic results and numerical results show that the…

Methodology · Statistics 2021-06-24 HaiYing Wang

While the inverse probability of treatment weighting (IPTW) is a commonly used approach for treatment comparisons in observational data, the resulting estimates may be subject to bias and excessively large variance when there is lack of…

Methodology · Statistics 2024-02-13 Zhiqiang Cao , Lama Ghazi , Claudia Mastrogiacomo , Laura Forastiere , F. Perry Wilson , Fan Li

We discuss estimating the probability that the sum of nonnegative independent and identically distributed random variables falls below a given threshold, i.e., $\mathbb{P}(\sum_{i=1}^{N}{X_i} \leq \gamma)$, via importance sampling (IS). We…

Computation · Statistics 2021-10-04 Nadhir Ben Rached , Abdul-Lateef Haji-Ali , Gerardo Rubino , Raul Tempone

Learning from imbalanced data is a challenging task. Standard classification algorithms tend to perform poorly when trained on imbalanced data. Some special strategies need to be adopted, either by modifying the data distribution or by…

Machine Learning · Computer Science 2022-08-26 Asif Newaz , Shahriar Hassan , Farhan Shahriyar Haq

Inverse probability of treatment weighting (IPTW) is a popular method for estimating the average treatment effect (ATE). However, empirical studies show that the IPTW estimators can be sensitive to the misspecification of the propensity…

Methodology · Statistics 2021-08-04 Jianqing Fan , Kosuke Imai , Inbeom Lee , Han Liu , Yang Ning , Xiaolin Yang

Driven by applications in telecommunication networks, we explore the simulation task of estimating rare event probabilities for tandem queues in their steady state. Existing literature has recognized that importance sampling methods can be…

Machine Learning · Computer Science 2025-04-22 Ruoning Zhao , Xinyun Chen

A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample…

Methodology · Statistics 2015-11-24 Rong Zhu , Ping Ma , Michael W. Mahoney , Bin Yu

Win measures, including the win ratio (WR), win odds (WO), net benefit (NB), and desirability of outcome ranking (DOOR), are increasingly used in randomized clinical trials with multiple hierarchical ordinal endpoints. In practice, however,…

Methodology · Statistics 2026-05-27 Yi Liu , Huiman Barnhart , Sean O'Brien , Yuliya Lokhnygina , Roland A. Matsouaka

Publication bias is a major concern in conducting systematic reviews and meta-analyses. Various sensitivity analysis or bias-correction methods have been developed based on selection models and they have some advantages over the widely used…

Methodology · Statistics 2021-09-28 Ao Huang , Kosuke Morikawa , Tim Friede , Satoshi Hattori

To address the challenges of imbalanced multi-class datasets typically used for rare event detection in critical cyber-physical systems, we propose an optimal, efficient, and adaptable mixed integer programming (MIP) ensemble weighting…

Machine Learning · Computer Science 2025-04-16 Georgios Tertytchny , Georgios L. Stavrinides , Maria K. Michael