English
Related papers

Related papers: Choosing good subsamples for regression modelling

200 papers

Data rebalancing techniques, including oversampling and undersampling, are a common approach to addressing the challenges of imbalanced data. To tackle unresolved problems related to both oversampling and undersampling, we propose a new…

Machine Learning · Computer Science 2025-07-11 Karen Medlin , Sven Leyffer , Krishnan Raghavan

Subsampling is a computationally efficient and scalable method to draw inference in large data settings based on a subset of the data rather than needing to consider the whole dataset. When employing subsampling techniques, a crucial…

Methodology · Statistics 2025-10-08 Amalan Mahendran , Helen Thompson , James M. McGree

We study the problem of parameter estimation for time-series possessing two, widely separated, characteristic time scales. The aim is to understand situations where it is desirable to fit a homogenized singlescale model to such multiscale…

Statistics Theory · Mathematics 2009-11-11 G. A. Pavliotis , A. M. Stuart

We present a new and general method of weighted least square univariate regression where the dependent variable is expanded as a series of suitably chosen functions of the independent variables. Each term of the series is obtained by an…

Numerical Analysis · Mathematics 2021-03-26 Nilotpal Kanti Sinha

Randomized trials are considered the gold standard for estimating causal effects. Trial findings are often used to inform policy and programming efforts, yet their results may not generalize well to a relevant target population due to…

In machine learning models, the estimation of errors is often complex due to distribution bias, particularly in spatial data such as those found in environmental studies. We introduce an approach based on the ideas of importance sampling to…

Machine Learning · Computer Science 2023-09-15 Boris Prokhorov , Diana Koldasbayeva , Alexey Zaytsev

Testing for the significance of a subset of regression coefficients in a linear model, a staple of statistical analysis, goes back at least to the work of Fisher who introduced the analysis of variance (ANOVA). We study this problem under…

Statistics Theory · Mathematics 2012-02-24 Ery Arias-Castro , Emmanuel J. Candès , Yaniv Plan

Small sample sizes are common in many disciplines, which necessitates pooling roughly similar datasets across multiple institutions to study weak but relevant associations between images and disease outcomes. Such data often manifest…

Machine Learning · Computer Science 2024-11-19 Sotirios Panagiotis Chytas , Vishnu Suresh Lokhande , Peiran Li , Vikas Singh

Modern longitudinal studies collect multiple outcomes as the primary endpoints to understand the complex dynamics of the diseases. Oftentimes, especially in clinical trials, the joint variations among the multidimensional responses play a…

Methodology · Statistics 2024-01-17 Salil Koner , Sheng Luo

Machine learning models often have uneven performance among subpopulations (a.k.a., groups) in the data distributions. This poses a significant challenge for the models to generalize when the proportions of the groups shift during…

Machine Learning · Computer Science 2025-03-11 Rui Qiao , Zhaoxuan Wu , Jingtan Wang , Pang Wei Koh , Bryan Kian Hsiang Low

Meta-analyses are regarded as the highest level in the hierarchy of evidence, yet standard models traditionally concentrated on estimating the mean effect size, often under restrictive assumptions about the underlying distribution, such as…

Other Statistics · Statistics 2026-04-02 Yefeng Yang , Shinichi Nakagawa

Observational cohort studies with oversampled exposed subjects are typically implemented to understand the causal effect of a rare exposure. Because the distribution of exposed subjects in the sample differs from the source population,…

Methodology · Statistics 2019-02-14 Sherri Rose

To capture the dependences of a disease on several risk factors, a challenge is to combine model-based estimation with evidence-based arguments. Standard case-control methods allow estimation of the dependences of a rare disease on several…

Methodology · Statistics 2012-03-09 Nanny Wermuth , Giovanni M. Marchetti

Many problems within personalized medicine and digital health rely on the analysis of continuous-time functional biomarkers and other complex data structures emerging from high-resolution patient monitoring. In this context, this work…

Machine Learning · Statistics 2025-01-14 Marcos Matabuena

To improve the generalizability of impact evaluations, recent research has examined statistical methods for selecting representative samples of sites. However, these methods rely on having rich data on impact moderators for all sites in the…

Methodology · Statistics 2022-01-17 Robert B. Olsen

Probability samples are the preferred method for providing inferences that are generalizable to a larger population. However, when a small (or rare) subpopulation is the group of interest, this approach is unlikely to yield a sample size…

Methodology · Statistics 2019-08-13 Michael W. Robbins , Bonnie Ghosh-Dastidar , Rajeev Ramchand

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares

Background: Adaptive interventions provide a guide for using ongoing information about individuals to decide whether and how to modify the type, amount, delivery modality, or timing of treatment, to improve intervention effectiveness while…

Methodology · Statistics 2026-03-12 John J. Dziak , Inbal Nahum-Shani

We consider a longitudinal data structure consisting of baseline covariates, time-varying treatment variables, intermediate time-dependent covariates, and a possibly time dependent outcome. Previous studies have shown that estimating the…

Statistics Theory · Mathematics 2018-10-09 Linh Tran , Maya Petersen , Joshua Schwab , Mark J van der Laan

We present a new method in problems where estimates are needed for finite population domains with small or even zero sample sizes. In contrast to known estimation methods, an auxiliary information is used to model sizes of population units…

Statistics Theory · Mathematics 2014-06-23 Andrius Čiginas , Tomas Rudys