English
Related papers

Related papers: High-dimensional Statistics Applications to Batch …

200 papers

We propose Batch-Expansion Training (BET), a framework for running a batch optimizer on a gradually expanding dataset. As opposed to stochastic approaches, batches do not need to be resampled i.i.d. at every iteration, thus making BET more…

Machine Learning · Computer Science 2018-02-26 Michał Dereziński , Dhruv Mahajan , S. Sathiya Keerthi , S. V. N. Vishwanathan , Markus Weimer

Hierarchical data with multiple observations per group is ubiquitous in empirical sciences and is often analyzed using mixed-effects regression. In such models, Bayesian inference gives an estimate of uncertainty but is analytically…

Machine Learning · Computer Science 2026-02-05 Alex Kipnis , Marcel Binz , Eric Schulz

The simultaneous estimation of many parameters based on data collected from corresponding studies is a key research problem that has received renewed attention in the high-dimensional setting. Many practical situations involve heterogeneous…

Methodology · Statistics 2026-03-26 Trambak Banerjee , Luella J. Fu , Gareth M. James , Gourab Mukherjee , Wenguang Sun

Modern biotechnologies often result in high-dimensional data sets with much more variables than observations (n $\ll$ p). These data sets pose new challenges to statistical analysis: Variable selection becomes one of the most important…

Machine Learning · Statistics 2014-11-06 Benjamin Hofner , Luigi Boccuto , Markus Göker

Intensity interferometry and in particular that due to Bose Einstein correlations (BEC) constitutes at present the only direct experimental method for the determination of sizes and lifetimes of sources in particle and nuclear physics. The…

High Energy Physics - Phenomenology · Physics 2009-10-31 Richard M. Weiner

When treating depression, clinicians are interested in determining the optimal treatment for a given patient, which is challenging given the amount of treatments available. To advance individualized treatment allocation, integrating data…

We consider a joint survival and mixed-effects model to explain the survival time from longitudinal data and high-dimensional covariates in a population. The longitudinal data is modeled using a non linear mixed-effects model to account for…

Statistics Theory · Mathematics 2025-08-06 Antoine Caillebotte , Estelle Kuhn , Sarah Lemler

Understanding how treatment effects vary across patient characteristics is essential for personalized medicine, yet randomized controlled trials (RCTs) are often underpowered to detect heterogeneous treatment effects (HTEs). We propose a…

Methodology · Statistics 2025-07-22 Amir Asiaee , Chiara Di Gravio , Cole Beck , Yuting Mei , Samhita Pal , Jared D. Huling

Statistical matching methods are widely used in the social and health sciences to estimate causal effects using observational data. Often the objective is to find comparable groups with similar covariate distributions in a dataset, with the…

Applications · Statistics 2021-01-19 Felix Bestehorn , Maike Bestehorn , Christian Kirches

We propose a mathematical model based on probability theory to optimize COVID-19 testing by a multi-step batch testing approach with variable batch sizes. This model and simulation tool dramatically increase the efficiency and efficacy of…

Methodology · Statistics 2021-01-11 Hongshik Ahn , Haoran Jiang , Xiaolin Li

The B/C ratio is used in cosmic-ray physics to constrain the transport parameters. However, from the same set of data, the various published values show a puzzling large scatter of these parameters. We investigate the impact of using…

High Energy Astrophysical Phenomena · Physics 2010-07-08 D. Maurin , A. Putze , L. Derome

Quantile treatment effects (QTEs) can characterize the potentially heterogeneous causal effect of a treatment on different points of the entire outcome distribution. Propensity score (PS) methods are commonly employed for estimating QTEs in…

Methodology · Statistics 2023-08-15 Yahang Liu , Kecheng Wei , Chen Huang , Yongfu Yu , Guoyou Qin

Robust estimation of heterogeneous treatment effects is a fundamental challenge for optimal decision-making in domains ranging from personalized medicine to educational policy. In recent years, predictive machine learning has emerged as a…

Machine Learning · Statistics 2025-06-23 Maximilian Schuessler , Erik Sverdrup , Robert Tibshirani

In randomized clinical trials, adjustments for baseline covariates at both design and analysis stages are highly encouraged by regulatory agencies. A recent trend is to use a model-assisted approach for covariate adjustment to gain…

Methodology · Statistics 2021-07-14 Ting Ye , Jun Shao , Yanyao Yi , Qingyuan Zhao

In this paper, we present an algorithm for learning time-correlated measurement covariances for application in batch state estimation. We parameterize the inverse measurement covariance matrix to be block-banded, which conveniently…

Robotics · Computer Science 2023-03-14 David J. Yoon , Timothy D. Barfoot

We propose a novel multi-task neural network approach for estimating distributional treatment effects (DTE) in randomized experiments. While DTE provides more granular insights into the experiment outcomes over conventional methods focusing…

Machine Learning · Computer Science 2025-07-11 Tomu Hirata , Undral Byambadalai , Tatsushi Oka , Shota Yasui , Shingo Uto

Studies of the effects of medical interventions increasingly take place in distributed research settings using data from multiple clinical data sources including electronic health records and administrative claims. In such settings, privacy…

Methodology · Statistics 2021-01-06 Martijn J. Schuemie , Yong Chen , David Madigan , Marc A. Suchard

High dimensional predictive regressions are useful in wide range of applications. However, the theory is mainly developed assuming that the model is stationary with time invariant parameters. This is at odds with the prevalent evidence for…

Econometrics · Economics 2019-10-09 Kashif Yousuf , Serena Ng

The statistical efficiency of randomized clinical trials can be improved by incorporating information from baseline covariates (i.e., pre-treatment patient characteristics). This can be done in the design stage using stratified (permutated…

Methodology · Statistics 2025-02-04 Zhiwei Zhang

Bayesian Optimization (BO) is a class of black-box, surrogate-based heuristics that can efficiently optimize problems that are expensive to evaluate, and hence admit only small evaluation budgets. BO is particularly popular for solving…

Machine Learning · Computer Science 2024-06-25 Maria Laura Santoni , Elena Raponi , Renato De Leone , Carola Doerr