English
Related papers

Related papers: Fast Rerandomization for Balancing Covariates in R…

200 papers

Random Reshuffling (RR) is an algorithm for minimizing finite-sum functions that utilizes iterative gradient descent steps in conjunction with data reshuffling. Often contrasted with its sibling Stochastic Gradient Descent (SGD), RR is…

Optimization and Control · Mathematics 2021-04-06 Konstantin Mishchenko , Ahmed Khaled , Peter Richtárik

This paper addresses the task of estimating a covariance matrix under a patternless sparsity assumption. In contrast to existing approaches based on thresholding or shrinkage penalties, we propose a likelihood-based method that regularizes…

Methodology · Statistics 2021-09-13 Jason Xu , Kenneth Lange

In non-linear estimations, it is common to assess sampling uncertainty by bootstrap inference. For complex models, this can be computationally intensive. This paper combines optimization with resampling: turning stochastic optimization into…

Econometrics · Economics 2022-05-09 Jean-Jacques Forneron

Large-scale online platforms and marketplace systems often evaluate new policies through experiments that randomize treatment across operational units (e.g., geographies, regions, or clusters) over many time periods. In these settings,…

In randomized clinical trials, adjustments for baseline covariates at both design and analysis stages are highly encouraged by regulatory agencies. A recent trend is to use a model-assisted approach for covariate adjustment to gain…

Methodology · Statistics 2021-07-14 Ting Ye , Jun Shao , Yanyao Yi , Qingyuan Zhao

Randomized benchmarking and variants thereof, which we collectively call RB+, are widely used to characterize the performance of quantum computers because they are simple, scalable, and robust to state-preparation and measurement errors.…

Quantum Physics · Physics 2019-06-05 Robin Harper , Ian Hincks , Chris Ferrie , Steven T. Flammia , Joel J. Wallman

We develop a family of accelerated stochastic algorithms that minimize sums of convex functions. Our algorithms improve upon the fastest running time for empirical risk minimization (ERM), and in particular linear least-squares regression,…

Machine Learning · Statistics 2015-06-25 Roy Frostig , Rong Ge , Sham M. Kakade , Aaron Sidford

A common goal in observational research is to estimate marginal causal effects in the presence of confounding variables. One solution to this problem is to use the covariate distribution to weight the outcomes such that the data appear…

Methodology · Statistics 2020-08-18 Kevin P. Josey , Elizabeth Juarez-Colunga , Fan Yang , Debashis Ghosh

Rerandomization utilizes modern computing ability to improve covariate balance while adhering to the randomization principle originally advocated by RA Fisher. Affinely invariant rerandomization has the ``Equal Percent Variance Reducing''…

Methodology · Statistics 2025-04-03 Zhen Zhong , Donald B. Rubin

Controlled experiments are widely used in many applications to investigate the causal relationship between input factors and experimental outcomes. A completely randomized design is usually used to randomly assign treatment levels to…

Methodology · Statistics 2026-05-12 Yiou Li , Lulu Kang , Xiao Huang

In observational studies, propensity scores are commonly estimated by maxi- mum likelihood but may fail to balance high-dimensional pre-treatment covariates even after specification search. We introduce a general framework that unifies and…

Methodology · Statistics 2017-03-22 Qingyuan Zhao

An algorithm for sampling from non-log-concave multivariate distributions is proposed, which improves the adaptive rejection Metropolis sampling (ARMS) algorithm by incorporating the hit and run sampling. It is not rare that the ARMS is…

Computation · Statistics 2015-03-10 Huaiye Zhang , Yuefeng Wu , Lulu Cheng , Inyoung Kim

Traditional MCMC algorithms are computationally intensive and do not scale well to large data. In particular, the Metropolis-Hastings (MH) algorithm requires passing over the entire dataset to evaluate the likelihood ratio in each…

Machine Learning · Statistics 2019-08-29 Tung-Yu Wu , Y. X. Rachel Wang , Wing H. Wong

Markov chain Monte Carlo methods are central in computational statistics, and typically rely on detailed balance to ensure invariance with respect to a target distribution. Although straightforward to construct by Metropolization, this can…

Statistics Theory · Mathematics 2025-11-14 Erik Jansson , Moritz Schauer , Ruben Seyer , Akash Sharma

Randomized Controlled Trials (RCTs) may suffer from limited scope. In particular, samples may be unrepresentative: some RCTs over- or under- sample individuals with certain characteristics compared to the target population, for which one…

Methodology · Statistics 2024-03-15 Bénédicte Colnet , Julie Josse , Gaël Varoquaux , Erwan Scornet

This paper presents an enhanced adaptive random Fourier features (ARFF) training algorithm for shallow neural networks, building upon the work introduced in "Adaptive Random Fourier Features with Metropolis Sampling", Kammonen et al.,…

Machine Learning · Computer Science 2025-05-01 Aku Kammonen , Anamika Pandey , Erik von Schwerin , Raúl Tempone

The performance of Metropolis-Hastings algorithms is highly sensitive to the choice of step size, and miss-specification can lead to severe loss of efficiency. We study algorithms with randomized step sizes, considering both…

Computation · Statistics 2026-01-28 Sebastiano Grazzi , Samuel Livingstone , Lionel Riou-Durand

We present a method for enhanced sampling of molecular dynamics simulations using stochastic resetting. Various phenomena, ranging from crystal nucleation to protein folding, occur on timescales that are unreachable in standard simulations.…

Chemical Physics · Physics 2023-02-09 Ofir Blumer , Shlomi Reuveni , Barak Hirshberg

Covariate balancing is a popular technique for controlling confounding in observational studies. It finds weights for the treatment group which are close to uniform, but make the group's covariate means (approximately) equal to those of the…

Methodology · Statistics 2025-03-07 Shiva Kaul , Min-Gyu Kim

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos