English
Related papers

Related papers: Sigmoid-FTRL: Design-Based Adaptive Neyman Allocat…

200 papers

We study the problem of constructing an estimator of the average treatment effect (ATE) with observational data. The celebrated doubly-robust, augmented-IPW (AIPW) estimator generally requires consistent estimation of both nuisance…

Methodology · Statistics 2024-12-13 Matteo Bonvini , Edward H. Kennedy , Oliver Dukes , Sivaraman Balakrishnan

We propose a new adaptive hypothesis test for inequality (e.g., monotonicity, convexity) and equality (e.g., parametric, semiparametric) restrictions on a structural function in a nonparametric instrumental variables (NPIV) model. Our test…

Econometrics · Economics 2024-11-08 Christoph Breunig , Xiaohong Chen

We consider the framework of non-stationary stochastic optimization [Besbes et al, 2015] with squared error losses and noisy gradient feedback where the dynamic regret of an online learner against a time varying comparator sequence is…

Machine Learning · Computer Science 2020-10-02 Dheeraj Baby , Yu-Xiang Wang

This paper aims first at a simultaneous axiomatic presentation of the proof of optimal convergence rates for adaptive finite element methods and second at some refinements of particular questions like the avoidance of (discrete) lower…

Numerical Analysis · Mathematics 2014-03-14 Carsten Carstensen , Michael Feischl , Marcus Page , Dirk Praetorius

We consider the model of nonregular nonparametric regression where smoothness constraints are imposed on the regression function $f$ and the regression errors are assumed to decay with some sharpness level at their endpoints. The aim of…

Statistics Theory · Mathematics 2014-10-02 Moritz Jirak , Alexander Meister , Markus Reiß

This note describes the optimal policy rule, according to the local asymptotic minimax regret criterion, for best arm identification when there are only two treatments. It is shown that the optimal sampling rule is the Neyman allocation,…

Econometrics · Economics 2022-08-29 Karun Adusumilli

In the framework of online convex optimization, most iterative algorithms require the computation of projections onto convex sets, which can be computationally expensive. To tackle this problem HK12 proposed the study of projection-free…

Machine Learning · Computer Science 2022-12-16 Zhou Lu , Nataly Brukhim , Paula Gradu , Elad Hazan

This paper explores adaptive variance reduction methods for stochastic optimization based on the STORM technique. Existing adaptive extensions of STORM rely on strong assumptions like bounded gradients and bounded function values, or suffer…

Optimization and Control · Mathematics 2024-10-24 Wei Jiang , Sifan Yang , Yibo Wang , Lijun Zhang

The uneven distribution of local data across different edge devices (clients) results in slow model training and accuracy reduction in federated learning. Naive federated learning (FL) strategy and most alternative solutions attempted to…

We study the problem of adaptively controlling a known discrete-time nonlinear system subject to unmodeled disturbances. We prove the first finite-time regret bounds for adaptive nonlinear control with matched uncertainty in the stochastic…

Machine Learning · Computer Science 2020-11-30 Nicholas M. Boffi , Stephen Tu , Jean-Jacques E. Slotine

We consider the classical problem of selecting the best of two treatments in clinical trials with binary response. The target is to find the design that maximizes the power of the relevant test. Many papers use a normal approximation to the…

Statistics Theory · Mathematics 2011-03-22 David Azriel , Micha Mandel , Yosef Rinott

We study online convex optimization on $\ell_p$-balls in $\mathbb{R}^d$ for $p > 2$. While always sub-linear, the optimal regret exhibits a shift between the high-dimensional setting ($d > T$), when the dimension $d$ is greater than the…

Machine Learning · Computer Science 2025-12-01 Emmeran Johnson , David Martínez-Rubio , Ciara Pike-Burke , Patrick Rebeschini

Personalized decision-making, tailored to individual characteristics, is gaining significant attention. The optimal treatment regime aims to provide the best-expected outcome in the entire population, known as the value function. One…

Methodology · Statistics 2024-05-28 Yuwen Cheng , Shu Yang

We consider the problem of controlling an unknown linear dynamical system under adversarially changing convex costs and full feedback of both the state and cost function. We present the first computationally-efficient algorithm that attains…

Machine Learning · Computer Science 2022-06-06 Asaf Cassel , Alon Cohen , Tomer Koren

Adaptive designs dynamically update treatment probabilities using information accumulated during the experiment. Existing theory for causal inference from adaptive experiments primarily assumes the superpopulation framework with independent…

Methodology · Statistics 2026-02-26 Xinran Li , Anqi Zhao

Practitioners conducting adaptive experiments often encounter two competing priorities: maximizing total welfare (or `reward') through effective treatment assignment and swiftly concluding experiments to implement population-wide…

Machine Learning · Computer Science 2024-07-31 Chao Qin , Daniel Russo

We consider decision-making problems involving the optimization of linear objective functions with uncertain coefficients. The probability distribution of the coefficients--which are assumed to be stochastic in nature--is unknown to the…

Optimization and Control · Mathematics 2024-12-23 Eilyan Bitar

This paper considers adaptive, minimax estimation of a quadratic functional in a nonparametric instrumental variables (NPIV) model, which is an important problem in optimal estimation of a nonlinear functional of an ill-posed inverse…

Statistics Theory · Mathematics 2022-02-10 Christoph Breunig , Xiaohong Chen

We consider a semi-supervised classification problem with non-stationary label-shift in which we observe a labelled data set followed by a sequence of unlabelled covariate vectors in which the marginal probabilities of the class labels may…

Statistics Theory · Mathematics 2024-05-29 Henry W J Reeve

A considerable chasm has been looming for decades between theory and practice in zero-sum game solving through first-order methods. Although a convergence rate of $T^{-1}$ has long been established, the most effective paradigm in practice…

Computer Science and Game Theory · Computer Science 2026-02-18 Brian Hu Zhang , Ioannis Anagnostides , Tuomas Sandholm