English
Related papers

Related papers: Sigmoid-FTRL: Design-Based Adaptive Neyman Allocat…

200 papers

In this paper we develop a nonparametric regression method that is simultaneously adaptive over a wide range of function classes for the regression function and robust over a large collection of error distributions, including those that are…

Statistics Theory · Mathematics 2008-10-28 Lawrence D. Brown , T. Tony Cai , Harrison H. Zhou

We present a reduction from reinforcement learning (RL) to no-regret online learning based on the saddle-point formulation of RL, by which "any" online algorithm with sublinear regret can generate policies with provable performance…

Machine Learning · Computer Science 2020-01-03 Ching-An Cheng , Remi Tachet des Combes , Byron Boots , Geoff Gordon

Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models,…

Applications · Statistics 2018-03-14 German A. Schnaidt Grez , Brani Vidakovic

We consider estimation and control in linear time-varying dynamical systems from the perspective of regret minimization. Unlike most prior work in this area, we focus on the problem of designing causal estimators and controllers which…

Machine Learning · Computer Science 2021-06-24 Gautam Goel , Babak Hassibi

Estimation and inference for the Average Treatment Effect (ATE) is a cornerstone of causal inference and often serves as the foundation for developing procedures for more complicated settings. Although traditionally analyzed in a batch…

Machine Learning · Statistics 2025-02-10 Ojash Neopane , Aaditya Ramdas , Aarti Singh

We introduce Cautious Optimism, a framework for substantially faster regularized learning in general games. Cautious Optimism, as a variant of Optimism, adaptively controls the learning pace in a dynamic, non-monotone manner to accelerate…

Machine Learning · Computer Science 2025-11-17 Ashkan Soleymani , Georgios Piliouras , Gabriele Farina

Distributionally Robust Optimization (DRO) is a popular framework for decision-making under uncertainty, but its adversarial nature can lead to overly conservative solutions. To address this, we study ex-ante Distributionally Robust Regret…

Optimization and Control · Mathematics 2025-04-22 Lukas-Benedikt Fiechtner , Jose Blanchet

In this paper, we clarify the relations between the existing sets of regularity conditions for convergence rates of nonparametric indirect regression (NPIR) and nonparametric instrumental variables (NPIV) regression models. We establish…

Statistics Theory · Mathematics 2007-09-14 Xiaohong Chen , Markus Reiss

Adaptive gradient algorithms such as ADAGRAD and its variants have gained popularity in the training of deep neural networks. While many works as for adaptive methods have focused on the static regret as a performance metric to achieve a…

Machine Learning · Computer Science 2022-09-07 Parvin Nazari , Esmaile Khorram

This paper introduces a dual-based algorithm framework for solving the regularized online resource allocation problems, which have potentially non-concave cumulative rewards, hard resource constraints, and a non-separable regularizer. Under…

Machine Learning · Computer Science 2023-07-18 Wanteng Ma , Ying Cao , Danny H. K. Tsang , Dong Xia

In the multidimensional setting, we consider the errors-in-variables model. We aim at estimating the unknown nonparametric multivariate regression function with errors in the covariates. We devise an adaptive estimator based on projection…

Statistics Theory · Mathematics 2016-01-13 Michaël Chichignoud , Van Ha Hoang , Thanh Mai Pham Ngoc , Vincent Rivoirard

We study nonparametric estimation of the diffusion coefficient from discrete data, when the observations are blurred by additional noise. Such issues have been developed over the last 10 years in several application fields and in particular…

Statistics Theory · Mathematics 2011-12-30 Marc Hoffmann , Axel Munk , Johannes Schmidt-Hieber

We consider the nonparametric regression with a random design model, and we are interested in the adaptive estimation of the regression at a point $x\_0$ where the design is degenerate. When the design density is $\beta$-regularly varying…

Statistics Theory · Mathematics 2016-08-16 Stéphane Gaiffas

In this paper, we first discuss the optimal convergence of the adaptive finite element methods for non-self-adjoint eigenvalue problems. We present new theoretical error estimators and computable error estimators for multiple and clustered…

Numerical Analysis · Mathematics 2026-03-16 Shixi Wang , Hai Bi , Yidu Yang

We consider the problem of estimating the average treatment effect (ATE) when both randomized control trial (RCT) data and external real-world data (RWD) are available. We decompose the ATE estimand as the difference between a pooled-ATE…

Methodology · Statistics 2025-01-22 Mark van der Laan , Sky Qiu , Jens Magelund Tarp , Lars van der Laan

We consider the performance of the difference-in-means estimator in a two-arm randomized experiment under common experimental endpoints such as continuous (regression), incidence, proportion and survival. We examine performance under both…

Statistics Theory · Mathematics 2025-07-08 David Azriel , Abba M. Krieger , Adam Kapelner

We consider a circular deconvolution problem, in which the density $f$ of a circular random variable $X$ must be estimated nonparametrically based on an i.i.d. sample from a noisy observation $Y$ of $X$. The additive measurement error is…

Statistics Theory · Mathematics 2013-12-11 Jan Johannes , Maik Schwarz

We design learning rate schedules that minimize regret for SGD-based online learning in the presence of a changing data distribution. We fully characterize the optimal learning rate schedule for online linear regression via a novel analysis…

Machine Learning · Computer Science 2024-06-19 Matthew Fahrbach , Adel Javanmard , Vahab Mirrokni , Pratik Worah

The accelerated failure time (AFT) model is widely used to analyze relationships between variables in the presence of censored observations. However, this model relies on some assumptions such as the error distribution, which can lead to…

Methodology · Statistics 2026-02-10 Sangkon Oh , Hyunjae Lee , Sangwook Kang , Byungtae Seo

We consider the problem of selecting a subset of points from a dataset of $n$ unlabeled examples for labeling, with the goal of training a multiclass classifier. To address this, we build upon the regret minimization framework introduced by…

Machine Learning · Computer Science 2026-02-27 Youguang Chen , George Biros