English
Related papers

Related papers: Efficient Inference after Directionally Stable Ada…

200 papers

We introduce two data-driven procedures for optimal estimation and inference in nonparametric models using instrumental variables. The first is a data-driven choice of sieve dimension for a popular class of sieve two-stage least squares…

Econometrics · Economics 2024-01-09 Xiaohong Chen , Timothy Christensen , Sid Kankanala

This paper proposes a novel approach to adaptive step sizes in stochastic gradient descent (SGD) by utilizing quantities that we have identified as numerically traceable -- the Lipschitz constant for gradients and a concept of the local…

Optimization and Control · Mathematics 2024-09-19 Frederik Köhne , Leonie Kreis , Anton Schiela , Roland Herzog

The class of $\alpha$-stable distributions is widely used in various applications, especially for modelling heavy-tailed data. Although the $\alpha$-stable distributions have been used in practice for many years, new methods for…

Methodology · Statistics 2022-12-29 Kewin Pączek , Damian Jelito , Marcin Pitera , Agnieszka Wyłomańska

This paper presents an approach to trajectory-centric learning control based on contraction metrics and disturbance estimation for nonlinear systems subject to matched uncertainties. The approach uses deep neural networks to learn uncertain…

Systems and Control · Electrical Eng. & Systems 2024-07-25 Pan Zhao , Ziyao Guo , Yikun Cheng , Aditya Gahlawat , Hyungsoo Kang , Naira Hovakimyan

We consider statistical inference for a finite-dimensional parameter in a regular semiparametric model under a distributed setting with blockwise missingness, where entire blocks of variables are unavailable at certain sites and sharing…

Methodology · Statistics 2025-08-26 Jingyue Huang , Huiyuan Wang , Yuqing Lei , Yong Chen

This study considers various semiparametric difference-in-differences models under different assumptions on the relation between the treatment group identifier, time and covariates for cross-sectional and panel data. The variance lower…

Econometrics · Economics 2020-08-17 Michael Zimmert

This paper studies distributed adaptive estimation over sensor networks with partially unknown source dynamics. We present parallel continuous-time and discrete-time designs in which each node runs a local adaptive observer and exchanges…

Systems and Control · Electrical Eng. & Systems 2026-05-18 Moh Kamalul Wafi , Hamidreza Montazeri Hedesh , Milad Siami

We develop new sub-optimality bounds for gradient descent (GD) that depend on the conditioning of the objective along the path of optimization rather than on global, worst-case constants. Key to our proofs is directional smoothness, a…

Machine Learning · Computer Science 2025-01-15 Aaron Mishkin , Ahmed Khaled , Yuanhao Wang , Aaron Defazio , Robert M. Gower

We evaluate the performance of Whittle index policy for restless Markovian bandits, when the number of bandits grows. It is proven in [30] that this performance is asymptotically optimal if the bandits are indexable and the associated…

Performance · Computer Science 2020-12-17 Nicolas Gast , Bruno Gaujal , Chen Yan

The doubly robust (DR) estimator, which consists of two nuisance parameters, the conditional mean outcome and the logging policy (the probability of choosing an action), is crucial in causal inference. This paper proposes a DR estimator for…

Machine Learning · Computer Science 2021-06-22 Masahiro Kato , Shota Yasui , Kenichiro McAlinn

Data that is gathered adaptively --- via bandit algorithms, for example --- exhibits bias. This is true both when gathering simple numeric valued data --- the empirical means kept track of by stochastic bandit algorithms are biased…

Machine Learning · Computer Science 2018-06-07 Seth Neel , Aaron Roth

This paper obtains asymptotic results for parametric inference using prediction-based estimating functions when the data are high frequency observations of a diffusion process with an infinite time horizon. Specifically, the data are…

Statistics Theory · Mathematics 2020-07-27 Emil S. Jørgensen , Michael Sørensen

This paper is devoted to the study of tilt stability in finite dimensional optimization via the approach of using the subgradient graphical derivative. We establish a new characterization of tilt-stable local minimizers for a broad class of…

Optimization and Control · Mathematics 2017-05-30 Nguyen Huy Chieu , Le Van Hien , Tran T. A. Nghia

When data are collected adaptively, such as in bandit algorithms, classical statistical approaches such as ordinary least squares and $M$-estimation will often fail to achieve asymptotic normality. Although recent lines of work have…

Methodology · Statistics 2026-02-10 James Leiner , Robin Dunn , Aaditya Ramdas

Conformal prediction has emerged as an effective strategy for uncertainty quantification by modifying a model to output sets of labels instead of a single label. These prediction sets come with the guarantee that they contain the true label…

Machine Learning · Computer Science 2025-05-28 Haosen Ge , Hamsa Bastani , Osbert Bastani

We consider stochastic non-stationary linear bandits where the linear parameter connecting contexts to the reward changes over time. Existing algorithms in this setting localize the policy by gradually discarding or down-weighting past…

Machine Learning · Statistics 2026-03-05 Margherita Lazzaretto , Jonas Peters , Niklas Pfister

Adaptive experiments such as multi-arm bandits adapt the treatment-allocation policy and/or the decision to stop the experiment to the data observed so far. This has the potential to improve outcomes for study participants within the…

Methodology · Statistics 2024-05-03 Aurélien Bibaut , Nathan Kallus

This letter proposes a convolutional neural network (CNN)-based adaptive controller wtih three notable features: 1) it determines control input directly from historical sensor data (in an end-to-end process); 2) it learns the desired…

Systems and Control · Electrical Eng. & Systems 2024-03-07 Myeongseok Ryu , Kyunghwan Choi

Causal discovery from observational data is a fundamental task in artificial intelligence, with far-reaching implications for decision-making, predictions, and interventions. Despite significant advances, existing methods can be broadly…

Machine Learning · Computer Science 2026-02-06 Jincheng Zhou , Mengbo Wang , Anqi He , Yumeng Zhou , Hessam Olya , Murat Kocaoglu , Bruno Ribeiro

Stochastic coordinate descent algorithms are efficient methods in which each iterate is obtained by fixing most coordinates at their values from the current iteration, and approximately minimizing the objective with respect to the remaining…

Machine Learning · Statistics 2025-04-02 Eméric Gbaguidi