English
Related papers

Related papers: Stochastic Online Instrumental Variable Regression…

200 papers

The deployment of Multi-Armed Bandits (MAB) has become commonplace in many economic applications. However, regret guarantees for even state-of-the-art linear bandit algorithms (such as Optimism in the Face of Uncertainty Linear bandit…

Econometrics · Economics 2023-02-28 Jingwen Zhang , Yifang Chen , Amandeep Singh

The endogeneity issue is fundamentally important as many empirical applications may suffer from the omission of explanatory variables, measurement error, or simultaneous causality. Recently, \cite{hllt17} propose a "Deep Instrumental…

Statistics Theory · Mathematics 2020-05-01 Ruiqi Liu , Zuofeng Shang , Guang Cheng

We study the problem of online generalized linear regression in the stochastic setting, where the label is generated from a generalized linear model with possibly unbounded additive noise. We provide a sharp analysis of the classical…

Machine Learning · Computer Science 2023-03-28 Heyang Zhao , Dongruo Zhou , Jiafan He , Quanquan Gu

We propose an algorithmic framework, Offline Estimation to Decisions (OE2D), that reduces contextual bandit learning with general reward function approximation to offline regression. The framework allows near-optimal regret for contextual…

Machine Learning · Computer Science 2026-02-11 Hao Qin , Chicheng Zhang

This paper addresses the critical challenge of stochastic latent heterogeneity in online decision-making, where individuals' responses to actions vary not only with observable contexts but also with unobserved, randomly realized subgroups.…

Machine Learning · Computer Science 2025-11-17 Elynn Chen , Xi Chen , Wenbo Jing , Xiao Liu

We consider the problem of online learning in misspecified linear stochastic multi-armed bandit problems. Regret guarantees for state-of-the-art linear bandit algorithms such as Optimism in the Face of Uncertainty Linear bandit (OFUL) hold…

Machine Learning · Computer Science 2017-04-25 Avishek Ghosh , Sayak Ray Chowdhury , Aditya Gopalan

Stochastic linear bandits are a fundamental model for sequential decision making, where an agent selects a vector-valued action and receives a noisy reward with expected value given by an unknown linear function. Although well studied in…

Machine Learning · Computer Science 2025-06-23 Bruce Huang , Ruida Zhou , Lin F. Yang , Suhas Diggavi

We consider the online version of the isotonic regression problem. Given a set of linearly ordered points (e.g., on the real line), the learner must predict labels sequentially at adversarially chosen positions and is evaluated by her total…

Machine Learning · Computer Science 2016-10-10 Wojciech Kotłowski , Wouter M. Koolen , Alan Malek

We study a variant of the stochastic linear bandit problem wherein we optimize a linear objective function but rewards are accrued only orthogonal to an unknown subspace (which we interpret as a \textit{protected space}) given only…

Machine Learning · Computer Science 2021-03-03 Advait Parulekar , Soumya Basu , Aditya Gopalan , Karthikeyan Shanmugam , Sanjay Shakkottai

We develop and analyze algorithms for instrumental variable regression by viewing the problem as a conditional stochastic optimization problem. In the context of least-squares instrumental variable regression, our algorithms neither require…

Machine Learning · Statistics 2024-05-31 Xuxing Chen , Abhishek Roy , Yifan Hu , Krishnakumar Balasubramanian

This paper investigates regret minimization, statistical inference, and their interplay in high-dimensional online decision-making based on the sparse linear context bandit model. We integrate the $\varepsilon$-greedy bandit algorithm for…

Machine Learning · Computer Science 2025-05-20 Congyuan Duan , Wanteng Ma , Jiashuo Jiang , Dong Xia

In this paper, we study a special bandit setting of online stochastic linear optimization, where only one-bit of information is revealed to the learner at each round. This problem has found many applications including online advertisement…

Machine Learning · Computer Science 2015-09-28 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

Recent literature has made much progress in understanding \emph{online LQR}: a modern learning-theoretic take on the classical control problem in which a learner attempts to optimally control an unknown linear dynamical system with fully…

Machine Learning · Computer Science 2020-10-06 Max Simchowitz

We study time-inhomogeneous episodic reinforcement learning (RL) under general function approximation and sparse rewards. We design a new algorithm, Variance-weighted Optimistic $Q$-Learning (VO$Q$L), based on $Q$-learning and bound its…

Machine Learning · Computer Science 2022-12-13 Alekh Agarwal , Yujia Jin , Tong Zhang

We study a noise model for linear stochastic bandits for which the subgaussian noise parameter vanishes linearly as we select actions on the unit sphere closer and closer to the unknown vector. We introduce an algorithm for this problem…

Machine Learning · Computer Science 2025-10-28 Josep Lumbreras , Marco Tomamichel

Online bilevel optimization (OBO) is a powerful framework for machine learning problems where both outer and inner objectives evolve over time, requiring dynamic updates. Current OBO approaches rely on deterministic \textit{window-smoothed}…

Machine Learning · Computer Science 2026-05-20 Parvin Nazari , Bojian Hou , Davoud Ataee Tarzanagh , Li Shen , George Michailidis

We study contextual online pricing with biased offline data. For the scalar price elasticity case, we identify the instance-dependent quantity $\delta^2$ that measures how far the offline data lies from the (unknown) online optimum. We show…

Machine Learning · Computer Science 2025-07-04 Yixuan Zhang , Ruihao Zhu , Qiaomin Xie

We study the stochastic linear bandits with parameter noise model, in which the reward of action $a$ is $a^\top \theta$ where $\theta$ is sampled i.i.d. We show a regret upper bound of $\widetilde{O} (\sqrt{d T \log (K/\delta)…

Machine Learning · Computer Science 2026-05-26 Daniel Ezer , Alon Peled-Cohen , Yishay Mansour

Self-normalized martingale inequalities lie at the heart of confidence ellipsoids for online least squares and, more broadly, many bandit and reinforcement-learning results. Yet existing vector and scalar results typically rely on bounded…

Machine Learning · Statistics 2026-05-05 Fan Chen , Jian Qian , Alexander Rakhlin , Nikita Zhivotovskiy

We study an online linear regression setting in which the observed feature vectors are corrupted by noise and the learner can pay to reduce the noise level. In practice, this may happen for several reasons: for example, because features can…

Machine Learning · Computer Science 2025-11-12 Nadav Merlis , Kyoungseok Jang , Nicolò Cesa-Bianchi
‹ Prev 1 2 3 10 Next ›