English
Related papers

Related papers: Stronger Neyman Regret Guarantees for Adaptive Exp…

200 papers

This paper aims first at a simultaneous axiomatic presentation of the proof of optimal convergence rates for adaptive finite element methods and second at some refinements of particular questions like the avoidance of (discrete) lower…

Numerical Analysis · Mathematics 2014-03-14 Carsten Carstensen , Michael Feischl , Marcus Page , Dirk Praetorius

In many applications, e.g. in healthcare and e-commerce, the goal of a contextual bandit may be to learn an optimal treatment assignment policy at the end of the experiment. That is, to minimize simple regret. However, this objective…

Machine Learning · Computer Science 2023-11-06 Sanath Kumar Krishnamurthy , Ruohan Zhan , Susan Athey , Emma Brunskill

We study the framework of a dynamic decision-making scenario with resource constraints. In this framework, an agent, whose target is to maximize the total reward under the initial inventory, selects an action in each round upon observing a…

Machine Learning · Computer Science 2024-12-19 Zhaohua Chen , Rui Ai , Mingwei Yang , Yuqi Pan , Chang Wang , Xiaotie Deng

Online structured prediction, including online classification as a special case, is the task of sequentially predicting labels from input features. In this setting, the surrogate regret -- the cumulative excess of the actual target loss…

Machine Learning · Computer Science 2026-05-15 Shinsaku Sakaue , Han Bao , Yuzhou Cao

Many critical decisions, such as personalized medical diagnoses and product pricing, are made based on insights gained from designing, observing, and analyzing a series of experiments. This highlights the crucial role of experimental…

Machine Learning · Statistics 2025-01-03 Daolang Huang , Yujia Guo , Luigi Acerbi , Samuel Kaski

The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of possibly-noisy tests, and is relevant in applications such as medical testing, communication protocols, pattern…

Information Theory · Computer Science 2018-10-05 Jonathan Scarlett

We propose a new concept named adaptive submodularity ratio to study the greedy policy for sequential decision making. While the greedy policy is known to perform well for a wide variety of adaptive stochastic optimization problems in…

Machine Learning · Computer Science 2019-04-25 Kaito Fujii , Shinsaku Sakaue

We consider reinforcement learning (RL) in episodic MDPs with adversarial full-information reward feedback and unknown fixed transition kernels. We propose two model-free policy optimization algorithms, POWER and POWER++, and establish…

Machine Learning · Computer Science 2020-07-02 Yingjie Fei , Zhuoran Yang , Zhaoran Wang , Qiaomin Xie

We study the adaptive control of an unknown linear system with a quadratic cost function subject to safety constraints on both the states and actions. The challenges of this problem arise from the tension among safety, exploration,…

Systems and Control · Electrical Eng. & Systems 2021-11-02 Yingying Li , Subhro Das , Jeff Shamma , Na Li

Although online convex optimization (OCO) under arbitrary delays has received increasing attention recently, previous studies focus on stationary environments with the goal of minimizing static regret. In this paper, we investigate the…

Machine Learning · Computer Science 2025-11-10 Yuanyu Wan , Chang Yao , Yitao Ma , Mingli Song , Lijun Zhang

Adaptive sequential decision making is one of the central challenges in machine learning and artificial intelligence. In such problems, the goal is to design an interactive policy that plans for an action to take, from a finite set of $n$…

Machine Learning · Computer Science 2020-07-28 Hossein Esfandiari , Amin Karbasi , Vahab Mirrokni

We study clustered multitask learning in a semiparametric setting where tasks share a latent cluster structure in their target parameters but exhibit heterogeneous, potentially infinite-dimensional nuisance components. Such heterogeneity…

Machine Learning · Statistics 2026-05-05 Hanxiao Chen , Debarghya Mukherjee

This paper addresses safe distributed online optimization over an unknown set of linear safety constraints. A network of agents aims at jointly minimizing a global, time-varying function, which is only partially observable to each…

Optimization and Control · Mathematics 2023-02-27 Ting-Jui Chang , Sapana Chaudhary , Dileep Kalathil , Shahin Shahrampour

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

Machine Learning · Computer Science 2023-08-17 Mengfan Xu , Diego Klabjan

We study unconstrained Online Linear Optimization with Lipschitz losses. Motivated by the pursuit of instance optimality, we propose a new algorithm that simultaneously achieves ($i$) the AdaGrad-style second order gradient adaptivity; and…

Machine Learning · Computer Science 2024-02-23 Zhiyu Zhang , Heng Yang , Ashok Cutkosky , Ioannis Ch. Paschalidis

This paper proposes an adaptive random experiment design (ARED) algorithm that can be applied to optimize the multiple factors and levels experiments. The algorithm takes real-time model error as the adaptive condition, and outputs a model…

Signal Processing · Electrical Eng. & Systems 2020-09-01 Zhou Qiao , Duan Xiaochang , Tang Wei

We investigate bandit convex optimization (BCO) with delayed feedback, where only the loss value of the action is revealed under an arbitrary delay. Let $n,T,\bar{d}$ denote the dimensionality, time horizon, and average delay, respectively.…

Machine Learning · Computer Science 2024-06-25 Yuanyu Wan , Chang Yao , Mingli Song , Lijun Zhang

Neural networks hold great potential to act as approximate models of nonlinear dynamical systems, with the resulting neural approximations enabling verification and control of such systems. However, in safety-critical contexts, the use of…

Machine Learning · Computer Science 2025-09-30 Frederik Baymler Mathiesen , Nikolaus Vertovec , Francesco Fabiano , Luca Laurenti , Alessandro Abate

We study the problem of non-stationary dueling bandits and provide the first adaptive dynamic regret algorithm for this problem. The only two existing attempts in this line of work fall short across multiple dimensions, including…

Machine Learning · Computer Science 2022-10-27 Thomas Kleine Buening , Aadirupa Saha

Due to the drastic gap in complexity between sequential and batch statistical learning, recent work has studied a smoothed sequential learning setting, where Nature is constrained to select contexts with density bounded by 1/{\sigma} with…

Machine Learning · Statistics 2022-05-27 Adam Block , Max Simchowitz